2023-10-25T23:23:46.651 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-25T23:23:46.652 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} --name pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi --owner scheduled_pdonnell@teuthology --verbose --archive /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436391 -- /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436391/orig.config.yaml 2023-10-25T23:23:46.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T23:23:46.784 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436391 branch: wip-batrick-testing-20231024.144545 description: fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} email: pdonnell@redhat.com first_in_suite: false job_id: '7436391' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-batrick-testing-20231024.144545 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 384993681abceb8cb8affea10538d607052db4b4 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 384993681abceb8cb8affea10538d607052db4b4 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20231024.144545 sha1: 384993681abceb8cb8affea10538d607052db4b4 owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 seed: 7595 sha1: 384993681abceb8cb8affea10538d607052db4b4 sleep_before_teardown: 0 subset: 66/256 suite: fs suite_branch: wip-batrick-testing-20231024.144545 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 384993681abceb8cb8affea10538d607052db4b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - workunit: clients: all: - fs/snaps timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 202b180cb047e798fb131047314a862593f45403 timestamp: 2023-10-24_19:52:40 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.770726 2023-10-25T23:23:46.785 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa; will attempt to use it 2023-10-25T23:23:46.786 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks 2023-10-25T23:23:46.786 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-25T23:23:46.788 INFO:teuthology.task.internal:Checking packages... 2023-10-25T23:23:46.811 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '384993681abceb8cb8affea10538d607052db4b4' 2023-10-25T23:23:46.812 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-25T23:23:46.812 INFO:teuthology.packaging:ref: None 2023-10-25T23:23:46.813 INFO:teuthology.packaging:tag: None 2023-10-25T23:23:46.813 INFO:teuthology.packaging:branch: wip-batrick-testing-20231024.144545 2023-10-25T23:23:46.813 INFO:teuthology.packaging:sha1: 384993681abceb8cb8affea10538d607052db4b4 2023-10-25T23:23:46.814 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-batrick-testing-20231024.144545 2023-10-25T23:23:47.039 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6863.g38499368 2023-10-25T23:23:47.039 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-25T23:23:47.048 INFO:teuthology.task.internal:no buildpackages task found 2023-10-25T23:23:47.049 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-25T23:23:47.105 INFO:teuthology.task.internal:Saving configuration 2023-10-25T23:23:47.122 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-25T23:23:47.133 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-25T23:23:47.157 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436391', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 23:18:37.973011', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-25T23:23:47.179 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436391', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 23:18:37.974450', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-25T23:23:47.179 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-25T23:23:47.188 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-10-25T23:23:47.189 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-10-25T23:23:47.189 INFO:teuthology.run_tasks:Running task console_log... 2023-10-25T23:23:47.290 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe38f6b1a60>, signals=[15]) 2023-10-25T23:23:47.292 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-25T23:23:47.305 INFO:teuthology.task.internal:Opening connections... 2023-10-25T23:23:47.306 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2023-10-25T23:23:47.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T23:23:47.373 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2023-10-25T23:23:47.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T23:23:47.441 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-25T23:23:47.453 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-10-25T23:23:47.474 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-10-25T23:23:47.474 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-10-25T23:23:47.530 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2023-10-25T23:23:47.531 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)" 2023-10-25T23:23:47.531 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2023-10-25T23:23:47.531 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2023-10-25T23:23:47.531 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6" 2023-10-25T23:23:47.531 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2023-10-25T23:23:47.532 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-25T23:23:47.532 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2023-10-25T23:23:47.532 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-25T23:23:47.532 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2023-10-25T23:23:47.532 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-25T23:23:47.533 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-25T23:23:47.533 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:23:47.533 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-25T23:23:47.533 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-25T23:23:47.533 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-25T23:23:47.533 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-25T23:23:47.534 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-10-25T23:23:47.558 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-10-25T23:23:47.580 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-10-25T23:23:47.580 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-10-25T23:23:47.639 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Red Hat Enterprise Linux" 2023-10-25T23:23:47.640 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8.6 (Ootpa)" 2023-10-25T23:23:47.640 INFO:teuthology.orchestra.run.smithi089.stdout:ID="rhel" 2023-10-25T23:23:47.640 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="fedora" 2023-10-25T23:23:47.640 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8.6" 2023-10-25T23:23:47.641 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8" 2023-10-25T23:23:47.641 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-25T23:23:47.641 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-10-25T23:23:47.641 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-25T23:23:47.641 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.redhat.com/" 2023-10-25T23:23:47.642 INFO:teuthology.orchestra.run.smithi089.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-25T23:23:47.642 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-25T23:23:47.642 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:23:47.642 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-25T23:23:47.642 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-25T23:23:47.642 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-25T23:23:47.643 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-25T23:23:47.643 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-10-25T23:23:47.666 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-25T23:23:47.678 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-25T23:23:47.722 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-25T23:23:47.723 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2023-10-25T23:23:47.725 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2023-10-25T23:23:47.744 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-25T23:23:47.778 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-25T23:23:47.779 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2023-10-25T23:23:47.783 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2023-10-25T23:23:47.815 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-25T23:23:47.873 INFO:teuthology.run_tasks:Running task kernel... 2023-10-25T23:23:47.892 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-25T23:23:47.893 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2023-10-25T23:23:47.894 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2023-10-25T23:23:47.894 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-25T23:23:47.913 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T23:23:47.914 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2023-10-25T23:23:47.973 INFO:teuthology.orchestra.run.smithi081.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-25T23:23:47.974 INFO:teuthology.task.kernel:Running kernel on smithi081: 4.18.0-372.9.1.el8.x86_64 2023-10-25T23:23:47.974 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum install -y kernel 2023-10-25T23:23:49.145 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-10-25T23:23:49.145 INFO:teuthology.orchestra.run.smithi081.stdout:Unable to read consumer identity 2023-10-25T23:23:50.525 INFO:teuthology.orchestra.run.smithi081.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-25T23:23:51.351 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2023-10-25T23:23:54.843 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 454 kB/s | 24 kB 00:00 2023-10-25T23:23:55.520 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-25T23:23:55.569 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2023-10-25T23:23:55.570 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2023-10-25T23:23:55.570 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2023-10-25T23:23:55.697 DEBUG:teuthology.orchestra.run.smithi081:> echo no | sudo yum reinstall kernel || true 2023-10-25T23:23:56.028 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-10-25T23:23:56.028 INFO:teuthology.orchestra.run.smithi081.stdout:Unable to read consumer identity 2023-10-25T23:23:56.285 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:02 ago on Wed 25 Oct 2023 11:23:54 PM UTC. 2023-10-25T23:23:56.326 INFO:teuthology.orchestra.run.smithi081.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-25T23:23:56.365 INFO:teuthology.orchestra.run.smithi081.stderr:Error: No packages marked for reinstall. 2023-10-25T23:23:56.411 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum reinstall -y kernel || true 2023-10-25T23:23:56.740 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-10-25T23:23:56.740 INFO:teuthology.orchestra.run.smithi081.stdout:Unable to read consumer identity 2023-10-25T23:23:56.994 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:02 ago on Wed 25 Oct 2023 11:23:54 PM UTC. 2023-10-25T23:23:57.034 INFO:teuthology.orchestra.run.smithi081.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-25T23:23:57.064 INFO:teuthology.orchestra.run.smithi081.stderr:Error: No packages marked for reinstall. 2023-10-25T23:23:57.110 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2023-10-25T23:23:57.194 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-25T23:23:57.195 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-25T23:23:57.196 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-25T23:23:57.197 DEBUG:teuthology.parallel:result is None 2023-10-25T23:23:57.198 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-25T23:23:57.211 INFO:teuthology.task.internal:Creating test directory... 2023-10-25T23:23:57.212 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-25T23:23:57.216 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-25T23:23:57.239 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-25T23:23:57.319 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-25T23:23:57.526 INFO:teuthology.task.internal:Creating archive directory... 2023-10-25T23:23:57.527 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-25T23:23:57.529 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-25T23:23:57.596 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-25T23:23:57.613 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-25T23:23:57.614 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-25T23:23:57.639 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T23:23:57.640 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-25T23:23:57.648 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-25T23:23:57.692 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-25T23:23:57.704 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-25T23:23:57.721 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-25T23:23:57.773 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-25T23:23:57.775 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-25T23:23:57.791 INFO:teuthology.task.internal:Configuring sudo... 2023-10-25T23:23:57.791 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-25T23:23:57.802 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-25T23:23:57.851 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-25T23:23:57.872 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-25T23:23:57.873 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-25T23:23:57.883 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-25T23:23:57.915 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-25T23:23:57.988 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-25T23:23:58.030 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-25T23:23:58.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-25T23:23:58.161 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:23:58.162 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-25T23:23:58.231 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-25T23:23:58.280 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-25T23:23:58.333 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-25T23:23:58.421 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-25T23:23:58.467 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:23:58.467 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-25T23:23:58.542 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2023-10-25T23:23:58.548 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2023-10-25T23:23:58.605 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-25T23:23:58.650 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-25T23:23:58.914 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-25T23:23:58.923 INFO:teuthology.task.internal:Starting timer... 2023-10-25T23:23:58.923 INFO:teuthology.run_tasks:Running task pcp... 2023-10-25T23:23:59.019 INFO:teuthology.run_tasks:Running task selinux... 2023-10-25T23:23:59.071 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-25T23:23:59.072 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2023-10-25T23:23:59.133 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2023-10-25T23:23:59.135 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2023-10-25T23:23:59.197 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2023-10-25T23:23:59.199 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-25T23:23:59.199 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2023-10-25T23:23:59.225 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2023-10-25T23:23:59.225 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2023-10-25T23:23:59.247 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2023-10-25T23:23:59.248 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi089.front.sepia.ceph.com': 'permissive'} 2023-10-25T23:23:59.248 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-25T23:23:59.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T23:23:59.294 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-25T23:23:59.322 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T23:23:59.322 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-25T23:23:59.323 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2023-10-25T23:23:59.363 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2023-10-25T23:23:59.400 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-25T23:23:59.410 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-25T23:23:59.411 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-25T23:23:59.428 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-25T23:23:59.430 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi089.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-25T23:32:43.384 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi089.front.sepia.ceph.com')] 2023-10-25T23:32:43.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-25T23:32:43.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T23:32:43.469 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-10-25T23:32:43.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-10-25T23:32:43.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-25T23:32:43.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-25T23:32:43.606 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-10-25T23:32:43.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-25T23:32:43.681 INFO:teuthology.run_tasks:Running task clock... 2023-10-25T23:32:43.697 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-25T23:32:43.697 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-25T23:32:43.698 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-25T23:32:43.701 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-25T23:32:43.702 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-25T23:32:43.731 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-25T23:32:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-25T23:32:43.752 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-25T23:32:43.767 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-25T23:32:43.810 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2023-10-25T23:32:43.821 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2023-10-25T23:32:43.829 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2023-10-25T23:32:43.836 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-25T23:32:43.840 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2023-10-25T23:32:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-25T23:32:43.854 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-25T23:32:43.868 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-25T23:32:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:bash: ntpq: command not found 2023-10-25T23:32:43.930 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-25T23:32:43.930 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2023-10-25T23:32:43.930 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-25T23:32:43.931 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-25T23:32:43.931 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-25T23:32:43.931 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-25T23:32:43.936 INFO:teuthology.orchestra.run.smithi089.stderr:bash: ntpq: command not found 2023-10-25T23:32:43.940 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-25T23:32:43.940 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2023-10-25T23:32:43.940 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-25T23:32:43.940 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-25T23:32:43.941 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-25T23:32:43.941 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-25T23:32:43.942 INFO:teuthology.run_tasks:Running task install... 2023-10-25T23:32:43.951 DEBUG:teuthology.task.install:project ceph 2023-10-25T23:32:43.951 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '384993681abceb8cb8affea10538d607052db4b4'}} 2023-10-25T23:32:43.951 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '384993681abceb8cb8affea10538d607052db4b4'} 2023-10-25T23:32:43.952 INFO:teuthology.task.install:Using flavor: default 2023-10-25T23:32:43.957 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-25T23:32:43.958 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-25T23:32:43.959 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '384993681abceb8cb8affea10538d607052db4b4', 'tag': None, 'wait_for_package': False} 2023-10-25T23:32:43.959 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=384993681abceb8cb8affea10538d607052db4b4 2023-10-25T23:32:43.962 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '384993681abceb8cb8affea10538d607052db4b4', 'tag': None, 'wait_for_package': False} 2023-10-25T23:32:43.962 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=384993681abceb8cb8affea10538d607052db4b4 2023-10-25T23:32:44.110 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/ 2023-10-25T23:32:44.111 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6863.g38499368 2023-10-25T23:32:44.123 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/ 2023-10-25T23:32:44.123 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6863.g38499368 2023-10-25T23:32:44.237 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-25T23:32:44.238 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:32:44.238 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-25T23:32:44.266 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-25T23:32:44.267 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/384993681abceb8cb8affea10538d607052db4b4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-25T23:32:44.291 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20231024.144545/384993681abceb8cb8affea10538d607052db4b4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-25T23:32:44.291 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:32:44.291 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-25T23:32:44.320 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-25T23:32:44.320 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/384993681abceb8cb8affea10538d607052db4b4/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-25T23:32:44.335 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-25T23:32:44.388 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-25T23:32:44.411 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-25T23:32:44.465 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-25T23:32:44.477 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2023-10-25T23:32:44.478 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2023-10-25T23:32:44.532 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2023-10-25T23:32:44.533 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2023-10-25T23:32:44.849 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-10-25T23:32:44.904 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-10-25T23:32:45.139 INFO:teuthology.orchestra.run.smithi089.stdout:44 files removed 2023-10-25T23:32:45.147 INFO:teuthology.orchestra.run.smithi081.stdout:44 files removed 2023-10-25T23:32:45.186 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-25T23:32:45.193 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-25T23:32:45.515 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-10-25T23:32:45.522 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2023-10-25T23:32:46.188 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 258 kB/s | 81 kB 00:00 2023-10-25T23:32:46.288 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 200 kB/s | 81 kB 00:00 2023-10-25T23:32:46.563 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 27 kB/s | 9.4 kB 00:00 2023-10-25T23:32:46.656 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 28 kB/s | 9.4 kB 00:00 2023-10-25T23:32:46.855 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 5.5 kB/s | 1.5 kB 00:00 2023-10-25T23:32:47.014 INFO:teuthology.orchestra.run.smithi089.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-25T23:32:47.031 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 4.2 kB/s | 1.5 kB 00:00 2023-10-25T23:32:47.190 INFO:teuthology.orchestra.run.smithi081.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-25T23:32:48.493 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-10-25T23:32:52.000 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 451 kB/s | 24 kB 00:00 2023-10-25T23:32:52.902 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 MB/s | 53 MB 00:00 2023-10-25T23:33:00.936 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 59 MB/s | 47 MB 00:00 2023-10-25T23:33:02.891 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 16 MB 00:15 2023-10-25T23:33:06.422 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 567 kB/s | 24 kB 00:00 2023-10-25T23:33:07.366 INFO:teuthology.orchestra.run.smithi089.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-10-25T23:33:11.761 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-25T23:33:11.761 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-25T23:33:11.776 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-25T23:33:11.777 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-25T23:33:11.777 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-25T23:33:11.779 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-25T23:33:11.781 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-25T23:33:11.786 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-25T23:33:11.787 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-25T23:33:11.917 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2023-10-25T23:33:11.937 INFO:teuthology.orchestra.run.smithi081.stdout:=========================================================================================================================== 2023-10-25T23:33:11.937 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2023-10-25T23:33:11.938 INFO:teuthology.orchestra.run.smithi081.stdout:=========================================================================================================================== 2023-10-25T23:33:11.938 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2023-10-25T23:33:11.938 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-25T23:33:11.939 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-25T23:33:11.939 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:18.0.0-6863.g38499368.el8 ceph 6.4 k 2023-10-25T23:33:11.939 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:18.0.0-6863.g38499368.el8 ceph 5.4 M 2023-10-25T23:33:11.939 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:18.0.0-6863.g38499368.el8 ceph 918 k 2023-10-25T23:33:11.940 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6863.g38499368.el8 ceph 167 k 2023-10-25T23:33:11.940 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:18.0.0-6863.g38499368.el8 ceph 1.6 M 2023-10-25T23:33:11.940 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 132 k 2023-10-25T23:33:11.940 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 1.8 M 2023-10-25T23:33:11.940 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 7.4 M 2023-10-25T23:33:11.941 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 48 k 2023-10-25T23:33:11.941 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:18.0.0-6863.g38499368.el8 ceph 14 M 2023-10-25T23:33:11.941 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:18.0.0-6863.g38499368.el8 ceph 49 M 2023-10-25T23:33:11.941 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 261 k 2023-10-25T23:33:11.942 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 191 k 2023-10-25T23:33:11.942 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:18.0.0-6863.g38499368.el8 ceph 261 k 2023-10-25T23:33:11.942 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 18 k 2023-10-25T23:33:11.943 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-25T23:33:11.943 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-25T23:33:11.943 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-25T23:33:11.943 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:18.0.0-6863.g38499368.el8 ceph 31 k 2023-10-25T23:33:11.944 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:18.0.0-6863.g38499368.el8 ceph 840 k 2023-10-25T23:33:11.944 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:18.0.0-6863.g38499368.el8 ceph 139 k 2023-10-25T23:33:11.944 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-25T23:33:11.944 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-25T23:33:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-25T23:33:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-25T23:33:11.945 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-25T23:33:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-25T23:33:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:18.0.0-6863.g38499368.el8 ceph 197 k 2023-10-25T23:33:11.946 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:18.0.0-6863.g38499368.el8 ceph 371 k 2023-10-25T23:33:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:18.0.0-6863.g38499368.el8 ceph 364 k 2023-10-25T23:33:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:18.0.0-6863.g38499368.el8 ceph 107 k 2023-10-25T23:33:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:18.0.0-6863.g38499368.el8 ceph 94 k 2023-10-25T23:33:11.947 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:18.0.0-6863.g38499368.el8 ceph 3.6 M 2023-10-25T23:33:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:18.0.0-6863.g38499368.el8 ceph 179 k 2023-10-25T23:33:11.948 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-25T23:33:11.949 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2023-10-25T23:33:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-25T23:33:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:18.0.0-6863.g38499368.el8 ceph 3.7 M 2023-10-25T23:33:11.949 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:18.0.0-6863.g38499368.el8 ceph 3.7 M 2023-10-25T23:33:11.950 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2023-10-25T23:33:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-25T23:33:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:18.0.0-6863.g38499368.el8 ceph 23 M 2023-10-25T23:33:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 23 k 2023-10-25T23:33:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:18.0.0-6863.g38499368.el8 ceph 2.3 M 2023-10-25T23:33:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 242 k 2023-10-25T23:33:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:18.0.0-6863.g38499368.el8 ceph 4.6 M 2023-10-25T23:33:11.951 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:18.0.0-6863.g38499368.el8 ceph 18 M 2023-10-25T23:33:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 15 k 2023-10-25T23:33:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:18.0.0-6863.g38499368.el8 ceph 24 k 2023-10-25T23:33:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-25T23:33:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-25T23:33:11.952 INFO:teuthology.orchestra.run.smithi081.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-25T23:33:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-25T23:33:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-25T23:33:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:18.0.0-6863.g38499368.el8 ceph 184 k 2023-10-25T23:33:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-25T23:33:11.953 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-25T23:33:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-25T23:33:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-25T23:33:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-25T23:33:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-25T23:33:11.954 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:18.0.0-6863.g38499368.el8 ceph 518 k 2023-10-25T23:33:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-25T23:33:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:18.0.0-6863.g38499368.el8 ceph 6.9 M 2023-10-25T23:33:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-25T23:33:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-25T23:33:11.955 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-25T23:33:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-25T23:33:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-25T23:33:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-25T23:33:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-25T23:33:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-25T23:33:11.956 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-25T23:33:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-25T23:33:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-25T23:33:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-25T23:33:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-25T23:33:11.957 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-25T23:33:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-25T23:33:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-25T23:33:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:18.0.0-6863.g38499368.el8 ceph 45 k 2023-10-25T23:33:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:18.0.0-6863.g38499368.el8 ceph 125 k 2023-10-25T23:33:11.958 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-25T23:33:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-25T23:33:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-25T23:33:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-25T23:33:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-25T23:33:11.959 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-25T23:33:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-25T23:33:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-25T23:33:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-25T23:33:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-25T23:33:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-25T23:33:11.960 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-25T23:33:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-25T23:33:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-25T23:33:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-25T23:33:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-25T23:33:11.961 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-25T23:33:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-25T23:33:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-25T23:33:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-25T23:33:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-25T23:33:11.962 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-25T23:33:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-25T23:33:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-25T23:33:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-25T23:33:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-25T23:33:11.963 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-25T23:33:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-25T23:33:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-25T23:33:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-25T23:33:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-25T23:33:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-25T23:33:11.964 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-25T23:33:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-25T23:33:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-25T23:33:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-25T23:33:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-25T23:33:11.965 INFO:teuthology.orchestra.run.smithi081.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-25T23:33:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-25T23:33:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-25T23:33:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-25T23:33:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-25T23:33:11.966 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-25T23:33:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-25T23:33:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-25T23:33:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-25T23:33:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-25T23:33:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-25T23:33:11.967 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-25T23:33:11.968 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling module streams: 2023-10-25T23:33:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql 10 2023-10-25T23:33:11.968 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:33:11.968 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2023-10-25T23:33:11.968 INFO:teuthology.orchestra.run.smithi081.stdout:=========================================================================================================================== 2023-10-25T23:33:11.969 INFO:teuthology.orchestra.run.smithi081.stdout:Install 128 Packages 2023-10-25T23:33:11.969 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 3 Packages 2023-10-25T23:33:11.969 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:33:11.969 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 209 M 2023-10-25T23:33:11.969 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2023-10-25T23:33:12.436 INFO:teuthology.orchestra.run.smithi081.stdout:(1/131): ceph-18.0.0-6863.g38499368.el8.x86_64. 55 kB/s | 6.4 kB 00:00 2023-10-25T23:33:12.678 INFO:teuthology.orchestra.run.smithi081.stdout:(2/131): ceph-fuse-18.0.0-6863.g38499368.el8.x8 3.7 MB/s | 918 kB 00:00 2023-10-25T23:33:12.754 INFO:teuthology.orchestra.run.smithi081.stdout:(3/131): ceph-immutable-object-cache-18.0.0-686 2.2 MB/s | 167 kB 00:00 2023-10-25T23:33:12.954 INFO:teuthology.orchestra.run.smithi081.stdout:(4/131): ceph-base-18.0.0-6863.g38499368.el8.x8 8.5 MB/s | 5.4 MB 00:00 2023-10-25T23:33:13.163 INFO:teuthology.orchestra.run.smithi081.stdout:(5/131): ceph-mds-18.0.0-6863.g38499368.el8.x86 5.7 MB/s | 2.3 MB 00:00 2023-10-25T23:33:13.197 INFO:teuthology.orchestra.run.smithi081.stdout:(6/131): ceph-mgr-18.0.0-6863.g38499368.el8.x86 6.7 MB/s | 1.6 MB 00:00 2023-10-25T23:33:14.030 INFO:teuthology.orchestra.run.smithi081.stdout:(7/131): ceph-mon-18.0.0-6863.g38499368.el8.x86 5.3 MB/s | 4.6 MB 00:00 2023-10-25T23:33:14.480 INFO:teuthology.orchestra.run.smithi081.stdout:(8/131): ceph-common-18.0.0-6863.g38499368.el8. 10 MB/s | 23 MB 00:02 2023-10-25T23:33:14.547 INFO:teuthology.orchestra.run.smithi081.stdout:(9/131): ceph-selinux-18.0.0-6863.g38499368.el8 367 kB/s | 24 kB 00:00 2023-10-25T23:33:14.922 INFO:teuthology.orchestra.run.smithi081.stdout:(10/131): ceph-osd-18.0.0-6863.g38499368.el8.x8 10 MB/s | 18 MB 00:01 2023-10-25T23:33:15.023 INFO:teuthology.orchestra.run.smithi081.stdout:(11/131): cephfs-mirror-18.0.0-6863.g38499368.e 2.6 MB/s | 261 kB 00:00 2023-10-25T23:33:15.098 INFO:teuthology.orchestra.run.smithi081.stdout:(12/131): libcephfs-devel-18.0.0-6863.g38499368 413 kB/s | 31 kB 00:00 2023-10-25T23:33:15.240 INFO:teuthology.orchestra.run.smithi081.stdout:(13/131): libcephfs2-18.0.0-6863.g38499368.el8. 5.8 MB/s | 840 kB 00:00 2023-10-25T23:33:15.315 INFO:teuthology.orchestra.run.smithi081.stdout:(14/131): libcephsqlite-18.0.0-6863.g38499368.e 2.4 MB/s | 184 kB 00:00 2023-10-25T23:33:15.390 INFO:teuthology.orchestra.run.smithi081.stdout:(15/131): librados-devel-18.0.0-6863.g38499368. 1.8 MB/s | 139 kB 00:00 2023-10-25T23:33:15.482 INFO:teuthology.orchestra.run.smithi081.stdout:(16/131): libradosstriper1-18.0.0-6863.g3849936 5.5 MB/s | 518 kB 00:00 2023-10-25T23:33:15.592 INFO:teuthology.orchestra.run.smithi089.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 59 MB/s | 47 MB 00:00 2023-10-25T23:33:16.075 INFO:teuthology.orchestra.run.smithi081.stdout:(17/131): ceph-radosgw-18.0.0-6863.g38499368.el 6.8 MB/s | 14 MB 00:02 2023-10-25T23:33:16.292 INFO:teuthology.orchestra.run.smithi081.stdout:(18/131): librgw2-18.0.0-6863.g38499368.el8.x86 8.6 MB/s | 6.9 MB 00:00 2023-10-25T23:33:16.316 INFO:teuthology.orchestra.run.smithi081.stdout:(19/131): python3-ceph-argparse-18.0.0-6863.g38 185 kB/s | 45 kB 00:00 2023-10-25T23:33:16.342 INFO:teuthology.orchestra.run.smithi081.stdout:(20/131): python3-ceph-common-18.0.0-6863.g3849 2.4 MB/s | 125 kB 00:00 2023-10-25T23:33:16.367 INFO:teuthology.orchestra.run.smithi081.stdout:(21/131): python3-cephfs-18.0.0-6863.g38499368. 3.8 MB/s | 197 kB 00:00 2023-10-25T23:33:16.401 INFO:teuthology.orchestra.run.smithi081.stdout:(22/131): python3-rados-18.0.0-6863.g38499368.e 6.2 MB/s | 371 kB 00:00 2023-10-25T23:33:16.426 INFO:teuthology.orchestra.run.smithi081.stdout:(23/131): python3-rbd-18.0.0-6863.g38499368.el8 6.1 MB/s | 364 kB 00:00 2023-10-25T23:33:16.460 INFO:teuthology.orchestra.run.smithi081.stdout:(24/131): python3-rgw-18.0.0-6863.g38499368.el8 1.8 MB/s | 107 kB 00:00 2023-10-25T23:33:16.485 INFO:teuthology.orchestra.run.smithi081.stdout:(25/131): rbd-fuse-18.0.0-6863.g38499368.el8.x8 1.6 MB/s | 94 kB 00:00 2023-10-25T23:33:16.586 INFO:teuthology.orchestra.run.smithi081.stdout:(26/131): rbd-nbd-18.0.0-6863.g38499368.el8.x86 1.7 MB/s | 179 kB 00:00 2023-10-25T23:33:16.669 INFO:teuthology.orchestra.run.smithi081.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6863.g 277 kB/s | 23 kB 00:00 2023-10-25T23:33:16.761 INFO:teuthology.orchestra.run.smithi081.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6863.g3849936 1.4 MB/s | 132 kB 00:00 2023-10-25T23:33:16.820 INFO:teuthology.orchestra.run.smithi081.stdout:(29/131): rbd-mirror-18.0.0-6863.g38499368.el8. 10 MB/s | 3.6 MB 00:00 2023-10-25T23:33:17.054 INFO:teuthology.orchestra.run.smithi081.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6863.g38499 6.0 MB/s | 1.8 MB 00:00 2023-10-25T23:33:17.154 INFO:teuthology.orchestra.run.smithi081.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6863.g38 2.4 MB/s | 242 kB 00:00 2023-10-25T23:33:17.238 INFO:teuthology.orchestra.run.smithi081.stdout:(32/131): ceph-mgr-rook-18.0.0-6863.g38499368.e 571 kB/s | 48 kB 00:00 2023-10-25T23:33:17.330 INFO:teuthology.orchestra.run.smithi081.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6863.g3 164 kB/s | 15 kB 00:00 2023-10-25T23:33:17.421 INFO:teuthology.orchestra.run.smithi081.stdout:(34/131): ceph-volume-18.0.0-6863.g38499368.el8 2.8 MB/s | 261 kB 00:00 2023-10-25T23:33:17.581 INFO:teuthology.orchestra.run.smithi081.stdout:(35/131): ceph-mgr-diskprediction-local-18.0.0- 9.7 MB/s | 7.4 MB 00:00 2023-10-25T23:33:17.606 INFO:teuthology.orchestra.run.smithi081.stdout:(36/131): cephadm-18.0.0-6863.g38499368.el8.noa 1.0 MB/s | 191 kB 00:00 2023-10-25T23:33:17.639 INFO:teuthology.orchestra.run.smithi081.stdout:(37/131): cephfs-top-18.0.0-6863.g38499368.el8. 310 kB/s | 18 kB 00:00 2023-10-25T23:33:18.098 INFO:teuthology.orchestra.run.smithi081.stdout:(38/131): ceph-test-18.0.0-6863.g38499368.el8.x 14 MB/s | 49 MB 00:03 2023-10-25T23:33:18.373 INFO:teuthology.orchestra.run.smithi081.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 80 kB/s | 59 kB 00:00 2023-10-25T23:33:18.465 INFO:teuthology.orchestra.run.smithi081.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 205 kB/s | 75 kB 00:00 2023-10-25T23:33:18.557 INFO:teuthology.orchestra.run.smithi081.stdout:(41/131): gperftools-libs-2.7-9.el8.x86_64.rpm 322 kB/s | 306 kB 00:00 2023-10-25T23:33:18.591 INFO:teuthology.orchestra.run.smithi081.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 348 kB/s | 44 kB 00:00 2023-10-25T23:33:18.691 INFO:teuthology.orchestra.run.smithi081.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-10-25T23:33:18.708 INFO:teuthology.orchestra.run.smithi081.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 282 kB/s | 33 kB 00:00 2023-10-25T23:33:18.741 INFO:teuthology.orchestra.run.smithi081.stdout:(45/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.3 MB/s | 476 kB 00:00 2023-10-25T23:33:18.783 INFO:teuthology.orchestra.run.smithi081.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 177 kB/s | 16 kB 00:00 2023-10-25T23:33:18.884 INFO:teuthology.orchestra.run.smithi081.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.6 MB/s | 384 kB 00:00 2023-10-25T23:33:18.909 INFO:teuthology.orchestra.run.smithi081.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 648 kB/s | 81 kB 00:00 2023-10-25T23:33:18.943 INFO:teuthology.orchestra.run.smithi081.stdout:(49/131): python3-cheroot-8.5.2-1.el8.noarch.rp 736 kB/s | 173 kB 00:00 2023-10-25T23:33:18.984 INFO:teuthology.orchestra.run.smithi081.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 110 kB/s | 11 kB 00:00 2023-10-25T23:33:19.010 INFO:teuthology.orchestra.run.smithi081.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2023-10-25T23:33:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 486 kB/s | 49 kB 00:00 2023-10-25T23:33:19.119 INFO:teuthology.orchestra.run.smithi081.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 541 kB/s | 59 kB 00:00 2023-10-25T23:33:19.186 INFO:teuthology.orchestra.run.smithi081.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 600 kB/s | 60 kB 00:00 2023-10-25T23:33:19.269 INFO:teuthology.orchestra.run.smithi081.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-10-25T23:33:19.295 INFO:teuthology.orchestra.run.smithi081.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-10-25T23:33:19.328 INFO:teuthology.orchestra.run.smithi081.stdout:(57/131): python3-kubernetes-11.0.0-6.el8.noarc 3.0 MB/s | 1.2 MB 00:00 2023-10-25T23:33:19.371 INFO:teuthology.orchestra.run.smithi081.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 334 kB/s | 34 kB 00:00 2023-10-25T23:33:19.412 INFO:teuthology.orchestra.run.smithi081.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2023-10-25T23:33:19.438 INFO:teuthology.orchestra.run.smithi081.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 587 kB/s | 64 kB 00:00 2023-10-25T23:33:19.471 INFO:teuthology.orchestra.run.smithi081.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 186 kB/s | 19 kB 00:00 2023-10-25T23:33:19.514 INFO:teuthology.orchestra.run.smithi081.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 238 kB/s | 24 kB 00:00 2023-10-25T23:33:19.539 INFO:teuthology.orchestra.run.smithi081.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 291 kB/s | 29 kB 00:00 2023-10-25T23:33:19.572 INFO:teuthology.orchestra.run.smithi081.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 274 kB/s | 27 kB 00:00 2023-10-25T23:33:19.639 INFO:teuthology.orchestra.run.smithi081.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.0 MB/s | 255 kB 00:00 2023-10-25T23:33:19.664 INFO:teuthology.orchestra.run.smithi081.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.0 MB/s | 251 kB 00:00 2023-10-25T23:33:19.690 INFO:teuthology.orchestra.run.smithi081.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 522 kB/s | 61 kB 00:00 2023-10-25T23:33:19.748 INFO:teuthology.orchestra.run.smithi081.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 785 kB/s | 85 kB 00:00 2023-10-25T23:33:19.774 INFO:teuthology.orchestra.run.smithi081.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 211 kB/s | 23 kB 00:00 2023-10-25T23:33:19.799 INFO:teuthology.orchestra.run.smithi081.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-25T23:33:19.849 INFO:teuthology.orchestra.run.smithi081.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 624 kB/s | 47 kB 00:00 2023-10-25T23:33:19.874 INFO:teuthology.orchestra.run.smithi081.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.8 MB/s | 200 kB 00:00 2023-10-25T23:33:19.900 INFO:teuthology.orchestra.run.smithi081.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 847 kB/s | 43 kB 00:00 2023-10-25T23:33:19.925 INFO:teuthology.orchestra.run.smithi081.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-25T23:33:19.950 INFO:teuthology.orchestra.run.smithi081.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 959 kB/s | 48 kB 00:00 2023-10-25T23:33:19.976 INFO:teuthology.orchestra.run.smithi081.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-10-25T23:33:20.001 INFO:teuthology.orchestra.run.smithi081.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 850 kB/s | 43 kB 00:00 2023-10-25T23:33:20.051 INFO:teuthology.orchestra.run.smithi081.stdout:(78/131): thrift-0.13.0-2.el8.x86_64.rpm 4.8 MB/s | 1.7 MB 00:00 2023-10-25T23:33:20.077 INFO:teuthology.orchestra.run.smithi081.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.1 MB/s | 109 kB 00:00 2023-10-25T23:33:20.102 INFO:teuthology.orchestra.run.smithi081.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2023-10-25T23:33:20.144 INFO:teuthology.orchestra.run.smithi081.stdout:(81/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 8.2 MB/s | 560 kB 00:00 2023-10-25T23:33:20.160 INFO:teuthology.orchestra.run.smithi081.stdout:(82/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 224 kB/s | 19 kB 00:00 2023-10-25T23:33:20.186 INFO:teuthology.orchestra.run.smithi081.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.9 MB/s | 155 kB 00:00 2023-10-25T23:33:20.203 INFO:teuthology.orchestra.run.smithi081.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 427 kB/s | 18 kB 00:00 2023-10-25T23:33:20.236 INFO:teuthology.orchestra.run.smithi081.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 5.9 MB/s | 559 kB 00:00 2023-10-25T23:33:20.278 INFO:teuthology.orchestra.run.smithi081.stdout:(86/131): pcre2-devel-10.32-2.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2023-10-25T23:33:20.304 INFO:teuthology.orchestra.run.smithi081.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.3 MB/s | 238 kB 00:00 2023-10-25T23:33:20.329 INFO:teuthology.orchestra.run.smithi081.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-10-25T23:33:20.354 INFO:teuthology.orchestra.run.smithi081.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-25T23:33:20.380 INFO:teuthology.orchestra.run.smithi081.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-10-25T23:33:20.405 INFO:teuthology.orchestra.run.smithi081.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-10-25T23:33:20.430 INFO:teuthology.orchestra.run.smithi081.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-10-25T23:33:20.456 INFO:teuthology.orchestra.run.smithi081.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 766 kB/s | 39 kB 00:00 2023-10-25T23:33:20.490 INFO:teuthology.orchestra.run.smithi081.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-10-25T23:33:20.514 INFO:teuthology.orchestra.run.smithi081.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-10-25T23:33:20.540 INFO:teuthology.orchestra.run.smithi081.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-10-25T23:33:20.599 INFO:teuthology.orchestra.run.smithi081.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.4 MB/s | 2.3 MB 00:00 2023-10-25T23:33:20.624 INFO:teuthology.orchestra.run.smithi081.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.3 MB/s | 110 kB 00:00 2023-10-25T23:33:20.649 INFO:teuthology.orchestra.run.smithi081.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-10-25T23:33:20.674 INFO:teuthology.orchestra.run.smithi081.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2023-10-25T23:33:20.708 INFO:teuthology.orchestra.run.smithi081.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-10-25T23:33:20.733 INFO:teuthology.orchestra.run.smithi081.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 663 kB/s | 39 kB 00:00 2023-10-25T23:33:20.767 INFO:teuthology.orchestra.run.smithi081.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-10-25T23:33:20.800 INFO:teuthology.orchestra.run.smithi081.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.9 MB/s | 538 kB 00:00 2023-10-25T23:33:20.826 INFO:teuthology.orchestra.run.smithi081.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-25T23:33:20.851 INFO:teuthology.orchestra.run.smithi081.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-25T23:33:20.893 INFO:teuthology.orchestra.run.smithi081.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-10-25T23:33:20.935 INFO:teuthology.orchestra.run.smithi081.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 640 kB/s | 27 kB 00:00 2023-10-25T23:33:20.977 INFO:teuthology.orchestra.run.smithi081.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-25T23:33:21.011 INFO:teuthology.orchestra.run.smithi081.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-10-25T23:33:21.094 INFO:teuthology.orchestra.run.smithi081.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-10-25T23:33:21.136 INFO:teuthology.orchestra.run.smithi081.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-10-25T23:33:21.178 INFO:teuthology.orchestra.run.smithi081.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-10-25T23:33:21.237 INFO:teuthology.orchestra.run.smithi081.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 17 MB/s | 3.7 MB 00:00 2023-10-25T23:33:21.262 INFO:teuthology.orchestra.run.smithi081.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 767 kB/s | 64 kB 00:00 2023-10-25T23:33:21.337 INFO:teuthology.orchestra.run.smithi081.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.2 MB/s | 126 kB 00:00 2023-10-25T23:33:21.489 INFO:teuthology.orchestra.run.smithi081.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 88 kB/s | 20 kB 00:00 2023-10-25T23:33:21.655 INFO:teuthology.orchestra.run.smithi081.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 326 kB/s | 103 kB 00:00 2023-10-25T23:33:21.697 INFO:teuthology.orchestra.run.smithi081.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 3.3 MB/s | 709 kB 00:00 2023-10-25T23:33:21.839 INFO:teuthology.orchestra.run.smithi081.stdout:(120/131): python3-scipy-1.0.0-21.module+el8.5. 10 MB/s | 14 MB 00:01 2023-10-25T23:33:21.864 INFO:teuthology.orchestra.run.smithi081.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.2 MB/s | 198 kB 00:00 2023-10-25T23:33:21.906 INFO:teuthology.orchestra.run.smithi081.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-10-25T23:33:21.948 INFO:teuthology.orchestra.run.smithi081.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-25T23:33:22.048 INFO:teuthology.orchestra.run.smithi081.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 12 MB/s | 4.9 MB 00:00 2023-10-25T23:33:22.124 INFO:teuthology.orchestra.run.smithi081.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-10-25T23:33:22.174 INFO:teuthology.orchestra.run.smithi081.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.3 MB/s | 808 kB 00:00 2023-10-25T23:33:22.232 INFO:teuthology.orchestra.run.smithi081.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 14 MB/s | 1.5 MB 00:00 2023-10-25T23:33:22.316 INFO:teuthology.orchestra.run.smithi081.stdout:(128/131): postgresql-server-10.21-2.module+el8 14 MB/s | 5.1 MB 00:00 2023-10-25T23:33:22.375 INFO:teuthology.orchestra.run.smithi081.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-25T23:33:22.658 INFO:teuthology.orchestra.run.smithi081.stdout:(130/131): librbd1-18.0.0-6863.g38499368.el8.x8 8.7 MB/s | 3.7 MB 00:00 2023-10-25T23:33:22.717 INFO:teuthology.orchestra.run.smithi081.stdout:(131/131): librados2-18.0.0-6863.g38499368.el8. 6.9 MB/s | 3.7 MB 00:00 2023-10-25T23:33:22.719 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2023-10-25T23:33:22.719 INFO:teuthology.orchestra.run.smithi081.stdout:Total 19 MB/s | 209 MB 00:10 2023-10-25T23:33:23.545 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2023-10-25T23:33:23.664 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2023-10-25T23:33:23.664 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2023-10-25T23:33:24.785 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2023-10-25T23:33:24.789 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2023-10-25T23:33:26.649 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-25T23:33:26.650 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-25T23:33:26.665 INFO:teuthology.orchestra.run.smithi089.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-25T23:33:26.666 INFO:teuthology.orchestra.run.smithi089.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-25T23:33:26.668 INFO:teuthology.orchestra.run.smithi089.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-25T23:33:26.669 INFO:teuthology.orchestra.run.smithi089.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-25T23:33:26.671 INFO:teuthology.orchestra.run.smithi089.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-25T23:33:26.675 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-25T23:33:26.676 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-25T23:33:26.813 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-10-25T23:33:26.826 INFO:teuthology.orchestra.run.smithi089.stdout:=========================================================================================================================== 2023-10-25T23:33:26.826 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-10-25T23:33:26.826 INFO:teuthology.orchestra.run.smithi089.stdout:=========================================================================================================================== 2023-10-25T23:33:26.826 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-10-25T23:33:26.826 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-25T23:33:26.827 INFO:teuthology.orchestra.run.smithi089.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-25T23:33:26.827 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:18.0.0-6863.g38499368.el8 ceph 6.4 k 2023-10-25T23:33:26.827 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:18.0.0-6863.g38499368.el8 ceph 5.4 M 2023-10-25T23:33:26.827 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:18.0.0-6863.g38499368.el8 ceph 918 k 2023-10-25T23:33:26.828 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6863.g38499368.el8 ceph 167 k 2023-10-25T23:33:26.828 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:18.0.0-6863.g38499368.el8 ceph 1.6 M 2023-10-25T23:33:26.828 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 132 k 2023-10-25T23:33:26.828 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 1.8 M 2023-10-25T23:33:26.828 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 7.4 M 2023-10-25T23:33:26.829 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 48 k 2023-10-25T23:33:26.829 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:18.0.0-6863.g38499368.el8 ceph 14 M 2023-10-25T23:33:26.829 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:18.0.0-6863.g38499368.el8 ceph 49 M 2023-10-25T23:33:26.829 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 261 k 2023-10-25T23:33:26.829 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 191 k 2023-10-25T23:33:26.830 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror x86_64 2:18.0.0-6863.g38499368.el8 ceph 261 k 2023-10-25T23:33:26.830 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 18 k 2023-10-25T23:33:26.830 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-25T23:33:26.830 INFO:teuthology.orchestra.run.smithi089.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-25T23:33:26.831 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-25T23:33:26.831 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:18.0.0-6863.g38499368.el8 ceph 31 k 2023-10-25T23:33:26.833 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:18.0.0-6863.g38499368.el8 ceph 840 k 2023-10-25T23:33:26.833 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:18.0.0-6863.g38499368.el8 ceph 139 k 2023-10-25T23:33:26.834 INFO:teuthology.orchestra.run.smithi089.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-25T23:33:26.834 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-25T23:33:26.834 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-25T23:33:26.834 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-25T23:33:26.834 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-25T23:33:26.835 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-25T23:33:26.835 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:18.0.0-6863.g38499368.el8 ceph 197 k 2023-10-25T23:33:26.835 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:18.0.0-6863.g38499368.el8 ceph 371 k 2023-10-25T23:33:26.835 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:18.0.0-6863.g38499368.el8 ceph 364 k 2023-10-25T23:33:26.835 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:18.0.0-6863.g38499368.el8 ceph 107 k 2023-10-25T23:33:26.836 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:18.0.0-6863.g38499368.el8 ceph 94 k 2023-10-25T23:33:26.836 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:18.0.0-6863.g38499368.el8 ceph 3.6 M 2023-10-25T23:33:26.836 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:18.0.0-6863.g38499368.el8 ceph 179 k 2023-10-25T23:33:26.836 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-25T23:33:26.836 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2023-10-25T23:33:26.837 INFO:teuthology.orchestra.run.smithi089.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-25T23:33:26.837 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:18.0.0-6863.g38499368.el8 ceph 3.7 M 2023-10-25T23:33:26.837 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:18.0.0-6863.g38499368.el8 ceph 3.7 M 2023-10-25T23:33:26.837 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-10-25T23:33:26.837 INFO:teuthology.orchestra.run.smithi089.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-25T23:33:26.838 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:18.0.0-6863.g38499368.el8 ceph 23 M 2023-10-25T23:33:26.838 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 23 k 2023-10-25T23:33:26.838 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:18.0.0-6863.g38499368.el8 ceph 2.3 M 2023-10-25T23:33:26.838 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 242 k 2023-10-25T23:33:26.838 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:18.0.0-6863.g38499368.el8 ceph 4.6 M 2023-10-25T23:33:26.839 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:18.0.0-6863.g38499368.el8 ceph 18 M 2023-10-25T23:33:26.839 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6863.g38499368.el8 ceph-noarch 15 k 2023-10-25T23:33:26.839 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:18.0.0-6863.g38499368.el8 ceph 24 k 2023-10-25T23:33:26.839 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-25T23:33:26.839 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-25T23:33:26.840 INFO:teuthology.orchestra.run.smithi089.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-25T23:33:26.840 INFO:teuthology.orchestra.run.smithi089.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-25T23:33:26.840 INFO:teuthology.orchestra.run.smithi089.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-25T23:33:26.840 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:18.0.0-6863.g38499368.el8 ceph 184 k 2023-10-25T23:33:26.840 INFO:teuthology.orchestra.run.smithi089.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-25T23:33:26.841 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-25T23:33:26.841 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-25T23:33:26.841 INFO:teuthology.orchestra.run.smithi089.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-25T23:33:26.841 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-25T23:33:26.841 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-25T23:33:26.841 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:18.0.0-6863.g38499368.el8 ceph 518 k 2023-10-25T23:33:26.842 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-25T23:33:26.842 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:18.0.0-6863.g38499368.el8 ceph 6.9 M 2023-10-25T23:33:26.842 INFO:teuthology.orchestra.run.smithi089.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-25T23:33:26.842 INFO:teuthology.orchestra.run.smithi089.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-25T23:33:26.843 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-25T23:33:26.843 INFO:teuthology.orchestra.run.smithi089.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-25T23:33:26.843 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-25T23:33:26.843 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-25T23:33:26.843 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-25T23:33:26.844 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-25T23:33:26.844 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-25T23:33:26.844 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-25T23:33:26.844 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-25T23:33:26.844 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-25T23:33:26.845 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-25T23:33:26.845 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-25T23:33:26.845 INFO:teuthology.orchestra.run.smithi089.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-25T23:33:26.845 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-25T23:33:26.845 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:18.0.0-6863.g38499368.el8 ceph 45 k 2023-10-25T23:33:26.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:18.0.0-6863.g38499368.el8 ceph 125 k 2023-10-25T23:33:26.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-25T23:33:26.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-25T23:33:26.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-25T23:33:26.846 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-25T23:33:26.847 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-25T23:33:26.847 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-25T23:33:26.847 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-25T23:33:26.847 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-25T23:33:26.847 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-25T23:33:26.847 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-25T23:33:26.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-25T23:33:26.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-25T23:33:26.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-25T23:33:26.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-25T23:33:26.848 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-25T23:33:26.849 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-25T23:33:26.849 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-25T23:33:26.849 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-25T23:33:26.849 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-25T23:33:26.849 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-25T23:33:26.850 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-25T23:33:26.850 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-25T23:33:26.850 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-25T23:33:26.850 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-25T23:33:26.850 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-25T23:33:26.851 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-25T23:33:26.851 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-25T23:33:26.851 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-25T23:33:26.851 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-25T23:33:26.851 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-25T23:33:26.851 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-25T23:33:26.852 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-25T23:33:26.852 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-25T23:33:26.852 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-25T23:33:26.852 INFO:teuthology.orchestra.run.smithi089.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-25T23:33:26.853 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-25T23:33:26.853 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-25T23:33:26.853 INFO:teuthology.orchestra.run.smithi089.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-25T23:33:26.853 INFO:teuthology.orchestra.run.smithi089.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-25T23:33:26.853 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-25T23:33:26.854 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-25T23:33:26.854 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-25T23:33:26.854 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-25T23:33:26.854 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-25T23:33:26.854 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-25T23:33:26.855 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-25T23:33:26.855 INFO:teuthology.orchestra.run.smithi089.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-25T23:33:26.855 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-25T23:33:26.855 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-25T23:33:26.855 INFO:teuthology.orchestra.run.smithi089.stdout:Enabling module streams: 2023-10-25T23:33:26.855 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql 10 2023-10-25T23:33:26.856 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:33:26.856 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-10-25T23:33:26.856 INFO:teuthology.orchestra.run.smithi089.stdout:=========================================================================================================================== 2023-10-25T23:33:26.856 INFO:teuthology.orchestra.run.smithi089.stdout:Install 128 Packages 2023-10-25T23:33:26.856 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 3 Packages 2023-10-25T23:33:26.857 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:33:26.857 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 209 M 2023-10-25T23:33:26.857 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-10-25T23:33:27.058 INFO:teuthology.orchestra.run.smithi089.stdout:(1/131): ceph-18.0.0-6863.g38499368.el8.x86_64. 34 kB/s | 6.4 kB 00:00 2023-10-25T23:33:27.409 INFO:teuthology.orchestra.run.smithi089.stdout:(2/131): ceph-base-18.0.0-6863.g38499368.el8.x8 10 MB/s | 5.4 MB 00:00 2023-10-25T23:33:27.484 INFO:teuthology.orchestra.run.smithi089.stdout:(3/131): ceph-fuse-18.0.0-6863.g38499368.el8.x8 2.1 MB/s | 918 kB 00:00 2023-10-25T23:33:27.509 INFO:teuthology.orchestra.run.smithi089.stdout:(4/131): ceph-immutable-object-cache-18.0.0-686 1.6 MB/s | 167 kB 00:00 2023-10-25T23:33:27.653 INFO:teuthology.orchestra.run.smithi089.stdout:(5/131): ceph-mgr-18.0.0-6863.g38499368.el8.x86 11 MB/s | 1.6 MB 00:00 2023-10-25T23:33:28.033 INFO:teuthology.orchestra.run.smithi089.stdout:(6/131): ceph-mon-18.0.0-6863.g38499368.el8.x86 12 MB/s | 4.6 MB 00:00 2023-10-25T23:33:28.102 INFO:teuthology.orchestra.run.smithi089.stdout:(7/131): ceph-mds-18.0.0-6863.g38499368.el8.x86 3.7 MB/s | 2.3 MB 00:00 2023-10-25T23:33:29.610 INFO:teuthology.orchestra.run.smithi089.stdout:(8/131): ceph-common-18.0.0-6863.g38499368.el8. 8.3 MB/s | 23 MB 00:02 2023-10-25T23:33:29.776 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2023-10-25T23:33:29.819 INFO:teuthology.orchestra.run.smithi089.stdout:(9/131): ceph-osd-18.0.0-6863.g38499368.el8.x86 10 MB/s | 18 MB 00:01 2023-10-25T23:33:29.844 INFO:teuthology.orchestra.run.smithi089.stdout:(10/131): ceph-selinux-18.0.0-6863.g38499368.el 104 kB/s | 24 kB 00:00 2023-10-25T23:33:29.928 INFO:teuthology.orchestra.run.smithi089.stdout:(11/131): cephfs-mirror-18.0.0-6863.g38499368.e 3.1 MB/s | 261 kB 00:00 2023-10-25T23:33:29.972 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-25T23:33:30.020 INFO:teuthology.orchestra.run.smithi089.stdout:(12/131): libcephfs-devel-18.0.0-6863.g38499368 338 kB/s | 31 kB 00:00 2023-10-25T23:33:30.155 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-25T23:33:30.287 INFO:teuthology.orchestra.run.smithi089.stdout:(13/131): ceph-radosgw-18.0.0-6863.g38499368.el 6.4 MB/s | 14 MB 00:02 2023-10-25T23:33:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-25T23:33:30.345 INFO:teuthology.orchestra.run.smithi089.stdout:(14/131): libcephfs2-18.0.0-6863.g38499368.el8. 2.5 MB/s | 840 kB 00:00 2023-10-25T23:33:30.370 INFO:teuthology.orchestra.run.smithi089.stdout:(15/131): libcephsqlite-18.0.0-6863.g38499368.e 2.2 MB/s | 184 kB 00:00 2023-10-25T23:33:30.429 INFO:teuthology.orchestra.run.smithi089.stdout:(16/131): librados-devel-18.0.0-6863.g38499368. 1.6 MB/s | 139 kB 00:00 2023-10-25T23:33:30.449 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-25T23:33:30.463 INFO:teuthology.orchestra.run.smithi089.stdout:(17/131): libradosstriper1-18.0.0-6863.g3849936 5.5 MB/s | 518 kB 00:00 2023-10-25T23:33:30.546 INFO:teuthology.orchestra.run.smithi089.stdout:(18/131): python3-ceph-argparse-18.0.0-6863.g38 536 kB/s | 45 kB 00:00 2023-10-25T23:33:30.638 INFO:teuthology.orchestra.run.smithi089.stdout:(19/131): python3-ceph-common-18.0.0-6863.g3849 1.3 MB/s | 125 kB 00:00 2023-10-25T23:33:30.657 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-25T23:33:30.739 INFO:teuthology.orchestra.run.smithi089.stdout:(20/131): python3-cephfs-18.0.0-6863.g38499368. 1.9 MB/s | 197 kB 00:00 2023-10-25T23:33:30.847 INFO:teuthology.orchestra.run.smithi089.stdout:(21/131): python3-rados-18.0.0-6863.g38499368.e 3.3 MB/s | 371 kB 00:00 2023-10-25T23:33:30.956 INFO:teuthology.orchestra.run.smithi089.stdout:(22/131): python3-rbd-18.0.0-6863.g38499368.el8 3.3 MB/s | 364 kB 00:00 2023-10-25T23:33:31.056 INFO:teuthology.orchestra.run.smithi089.stdout:(23/131): librgw2-18.0.0-6863.g38499368.el8.x86 11 MB/s | 6.9 MB 00:00 2023-10-25T23:33:31.070 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-25T23:33:31.081 INFO:teuthology.orchestra.run.smithi089.stdout:(24/131): python3-rgw-18.0.0-6863.g38499368.el8 854 kB/s | 107 kB 00:00 2023-10-25T23:33:31.140 INFO:teuthology.orchestra.run.smithi089.stdout:(25/131): rbd-fuse-18.0.0-6863.g38499368.el8.x8 1.1 MB/s | 94 kB 00:00 2023-10-25T23:33:31.232 INFO:teuthology.orchestra.run.smithi089.stdout:(26/131): rbd-nbd-18.0.0-6863.g38499368.el8.x86 1.9 MB/s | 179 kB 00:00 2023-10-25T23:33:31.291 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:18.0.0-6863.g38499368.el8.x86_64 5/134 2023-10-25T23:33:31.324 INFO:teuthology.orchestra.run.smithi089.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6863.g 252 kB/s | 23 kB 00:00 2023-10-25T23:33:31.408 INFO:teuthology.orchestra.run.smithi089.stdout:(28/131): rbd-mirror-18.0.0-6863.g38499368.el8. 11 MB/s | 3.6 MB 00:00 2023-10-25T23:33:31.433 INFO:teuthology.orchestra.run.smithi089.stdout:(29/131): ceph-mgr-cephadm-18.0.0-6863.g3849936 1.2 MB/s | 132 kB 00:00 2023-10-25T23:33:31.608 INFO:teuthology.orchestra.run.smithi089.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6863.g38499 8.8 MB/s | 1.8 MB 00:00 2023-10-25T23:33:31.686 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:18.0.0-6863.g38499368.el8.x86_64 5/134 2023-10-25T23:33:31.717 INFO:teuthology.orchestra.run.smithi089.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6863.g38 2.2 MB/s | 242 kB 00:00 2023-10-25T23:33:31.809 INFO:teuthology.orchestra.run.smithi089.stdout:(32/131): ceph-mgr-rook-18.0.0-6863.g38499368.e 520 kB/s | 48 kB 00:00 2023-10-25T23:33:31.874 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:18.0.0-6863.g38499368.el8.x86_64 6/134 2023-10-25T23:33:31.892 INFO:teuthology.orchestra.run.smithi089.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6863.g3 180 kB/s | 15 kB 00:00 2023-10-25T23:33:31.984 INFO:teuthology.orchestra.run.smithi089.stdout:(34/131): ceph-volume-18.0.0-6863.g38499368.el8 2.8 MB/s | 261 kB 00:00 2023-10-25T23:33:32.005 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:18.0.0-6863.g38499368.el8.x86_64 6/134 2023-10-25T23:33:32.084 INFO:teuthology.orchestra.run.smithi089.stdout:(35/131): cephadm-18.0.0-6863.g38499368.el8.noa 1.9 MB/s | 191 kB 00:00 2023-10-25T23:33:32.177 INFO:teuthology.orchestra.run.smithi089.stdout:(36/131): cephfs-top-18.0.0-6863.g38499368.el8. 197 kB/s | 18 kB 00:00 2023-10-25T23:33:32.327 INFO:teuthology.orchestra.run.smithi089.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 8.3 MB/s | 7.4 MB 00:00 2023-10-25T23:33:32.399 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 7/134 2023-10-25T23:33:32.498 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 7/134 2023-10-25T23:33:32.511 INFO:teuthology.orchestra.run.smithi089.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 329 kB/s | 59 kB 00:00 2023-10-25T23:33:32.536 INFO:teuthology.orchestra.run.smithi089.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 853 kB/s | 306 kB 00:00 2023-10-25T23:33:32.631 INFO:teuthology.orchestra.run.smithi089.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 625 kB/s | 75 kB 00:00 2023-10-25T23:33:32.670 INFO:teuthology.orchestra.run.smithi089.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.5 MB/s | 476 kB 00:00 2023-10-25T23:33:32.671 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:18.0.0-6863.g38499368.el8.x86_64 8/134 2023-10-25T23:33:32.695 INFO:teuthology.orchestra.run.smithi089.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 686 kB/s | 44 kB 00:00 2023-10-25T23:33:32.754 INFO:teuthology.orchestra.run.smithi089.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.2 MB/s | 185 kB 00:00 2023-10-25T23:33:32.771 INFO:teuthology.orchestra.run.smithi089.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 438 kB/s | 33 kB 00:00 2023-10-25T23:33:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-25T23:33:33.126 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-25T23:33:33.218 INFO:teuthology.orchestra.run.smithi089.stdout:(45/131): ceph-test-18.0.0-6863.g38499368.el8.x 14 MB/s | 49 MB 00:03 2023-10-25T23:33:33.238 INFO:teuthology.orchestra.run.smithi089.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 34 kB/s | 16 kB 00:00 2023-10-25T23:33:33.272 INFO:teuthology.orchestra.run.smithi089.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 345 kB/s | 173 kB 00:00 2023-10-25T23:33:33.305 INFO:teuthology.orchestra.run.smithi089.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.3 MB/s | 81 kB 00:00 2023-10-25T23:33:33.331 INFO:teuthology.orchestra.run.smithi089.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 192 kB/s | 11 kB 00:00 2023-10-25T23:33:33.336 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-25T23:33:33.364 INFO:teuthology.orchestra.run.smithi089.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 300 kB/s | 18 kB 00:00 2023-10-25T23:33:33.423 INFO:teuthology.orchestra.run.smithi089.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 838 kB/s | 49 kB 00:00 2023-10-25T23:33:33.448 INFO:teuthology.orchestra.run.smithi089.stdout:(52/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.6 MB/s | 384 kB 00:00 2023-10-25T23:33:33.482 INFO:teuthology.orchestra.run.smithi089.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 7.7 MB/s | 1.2 MB 00:00 2023-10-25T23:33:33.499 INFO:teuthology.orchestra.run.smithi089.stdout:(54/131): python3-more-itertools-7.2.0-3.el8.no 777 kB/s | 59 kB 00:00 2023-10-25T23:33:33.515 INFO:teuthology.orchestra.run.smithi089.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 897 kB/s | 60 kB 00:00 2023-10-25T23:33:33.549 INFO:teuthology.orchestra.run.smithi089.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 4.1 MB/s | 283 kB 00:00 2023-10-25T23:33:33.575 INFO:teuthology.orchestra.run.smithi089.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2023-10-25T23:33:33.591 INFO:teuthology.orchestra.run.smithi089.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 446 kB/s | 34 kB 00:00 2023-10-25T23:33:33.617 INFO:teuthology.orchestra.run.smithi089.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 2.9 MB/s | 196 kB 00:00 2023-10-25T23:33:33.642 INFO:teuthology.orchestra.run.smithi089.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 956 kB/s | 64 kB 00:00 2023-10-25T23:33:33.659 INFO:teuthology.orchestra.run.smithi089.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 279 kB/s | 19 kB 00:00 2023-10-25T23:33:33.676 INFO:teuthology.orchestra.run.smithi089.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 407 kB/s | 24 kB 00:00 2023-10-25T23:33:33.693 INFO:teuthology.orchestra.run.smithi089.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 582 kB/s | 29 kB 00:00 2023-10-25T23:33:33.735 INFO:teuthology.orchestra.run.smithi089.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 470 kB/s | 27 kB 00:00 2023-10-25T23:33:33.740 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-25T23:33:33.779 INFO:teuthology.orchestra.run.smithi089.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.4 MB/s | 255 kB 00:00 2023-10-25T23:33:33.802 INFO:teuthology.orchestra.run.smithi089.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 912 kB/s | 61 kB 00:00 2023-10-25T23:33:33.828 INFO:teuthology.orchestra.run.smithi089.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-10-25T23:33:33.853 INFO:teuthology.orchestra.run.smithi089.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 459 kB/s | 23 kB 00:00 2023-10-25T23:33:33.878 INFO:teuthology.orchestra.run.smithi089.stdout:(69/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.3 MB/s | 251 kB 00:00 2023-10-25T23:33:33.903 INFO:teuthology.orchestra.run.smithi089.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-10-25T23:33:33.953 INFO:teuthology.orchestra.run.smithi089.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 624 kB/s | 47 kB 00:00 2023-10-25T23:33:33.979 INFO:teuthology.orchestra.run.smithi089.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.8 MB/s | 200 kB 00:00 2023-10-25T23:33:34.004 INFO:teuthology.orchestra.run.smithi089.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 848 kB/s | 43 kB 00:00 2023-10-25T23:33:34.029 INFO:teuthology.orchestra.run.smithi089.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-25T23:33:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-25T23:33:34.063 INFO:teuthology.orchestra.run.smithi089.stdout:(75/131): thrift-0.13.0-2.el8.x86_64.rpm 7.4 MB/s | 1.7 MB 00:00 2023-10-25T23:33:34.088 INFO:teuthology.orchestra.run.smithi089.stdout:(76/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 573 kB/s | 48 kB 00:00 2023-10-25T23:33:34.130 INFO:teuthology.orchestra.run.smithi089.stdout:(77/131): libsepol-devel-2.9-3.el8.x86_64.rpm 866 kB/s | 87 kB 00:00 2023-10-25T23:33:34.164 INFO:teuthology.orchestra.run.smithi089.stdout:(78/131): python3-requests-oauthlib-1.0.0-1.el8 425 kB/s | 43 kB 00:00 2023-10-25T23:33:34.189 INFO:teuthology.orchestra.run.smithi089.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.1 MB/s | 109 kB 00:00 2023-10-25T23:33:34.207 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 14/134 2023-10-25T23:33:34.215 INFO:teuthology.orchestra.run.smithi089.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2023-10-25T23:33:34.240 INFO:teuthology.orchestra.run.smithi089.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 373 kB/s | 19 kB 00:00 2023-10-25T23:33:34.265 INFO:teuthology.orchestra.run.smithi089.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-10-25T23:33:34.307 INFO:teuthology.orchestra.run.smithi089.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.8 MB/s | 560 kB 00:00 2023-10-25T23:33:34.322 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 14/134 2023-10-25T23:33:34.332 INFO:teuthology.orchestra.run.smithi089.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 267 kB/s | 18 kB 00:00 2023-10-25T23:33:34.382 INFO:teuthology.orchestra.run.smithi089.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 3.8 MB/s | 559 kB 00:00 2023-10-25T23:33:34.408 INFO:teuthology.orchestra.run.smithi089.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.1 MB/s | 238 kB 00:00 2023-10-25T23:33:34.433 INFO:teuthology.orchestra.run.smithi089.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-10-25T23:33:34.458 INFO:teuthology.orchestra.run.smithi089.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-10-25T23:33:34.482 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:18.0.0-6863.g38499368.el8.x86 15/134 2023-10-25T23:33:34.483 INFO:teuthology.orchestra.run.smithi089.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-25T23:33:34.509 INFO:teuthology.orchestra.run.smithi089.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-10-25T23:33:34.525 INFO:teuthology.orchestra.run.smithi089.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 2.3 MB/s | 98 kB 00:00 2023-10-25T23:33:34.551 INFO:teuthology.orchestra.run.smithi089.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.3 MB/s | 58 kB 00:00 2023-10-25T23:33:34.576 INFO:teuthology.orchestra.run.smithi089.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 767 kB/s | 39 kB 00:00 2023-10-25T23:33:34.632 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6863.g38499368.el8.x86 15/134 2023-10-25T23:33:34.635 INFO:teuthology.orchestra.run.smithi089.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 7.5 MB/s | 644 kB 00:00 2023-10-25T23:33:34.661 INFO:teuthology.orchestra.run.smithi089.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.0 MB/s | 171 kB 00:00 2023-10-25T23:33:34.686 INFO:teuthology.orchestra.run.smithi089.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-10-25T23:33:34.744 INFO:teuthology.orchestra.run.smithi089.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.4 MB/s | 2.3 MB 00:00 2023-10-25T23:33:34.770 INFO:teuthology.orchestra.run.smithi089.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.3 MB/s | 110 kB 00:00 2023-10-25T23:33:34.787 INFO:teuthology.orchestra.run.smithi089.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-10-25T23:33:34.812 INFO:teuthology.orchestra.run.smithi089.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.0 MB/s | 259 kB 00:00 2023-10-25T23:33:34.827 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-25T23:33:34.845 INFO:teuthology.orchestra.run.smithi089.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-10-25T23:33:34.862 INFO:teuthology.orchestra.run.smithi089.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 775 kB/s | 39 kB 00:00 2023-10-25T23:33:34.905 INFO:teuthology.orchestra.run.smithi089.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-10-25T23:33:34.963 INFO:teuthology.orchestra.run.smithi089.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 5.2 MB/s | 538 kB 00:00 2023-10-25T23:33:34.980 INFO:teuthology.orchestra.run.smithi089.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2023-10-25T23:33:34.996 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-25T23:33:35.005 INFO:teuthology.orchestra.run.smithi089.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-10-25T23:33:35.056 INFO:teuthology.orchestra.run.smithi089.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-10-25T23:33:35.089 INFO:teuthology.orchestra.run.smithi089.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 796 kB/s | 27 kB 00:00 2023-10-25T23:33:35.131 INFO:teuthology.orchestra.run.smithi089.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-25T23:33:35.165 INFO:teuthology.orchestra.run.smithi089.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-10-25T23:33:35.167 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-25T23:33:35.257 INFO:teuthology.orchestra.run.smithi089.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2023-10-25T23:33:35.298 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-25T23:33:35.299 INFO:teuthology.orchestra.run.smithi089.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-10-25T23:33:35.341 INFO:teuthology.orchestra.run.smithi089.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-10-25T23:33:35.399 INFO:teuthology.orchestra.run.smithi089.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 16 MB/s | 3.7 MB 00:00 2023-10-25T23:33:35.424 INFO:teuthology.orchestra.run.smithi089.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 767 kB/s | 64 kB 00:00 2023-10-25T23:33:35.430 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-25T23:33:35.450 INFO:teuthology.orchestra.run.smithi089.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-10-25T23:33:35.475 INFO:teuthology.orchestra.run.smithi089.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 398 kB/s | 20 kB 00:00 2023-10-25T23:33:35.534 INFO:teuthology.orchestra.run.smithi089.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.2 MB/s | 103 kB 00:00 2023-10-25T23:33:35.567 INFO:teuthology.orchestra.run.smithi089.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 7.5 MB/s | 709 kB 00:00 2023-10-25T23:33:35.582 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-25T23:33:35.734 INFO:teuthology.orchestra.run.smithi089.stdout:(120/131): python3-scipy-1.0.0-21.module+el8.5. 13 MB/s | 14 MB 00:01 2023-10-25T23:33:35.759 INFO:teuthology.orchestra.run.smithi089.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.0 MB/s | 198 kB 00:00 2023-10-25T23:33:35.801 INFO:teuthology.orchestra.run.smithi089.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-25T23:33:35.843 INFO:teuthology.orchestra.run.smithi089.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-25T23:33:35.919 INFO:teuthology.orchestra.run.smithi089.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 13 MB/s | 4.9 MB 00:00 2023-10-25T23:33:36.011 INFO:teuthology.orchestra.run.smithi089.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-10-25T23:33:36.044 INFO:teuthology.orchestra.run.smithi089.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.3 MB/s | 808 kB 00:00 2023-10-25T23:33:36.120 INFO:teuthology.orchestra.run.smithi089.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 14 MB/s | 1.5 MB 00:00 2023-10-25T23:33:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-25T23:33:36.203 INFO:teuthology.orchestra.run.smithi089.stdout:(128/131): postgresql-server-10.21-2.module+el8 14 MB/s | 5.1 MB 00:00 2023-10-25T23:33:36.262 INFO:teuthology.orchestra.run.smithi089.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-10-25T23:33:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-25T23:33:36.504 INFO:teuthology.orchestra.run.smithi089.stdout:(130/131): librbd1-18.0.0-6863.g38499368.el8.x8 9.7 MB/s | 3.7 MB 00:00 2023-10-25T23:33:36.621 INFO:teuthology.orchestra.run.smithi089.stdout:(131/131): librados2-18.0.0-6863.g38499368.el8. 6.5 MB/s | 3.7 MB 00:00 2023-10-25T23:33:36.625 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-10-25T23:33:36.625 INFO:teuthology.orchestra.run.smithi089.stdout:Total 21 MB/s | 209 MB 00:09 2023-10-25T23:33:36.962 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-25T23:33:37.182 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-25T23:33:37.449 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-10-25T23:33:37.569 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-10-25T23:33:37.570 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-10-25T23:33:37.886 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-25T23:33:38.239 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-25T23:33:38.413 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-25T23:33:38.643 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-25T23:33:38.699 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-10-25T23:33:38.703 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-10-25T23:33:38.813 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:18.0.0-6863.g38499368.el8. 26/134 2023-10-25T23:33:38.943 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:18.0.0-6863.g38499368.el 27/134 2023-10-25T23:33:39.185 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:18.0.0-6863.g38499368.el8.x86_6 28/134 2023-10-25T23:33:39.356 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-25T23:33:41.107 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-25T23:33:42.108 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-25T23:33:42.412 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-25T23:33:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-25T23:33:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-25T23:33:43.101 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-25T23:33:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-25T23:33:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:18.0.0-6863.g38499368.el8.x86_64 36/134 2023-10-25T23:33:43.670 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:18.0.0-6863.g38499368.el8.x86_6 37/134 2023-10-25T23:33:43.804 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-25T23:33:43.814 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-10-25T23:33:43.949 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-25T23:33:44.012 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-25T23:33:44.114 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-25T23:33:44.190 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-25T23:33:44.228 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-25T23:33:44.389 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-25T23:33:44.400 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-25T23:33:44.497 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-10-25T23:33:44.625 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-25T23:33:44.680 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-25T23:33:44.806 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-25T23:33:44.869 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-25T23:33:45.059 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-25T23:33:45.106 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-10-25T23:33:45.226 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-25T23:33:45.393 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-25T23:33:45.494 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:18.0.0-6863.g38499368.el8.x86_64 5/134 2023-10-25T23:33:45.557 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-25T23:33:45.733 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-25T23:33:45.866 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-25T23:33:45.999 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:18.0.0-6863.g38499368.el8.x86_64 5/134 2023-10-25T23:33:46.051 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-25T23:33:46.213 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:18.0.0-6863.g38499368.el8.x86_64 6/134 2023-10-25T23:33:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-25T23:33:46.350 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:18.0.0-6863.g38499368.el8.x86_64 6/134 2023-10-25T23:33:46.580 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 7/134 2023-10-25T23:33:46.613 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-25T23:33:46.675 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 7/134 2023-10-25T23:33:46.844 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:18.0.0-6863.g38499368.el8.x86_64 8/134 2023-10-25T23:33:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-25T23:33:47.015 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-10-25T23:33:47.075 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-25T23:33:47.269 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-25T23:33:47.326 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-25T23:33:47.441 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-25T23:33:47.559 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-25T23:33:47.864 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-25T23:33:47.905 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-25T23:33:48.130 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-25T23:33:48.140 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-25T23:33:48.323 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-25T23:33:48.380 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 14/134 2023-10-25T23:33:48.487 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 14/134 2023-10-25T23:33:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-25T23:33:48.654 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:18.0.0-6863.g38499368.el8.x86 15/134 2023-10-25T23:33:48.733 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-25T23:33:48.801 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6863.g38499368.el8.x86 15/134 2023-10-25T23:33:48.909 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-25T23:33:48.983 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-10-25T23:33:49.152 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-10-25T23:33:49.219 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-25T23:33:49.345 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-10-25T23:33:49.476 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-25T23:33:49.479 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-25T23:33:49.617 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-10-25T23:33:49.709 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-25T23:33:49.763 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-25T23:33:49.940 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-25T23:33:50.104 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-25T23:33:50.290 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-25T23:33:50.367 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-10-25T23:33:50.571 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-25T23:33:50.605 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-25T23:33:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-25T23:33:50.959 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-25T23:33:51.099 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-25T23:33:51.200 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-10-25T23:33:51.280 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-25T23:33:51.412 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-10-25T23:33:51.474 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-25T23:33:51.640 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-25T23:33:51.791 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-25T23:33:51.936 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-25T23:33:52.116 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-10-25T23:33:52.159 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-25T23:33:52.383 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-25T23:33:52.386 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-10-25T23:33:52.560 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-25T23:33:52.561 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-10-25T23:33:52.773 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-25T23:33:52.844 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-25T23:33:52.960 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:18.0.0-6863.g38499368.el8. 26/134 2023-10-25T23:33:53.079 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-25T23:33:53.082 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:18.0.0-6863.g38499368.el 27/134 2023-10-25T23:33:53.262 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-25T23:33:53.334 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:18.0.0-6863.g38499368.el8.x86_6 28/134 2023-10-25T23:33:53.471 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-25T23:33:53.554 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-25T23:33:54.921 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-25T23:33:55.183 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-25T23:33:55.320 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-10-25T23:33:55.420 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-25T23:33:55.737 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-25T23:33:56.012 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-25T23:33:56.198 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-25T23:33:56.320 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-10-25T23:33:56.995 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-10-25T23:33:57.016 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-25T23:33:57.212 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:18.0.0-6863.g38499368.el8.x86_64 92/134 2023-10-25T23:33:57.272 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-10-25T23:33:57.287 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:18.0.0-6863.g38499368.el8.x86_64 92/134 2023-10-25T23:33:57.446 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:18.0.0-6863.g38499368.el8.x86_64 93/134 2023-10-25T23:33:57.521 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-10-25T23:33:57.731 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-25T23:33:57.930 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-25T23:33:58.134 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:18.0.0-6863.g38499368.el8.x86_64 36/134 2023-10-25T23:33:58.284 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:18.0.0-6863.g38499368.el8.x86_6 37/134 2023-10-25T23:33:58.435 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-10-25T23:33:58.620 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-10-25T23:33:58.803 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-10-25T23:33:58.859 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-10-25T23:33:59.064 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-10-25T23:33:59.323 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-10-25T23:33:59.495 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-25T23:33:59.554 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-10-25T23:33:59.798 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-10-25T23:33:59.973 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-10-25T23:34:00.157 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-10-25T23:34:00.354 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-10-25T23:34:00.538 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-10-25T23:34:00.672 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-10-25T23:34:00.889 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-10-25T23:34:01.098 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-10-25T23:34:01.234 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 94/134 2023-10-25T23:34:01.438 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-10-25T23:34:01.454 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 94/134 2023-10-25T23:34:01.704 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-10-25T23:34:01.931 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-10-25T23:34:02.044 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 94/134 2023-10-25T23:34:02.198 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-10-25T23:34:02.316 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 95/134 2023-10-25T23:34:02.396 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 95/134 2023-10-25T23:34:02.440 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-10-25T23:34:02.562 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 96/134 2023-10-25T23:34:02.768 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-10-25T23:34:02.993 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-10-25T23:34:03.203 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-10-25T23:34:03.442 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-10-25T23:34:03.634 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-10-25T23:34:03.830 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-10-25T23:34:04.134 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-10-25T23:34:04.414 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-10-25T23:34:04.632 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-10-25T23:34:04.845 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-10-25T23:34:05.035 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-25T23:34:05.196 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-25T23:34:05.477 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-25T23:34:05.692 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-25T23:34:05.831 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-25T23:34:05.978 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-25T23:34:06.192 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-25T23:34:06.362 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-25T23:34:06.553 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-25T23:34:06.738 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-25T23:34:06.899 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-25T23:34:07.085 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-25T23:34:07.287 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-25T23:34:07.465 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-25T23:34:07.728 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-25T23:34:07.967 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-25T23:34:08.133 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-25T23:34:08.333 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-25T23:34:09.385 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-25T23:34:09.638 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-25T23:34:09.876 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-25T23:34:10.151 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-25T23:34:10.428 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-25T23:34:10.710 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-25T23:34:11.539 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-25T23:34:11.701 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:18.0.0-6863.g38499368.el8.x86_64 92/134 2023-10-25T23:34:11.769 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:18.0.0-6863.g38499368.el8.x86_64 92/134 2023-10-25T23:34:11.935 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:18.0.0-6863.g38499368.el8.x86_64 93/134 2023-10-25T23:34:15.662 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 94/134 2023-10-25T23:34:15.926 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 94/134 2023-10-25T23:34:16.507 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 94/134 2023-10-25T23:34:16.793 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 95/134 2023-10-25T23:34:16.873 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 95/134 2023-10-25T23:34:17.042 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 96/134 2023-10-25T23:34:21.365 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 96/134 2023-10-25T23:34:21.366 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2023-10-25T23:34:21.366 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2023-10-25T23:34:21.366 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /dev 2023-10-25T23:34:21.367 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /run 2023-10-25T23:34:21.367 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2023-10-25T23:34:21.368 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2023-10-25T23:34:21.368 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2023-10-25T23:34:21.368 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2023-10-25T23:34:21.369 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /dev 2023-10-25T23:34:21.369 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:34:21.702 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 97/134 2023-10-25T23:34:23.291 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 97/134 2023-10-25T23:34:23.497 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 98/134 2023-10-25T23:34:23.717 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 98/134 2023-10-25T23:34:23.868 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 99/134 2023-10-25T23:34:24.328 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 99/134 2023-10-25T23:34:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 100/134 2023-10-25T23:34:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 100/134 2023-10-25T23:34:26.199 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:18.0.0-6863.g38499368.el8.noarch 101/134 2023-10-25T23:34:26.399 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:18.0.0-6863.g38499368.el8.noarch 101/134 2023-10-25T23:34:26.565 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6863.g38499368.e 102/134 2023-10-25T23:34:26.751 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6863.g38499368. 103/134 2023-10-25T23:34:26.942 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noa 104/134 2023-10-25T23:34:27.167 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noa 104/134 2023-10-25T23:34:27.463 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.n 105/134 2023-10-25T23:34:28.420 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.n 105/134 2023-10-25T23:34:28.558 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6863.g384 106/134 2023-10-25T23:34:28.649 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6863.g384 106/134 2023-10-25T23:34:29.005 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6863.g38499368.el 107/134 2023-10-25T23:34:29.197 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 108/134 2023-10-25T23:34:29.231 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 108/134 2023-10-25T23:34:29.400 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 109/134 2023-10-25T23:34:29.411 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 109/134 2023-10-25T23:34:30.725 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:18.0.0-6863.g38499368.el8.x86_64 110/134 2023-10-25T23:34:30.936 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 111/134 2023-10-25T23:34:30.970 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 111/134 2023-10-25T23:34:31.150 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6863.g38499 112/134 2023-10-25T23:34:31.192 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6863.g38499 112/134 2023-10-25T23:34:31.366 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 113/134 2023-10-25T23:34:31.724 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 113/134 2023-10-25T23:34:31.916 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 114/134 2023-10-25T23:34:35.821 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 96/134 2023-10-25T23:34:35.822 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2023-10-25T23:34:35.822 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2023-10-25T23:34:35.822 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /dev 2023-10-25T23:34:35.822 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /run 2023-10-25T23:34:35.823 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2023-10-25T23:34:35.823 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2023-10-25T23:34:35.823 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2023-10-25T23:34:35.823 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2023-10-25T23:34:35.824 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /dev 2023-10-25T23:34:35.824 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:34:36.189 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 97/134 2023-10-25T23:34:36.582 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 114/134 2023-10-25T23:34:37.462 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:18.0.0-6863.g38499368.el8.x86_64 115/134 2023-10-25T23:34:37.797 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 97/134 2023-10-25T23:34:37.803 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-25T23:34:37.983 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:18.0.0-6863.g38499368.el8.x86_64 117/134 2023-10-25T23:34:38.006 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 98/134 2023-10-25T23:34:38.226 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 98/134 2023-10-25T23:34:38.239 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-25T23:34:38.399 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-25T23:34:38.405 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 99/134 2023-10-25T23:34:38.596 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-25T23:34:38.845 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-25T23:34:38.876 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 99/134 2023-10-25T23:34:39.011 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:18.0.0-6863.g38499368.el8.x86_ 121/134 2023-10-25T23:34:39.063 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 100/134 2023-10-25T23:34:39.080 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 100/134 2023-10-25T23:34:39.141 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-25T23:34:40.791 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:18.0.0-6863.g38499368.el8.noarch 101/134 2023-10-25T23:34:40.983 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:18.0.0-6863.g38499368.el8.noarch 101/134 2023-10-25T23:34:41.111 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6863.g38499368.e 102/134 2023-10-25T23:34:41.329 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6863.g38499368. 103/134 2023-10-25T23:34:41.354 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-25T23:34:41.504 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noa 104/134 2023-10-25T23:34:41.624 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-25T23:34:41.640 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-25T23:34:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noa 104/134 2023-10-25T23:34:41.799 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:18.0.0-6863.g38499368.el8.noarch 124/134 2023-10-25T23:34:42.014 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.n 105/134 2023-10-25T23:34:42.123 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:18.0.0-6863.g38499368.el8.x86_64 125/134 2023-10-25T23:34:42.410 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:18.0.0-6863.g38499368.el8.x86_64 126/134 2023-10-25T23:34:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-25T23:34:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-25T23:34:42.974 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.n 105/134 2023-10-25T23:34:43.035 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-25T23:34:43.129 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6863.g384 106/134 2023-10-25T23:34:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-25T23:34:43.221 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6863.g384 106/134 2023-10-25T23:34:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-25T23:34:43.373 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-25T23:34:43.381 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-25T23:34:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-25T23:34:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-25T23:34:43.572 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6863.g38499368.el 107/134 2023-10-25T23:34:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-25T23:34:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-25T23:34:43.756 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 108/134 2023-10-25T23:34:43.791 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 108/134 2023-10-25T23:34:43.927 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-25T23:34:43.946 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 109/134 2023-10-25T23:34:43.957 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 109/134 2023-10-25T23:34:44.105 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-25T23:34:44.596 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-25T23:34:44.597 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:18.0.0-6863.g38499368.el8.x86_64 1/134 2023-10-25T23:34:44.597 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 2/134 2023-10-25T23:34:44.598 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 3/134 2023-10-25T23:34:44.598 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:18.0.0-6863.g38499368.el8.x86_64 4/134 2023-10-25T23:34:44.598 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6863.g38499 5/134 2023-10-25T23:34:44.599 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 6/134 2023-10-25T23:34:44.599 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 7/134 2023-10-25T23:34:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 8/134 2023-10-25T23:34:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 9/134 2023-10-25T23:34:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 10/134 2023-10-25T23:34:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 11/134 2023-10-25T23:34:44.600 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:18.0.0-6863.g38499368.el8.x86_64 12/134 2023-10-25T23:34:44.601 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 13/134 2023-10-25T23:34:44.601 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:18.0.0-6863.g38499368.el8.x86_ 14/134 2023-10-25T23:34:44.601 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 15/134 2023-10-25T23:34:44.601 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 16/134 2023-10-25T23:34:44.601 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:18.0.0-6863.g38499368.el8.x86_6 17/134 2023-10-25T23:34:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:18.0.0-6863.g38499368.el8.x86 18/134 2023-10-25T23:34:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:18.0.0-6863.g38499368.el8.x86_64 19/134 2023-10-25T23:34:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6863.g38499368.el 20/134 2023-10-25T23:34:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:18.0.0-6863.g38499368.el8. 21/134 2023-10-25T23:34:44.602 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:18.0.0-6863.g38499368.el8.x86_6 22/134 2023-10-25T23:34:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:18.0.0-6863.g38499368.el8.x86_64 23/134 2023-10-25T23:34:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:18.0.0-6863.g38499368.el8.x86_64 24/134 2023-10-25T23:34:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:18.0.0-6863.g38499368.el8.x86_64 25/134 2023-10-25T23:34:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:18.0.0-6863.g38499368.el8.x86_64 26/134 2023-10-25T23:34:44.603 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 27/134 2023-10-25T23:34:44.604 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:18.0.0-6863.g38499368.el8.x86_64 28/134 2023-10-25T23:34:44.604 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6863.g38499368. 29/134 2023-10-25T23:34:44.615 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noa 30/134 2023-10-25T23:34:44.615 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.n 31/134 2023-10-25T23:34:44.616 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6863.g384 32/134 2023-10-25T23:34:44.616 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6863.g38499368.el 33/134 2023-10-25T23:34:44.616 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 34/134 2023-10-25T23:34:44.617 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6863.g38499368.e 35/134 2023-10-25T23:34:44.617 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 36/134 2023-10-25T23:34:44.617 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:18.0.0-6863.g38499368.el8.noarch 37/134 2023-10-25T23:34:44.618 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:18.0.0-6863.g38499368.el8.noarch 38/134 2023-10-25T23:34:44.618 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-25T23:34:44.618 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-25T23:34:44.619 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-25T23:34:44.619 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-25T23:34:44.619 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-25T23:34:44.620 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-25T23:34:44.620 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-25T23:34:44.621 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-25T23:34:44.621 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-25T23:34:44.621 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-25T23:34:44.621 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-25T23:34:44.622 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-25T23:34:44.622 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-25T23:34:44.622 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-25T23:34:44.622 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-25T23:34:44.622 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-25T23:34:44.623 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-25T23:34:44.623 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-25T23:34:44.623 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-25T23:34:44.623 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-25T23:34:44.623 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-25T23:34:44.623 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-25T23:34:44.624 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-25T23:34:44.624 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-25T23:34:44.624 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-25T23:34:44.624 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-25T23:34:44.625 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-25T23:34:44.625 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-25T23:34:44.625 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-25T23:34:44.625 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-25T23:34:44.625 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-25T23:34:44.626 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-25T23:34:44.626 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-25T23:34:44.626 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-25T23:34:44.626 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-25T23:34:44.626 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-25T23:34:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-25T23:34:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-25T23:34:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-25T23:34:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-25T23:34:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-25T23:34:44.627 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-25T23:34:44.628 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-25T23:34:44.628 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-25T23:34:44.628 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-25T23:34:44.628 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-25T23:34:44.629 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-25T23:34:44.629 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-25T23:34:44.629 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-25T23:34:44.629 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-25T23:34:44.629 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-25T23:34:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-25T23:34:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-25T23:34:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-25T23:34:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-25T23:34:44.630 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-25T23:34:44.631 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-25T23:34:44.631 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-25T23:34:44.631 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-25T23:34:44.631 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-25T23:34:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-25T23:34:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-25T23:34:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-25T23:34:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-25T23:34:44.632 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-25T23:34:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-25T23:34:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-25T23:34:44.633 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-25T23:34:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-25T23:34:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-25T23:34:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-25T23:34:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-25T23:34:44.634 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-25T23:34:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-25T23:34:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-25T23:34:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-25T23:34:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-25T23:34:44.635 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-25T23:34:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-25T23:34:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-25T23:34:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-25T23:34:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-25T23:34:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-25T23:34:44.636 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-25T23:34:44.637 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-25T23:34:44.637 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-25T23:34:44.638 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-25T23:34:44.638 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-25T23:34:44.638 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-25T23:34:44.638 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-25T23:34:44.639 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:18.0.0-6863.g38499368.el8.x86_64 129/134 2023-10-25T23:34:44.639 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-25T23:34:44.639 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:18.0.0-6863.g38499368.el8.x86_64 131/134 2023-10-25T23:34:44.639 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-25T23:34:44.640 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-25T23:34:45.307 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:18.0.0-6863.g38499368.el8.x86_64 110/134 2023-10-25T23:34:45.528 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 111/134 2023-10-25T23:34:45.562 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 111/134 2023-10-25T23:34:45.738 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6863.g38499 112/134 2023-10-25T23:34:45.780 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6863.g38499 112/134 2023-10-25T23:34:45.963 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 113/134 2023-10-25T23:34:46.322 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 113/134 2023-10-25T23:34:46.504 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 114/134 2023-10-25T23:34:47.280 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-25T23:34:47.281 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:01:47 ago on Wed 25 Oct 2023 11:33:00 PM UTC. 2023-10-25T23:34:50.070 INFO:teuthology.orchestra.run.smithi081.stdout:Installed products updated. 2023-10-25T23:34:50.306 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:34:50.307 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2023-10-25T23:34:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-25T23:34:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.307 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.307 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2023-10-25T23:34:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-25T23:34:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.1-7.el8.noarch 2023-10-25T23:34:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.0.4-10.el8.x86_64 2023-10-25T23:34:50.308 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:34:50.309 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:34:50.310 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:34:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:34:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:34:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:34:50.311 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.312 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:34:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.313 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:34:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:34:50.314 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:34:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-25T23:34:50.315 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.1-9.el8.x86_64 2023-10-25T23:34:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-25T23:34:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-25T23:34:50.316 INFO:teuthology.orchestra.run.smithi081.stdout: jq-1.6-3.el8.x86_64 2023-10-25T23:34:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-25T23:34:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-25T23:34:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-25T23:34:50.317 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.318 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-25T23:34:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-25T23:34:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-25T23:34:50.319 INFO:teuthology.orchestra.run.smithi081.stdout: libpq-13.5-1.el8.x86_64 2023-10-25T23:34:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-25T23:34:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-25T23:34:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.320 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-25T23:34:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-25T23:34:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-25T23:34:50.321 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-25T23:34:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-25T23:34:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-25T23:34:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-25T23:34:50.322 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-25T23:34:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-25T23:34:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-25T23:34:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-25T23:34:50.323 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-25T23:34:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-25T23:34:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-25T23:34:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-25T23:34:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-25T23:34:50.324 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-25T23:34:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-25T23:34:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-25T23:34:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-25T23:34:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-25T23:34:50.325 INFO:teuthology.orchestra.run.smithi081.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-25T23:34:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-25T23:34:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.326 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-25T23:34:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-25T23:34:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-25T23:34:50.327 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-25T23:34:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-25T23:34:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-25T23:34:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-25T23:34:50.328 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-25T23:34:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-25T23:34:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-25T23:34:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-25T23:34:50.329 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-25T23:34:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-25T23:34:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-25T23:34:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-25T23:34:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-25T23:34:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-25T23:34:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-25T23:34:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-25T23:34:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-25T23:34:50.331 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-25T23:34:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-25T23:34:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-2.6-1.el8.noarch 2023-10-25T23:34:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-25T23:34:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-25T23:34:50.332 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-25T23:34:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-25T23:34:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-25T23:34:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-25T23:34:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.333 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-25T23:34:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-25T23:34:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.334 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-25T23:34:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-25T23:34:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-25T23:34:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-25T23:34:50.335 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-25T23:34:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-25T23:34:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-25T23:34:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-25T23:34:50.336 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-25T23:34:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-25T23:34:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-25T23:34:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-25T23:34:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-25T23:34:50.337 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.338 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.338 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:34:50.338 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-25T23:34:50.338 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-25T23:34:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-25T23:34:50.339 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-25T23:34:50.340 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-25T23:34:50.340 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-25T23:34:50.341 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:34:50.341 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2023-10-25T23:34:50.487 DEBUG:teuthology.parallel:result is None 2023-10-25T23:34:51.175 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 114/134 2023-10-25T23:34:52.023 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:18.0.0-6863.g38499368.el8.x86_64 115/134 2023-10-25T23:34:52.357 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-10-25T23:34:52.557 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:18.0.0-6863.g38499368.el8.x86_64 117/134 2023-10-25T23:34:52.833 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-10-25T23:34:52.978 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-10-25T23:34:53.168 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-10-25T23:34:53.407 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-10-25T23:34:53.574 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:18.0.0-6863.g38499368.el8.x86_ 121/134 2023-10-25T23:34:53.721 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-25T23:34:55.924 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-25T23:34:56.194 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-25T23:34:56.213 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-25T23:34:56.386 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-top-2:18.0.0-6863.g38499368.el8.noarch 124/134 2023-10-25T23:34:56.677 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:18.0.0-6863.g38499368.el8.x86_64 125/134 2023-10-25T23:34:56.976 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:18.0.0-6863.g38499368.el8.x86_64 126/134 2023-10-25T23:34:57.408 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-25T23:34:57.586 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-10-25T23:34:57.669 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-10-25T23:34:57.902 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-10-25T23:34:57.907 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-10-25T23:34:58.045 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-25T23:34:58.052 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-10-25T23:34:58.174 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-10-25T23:34:58.174 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-25T23:34:58.356 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-25T23:34:58.356 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-25T23:34:58.625 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-25T23:34:58.801 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-25T23:34:59.309 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-25T23:34:59.309 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:18.0.0-6863.g38499368.el8.x86_64 1/134 2023-10-25T23:34:59.309 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 2/134 2023-10-25T23:34:59.309 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 3/134 2023-10-25T23:34:59.310 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:18.0.0-6863.g38499368.el8.x86_64 4/134 2023-10-25T23:34:59.310 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6863.g38499 5/134 2023-10-25T23:34:59.310 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 6/134 2023-10-25T23:34:59.310 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 7/134 2023-10-25T23:34:59.310 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 8/134 2023-10-25T23:34:59.311 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 9/134 2023-10-25T23:34:59.311 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 10/134 2023-10-25T23:34:59.311 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 11/134 2023-10-25T23:34:59.311 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:18.0.0-6863.g38499368.el8.x86_64 12/134 2023-10-25T23:34:59.311 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 13/134 2023-10-25T23:34:59.312 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:18.0.0-6863.g38499368.el8.x86_ 14/134 2023-10-25T23:34:59.312 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 15/134 2023-10-25T23:34:59.312 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 16/134 2023-10-25T23:34:59.312 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:18.0.0-6863.g38499368.el8.x86_6 17/134 2023-10-25T23:34:59.312 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:18.0.0-6863.g38499368.el8.x86 18/134 2023-10-25T23:34:59.313 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:18.0.0-6863.g38499368.el8.x86_64 19/134 2023-10-25T23:34:59.313 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6863.g38499368.el 20/134 2023-10-25T23:34:59.313 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:18.0.0-6863.g38499368.el8. 21/134 2023-10-25T23:34:59.313 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:18.0.0-6863.g38499368.el8.x86_6 22/134 2023-10-25T23:34:59.313 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:18.0.0-6863.g38499368.el8.x86_64 23/134 2023-10-25T23:34:59.313 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:18.0.0-6863.g38499368.el8.x86_64 24/134 2023-10-25T23:34:59.314 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:18.0.0-6863.g38499368.el8.x86_64 25/134 2023-10-25T23:34:59.314 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:18.0.0-6863.g38499368.el8.x86_64 26/134 2023-10-25T23:34:59.314 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 27/134 2023-10-25T23:34:59.314 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:18.0.0-6863.g38499368.el8.x86_64 28/134 2023-10-25T23:34:59.315 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6863.g38499368. 29/134 2023-10-25T23:34:59.315 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noa 30/134 2023-10-25T23:34:59.315 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.n 31/134 2023-10-25T23:34:59.315 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6863.g384 32/134 2023-10-25T23:34:59.315 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6863.g38499368.el 33/134 2023-10-25T23:34:59.315 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 34/134 2023-10-25T23:34:59.316 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6863.g38499368.e 35/134 2023-10-25T23:34:59.316 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 36/134 2023-10-25T23:34:59.316 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:18.0.0-6863.g38499368.el8.noarch 37/134 2023-10-25T23:34:59.316 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-top-2:18.0.0-6863.g38499368.el8.noarch 38/134 2023-10-25T23:34:59.316 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-25T23:34:59.317 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-25T23:34:59.317 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-25T23:34:59.317 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-25T23:34:59.317 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-25T23:34:59.317 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-25T23:34:59.318 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-25T23:34:59.318 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-25T23:34:59.318 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-25T23:34:59.318 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-25T23:34:59.318 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-25T23:34:59.319 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-25T23:34:59.319 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-25T23:34:59.319 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-25T23:34:59.319 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-25T23:34:59.319 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-25T23:34:59.319 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-25T23:34:59.320 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-25T23:34:59.320 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-25T23:34:59.320 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-25T23:34:59.320 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-25T23:34:59.320 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-25T23:34:59.321 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-25T23:34:59.321 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-25T23:34:59.321 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-25T23:34:59.321 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-25T23:34:59.321 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-25T23:34:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-25T23:34:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-25T23:34:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-25T23:34:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-25T23:34:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-25T23:34:59.322 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-25T23:34:59.323 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-10-25T23:34:59.323 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-10-25T23:34:59.323 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-10-25T23:34:59.323 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-10-25T23:34:59.323 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-10-25T23:34:59.324 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-10-25T23:34:59.324 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-10-25T23:34:59.324 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-10-25T23:34:59.324 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-10-25T23:34:59.324 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-10-25T23:34:59.325 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-10-25T23:34:59.325 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-10-25T23:34:59.325 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-10-25T23:34:59.325 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-10-25T23:34:59.325 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-10-25T23:34:59.326 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-10-25T23:34:59.326 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-10-25T23:34:59.326 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-10-25T23:34:59.326 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-10-25T23:34:59.326 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-10-25T23:34:59.327 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-10-25T23:34:59.327 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-10-25T23:34:59.327 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-10-25T23:34:59.327 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-10-25T23:34:59.327 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-10-25T23:34:59.327 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-10-25T23:34:59.328 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-10-25T23:34:59.328 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-10-25T23:34:59.328 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-10-25T23:34:59.328 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-10-25T23:34:59.328 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-10-25T23:34:59.329 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-10-25T23:34:59.329 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-10-25T23:34:59.329 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-10-25T23:34:59.329 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-10-25T23:34:59.329 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-10-25T23:34:59.330 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-10-25T23:34:59.330 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-10-25T23:34:59.330 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-10-25T23:34:59.330 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-10-25T23:34:59.330 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-10-25T23:34:59.331 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-10-25T23:34:59.331 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-10-25T23:34:59.331 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-10-25T23:34:59.331 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-10-25T23:34:59.331 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-10-25T23:34:59.332 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-10-25T23:34:59.332 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-10-25T23:34:59.332 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-10-25T23:34:59.332 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-10-25T23:34:59.332 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-10-25T23:34:59.332 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-10-25T23:34:59.333 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-10-25T23:34:59.333 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-10-25T23:34:59.333 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-10-25T23:34:59.333 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-10-25T23:34:59.333 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-10-25T23:34:59.334 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:18.0.0-6863.g38499368.el8.x86_64 129/134 2023-10-25T23:34:59.334 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-25T23:34:59.334 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:18.0.0-6863.g38499368.el8.x86_64 131/134 2023-10-25T23:34:59.334 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-25T23:34:59.334 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-25T23:35:02.081 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-25T23:35:02.081 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:47 ago on Wed 25 Oct 2023 11:33:15 PM UTC. 2023-10-25T23:35:04.852 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-10-25T23:35:05.067 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:05.067 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2023-10-25T23:35:05.067 INFO:teuthology.orchestra.run.smithi089.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-25T23:35:05.068 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.068 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.068 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-10-25T23:35:05.068 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-25T23:35:05.068 INFO:teuthology.orchestra.run.smithi089.stdout: automake-1.16.1-7.el8.noarch 2023-10-25T23:35:05.069 INFO:teuthology.orchestra.run.smithi089.stdout: bison-3.0.4-10.el8.x86_64 2023-10-25T23:35:05.069 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.069 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.069 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.069 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.070 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:35:05.070 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.070 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.070 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.070 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:35:05.071 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:35:05.071 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:35:05.071 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:35:05.071 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:35:05.071 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.072 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.072 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:35:05.072 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.072 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.072 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.072 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:35:05.073 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:35:05.073 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.073 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top-2:18.0.0-6863.g38499368.el8.noarch 2023-10-25T23:35:05.073 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-25T23:35:05.073 INFO:teuthology.orchestra.run.smithi089.stdout: flex-2.6.1-9.el8.x86_64 2023-10-25T23:35:05.074 INFO:teuthology.orchestra.run.smithi089.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-25T23:35:05.074 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-25T23:35:05.074 INFO:teuthology.orchestra.run.smithi089.stdout: jq-1.6-3.el8.x86_64 2023-10-25T23:35:05.074 INFO:teuthology.orchestra.run.smithi089.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-25T23:35:05.074 INFO:teuthology.orchestra.run.smithi089.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-25T23:35:05.075 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-25T23:35:05.075 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.075 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.075 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.075 INFO:teuthology.orchestra.run.smithi089.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-25T23:35:05.076 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-25T23:35:05.076 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-25T23:35:05.076 INFO:teuthology.orchestra.run.smithi089.stdout: libpq-13.5-1.el8.x86_64 2023-10-25T23:35:05.076 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-25T23:35:05.076 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-25T23:35:05.077 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.077 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.077 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-25T23:35:05.077 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.077 INFO:teuthology.orchestra.run.smithi089.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-25T23:35:05.078 INFO:teuthology.orchestra.run.smithi089.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-25T23:35:05.078 INFO:teuthology.orchestra.run.smithi089.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-25T23:35:05.078 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-25T23:35:05.078 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-25T23:35:05.078 INFO:teuthology.orchestra.run.smithi089.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-25T23:35:05.079 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-25T23:35:05.079 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-25T23:35:05.079 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-25T23:35:05.079 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-25T23:35:05.079 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-25T23:35:05.079 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-25T23:35:05.080 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-25T23:35:05.080 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-25T23:35:05.080 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-25T23:35:05.080 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-25T23:35:05.080 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-25T23:35:05.081 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-25T23:35:05.081 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-25T23:35:05.081 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-25T23:35:05.081 INFO:teuthology.orchestra.run.smithi089.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-25T23:35:05.081 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-25T23:35:05.082 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.082 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.082 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.082 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-25T23:35:05.082 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-25T23:35:05.083 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-25T23:35:05.083 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-25T23:35:05.083 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-25T23:35:05.083 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-25T23:35:05.083 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-25T23:35:05.084 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-25T23:35:05.084 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-25T23:35:05.084 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-25T23:35:05.084 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-25T23:35:05.084 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-25T23:35:05.085 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-25T23:35:05.085 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-25T23:35:05.085 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-25T23:35:05.085 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-25T23:35:05.085 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-25T23:35:05.085 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-25T23:35:05.086 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-25T23:35:05.086 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-25T23:35:05.086 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-25T23:35:05.086 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-25T23:35:05.086 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-2.6-1.el8.noarch 2023-10-25T23:35:05.087 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-25T23:35:05.087 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-25T23:35:05.087 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-25T23:35:05.087 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-25T23:35:05.087 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-25T23:35:05.088 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-25T23:35:05.088 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.088 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.088 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-25T23:35:05.088 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-25T23:35:05.089 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.089 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-25T23:35:05.089 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-25T23:35:05.089 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-25T23:35:05.089 INFO:teuthology.orchestra.run.smithi089.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-25T23:35:05.090 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-25T23:35:05.090 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-25T23:35:05.090 INFO:teuthology.orchestra.run.smithi089.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-25T23:35:05.090 INFO:teuthology.orchestra.run.smithi089.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-25T23:35:05.090 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-25T23:35:05.091 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-25T23:35:05.091 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-25T23:35:05.091 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-25T23:35:05.091 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-25T23:35:05.091 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.092 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.092 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:18.0.0-6863.g38499368.el8.x86_64 2023-10-25T23:35:05.092 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-25T23:35:05.092 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-25T23:35:05.092 INFO:teuthology.orchestra.run.smithi089.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-25T23:35:05.093 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-25T23:35:05.093 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-25T23:35:05.093 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-25T23:35:05.094 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:05.094 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-10-25T23:35:05.251 DEBUG:teuthology.parallel:result is None 2023-10-25T23:35:05.252 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=384993681abceb8cb8affea10538d607052db4b4 2023-10-25T23:35:05.398 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-25T23:35:05.427 INFO:teuthology.orchestra.run.smithi081.stdout:18.0.0-6863.g38499368.el8 2023-10-25T23:35:05.428 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6863.g38499368.el8 2023-10-25T23:35:05.428 INFO:teuthology.task.install:The correct ceph version 18.0.0-6863.g38499368 is installed. 2023-10-25T23:35:05.429 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=384993681abceb8cb8affea10538d607052db4b4 2023-10-25T23:35:05.649 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-25T23:35:05.672 INFO:teuthology.orchestra.run.smithi089.stdout:18.0.0-6863.g38499368.el8 2023-10-25T23:35:05.672 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6863.g38499368.el8 2023-10-25T23:35:05.673 INFO:teuthology.task.install:The correct ceph version 18.0.0-6863.g38499368 is installed. 2023-10-25T23:35:05.673 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-25T23:35:05.674 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:05.674 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-25T23:35:05.722 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:05.722 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-25T23:35:05.763 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-25T23:35:05.763 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:05.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2023-10-25T23:35:05.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-25T23:35:05.862 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:05.862 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2023-10-25T23:35:05.889 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-25T23:35:05.955 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-25T23:35:05.956 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:05.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-25T23:35:05.984 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-25T23:35:06.052 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:06.053 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-25T23:35:06.079 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-25T23:35:06.146 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-25T23:35:06.147 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:06.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2023-10-25T23:35:06.175 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-25T23:35:06.242 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:06.243 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2023-10-25T23:35:06.269 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-25T23:35:06.334 INFO:teuthology.run_tasks:Running task ceph... 2023-10-25T23:35:06.412 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-25T23:35:06.413 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2023-10-25T23:35:06.415 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2023-10-25T23:35:06.441 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-25T23:35:06.441 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-25T23:35:06.483 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-25T23:35:06.508 INFO:tasks.ceph:Creating extra log directories... 2023-10-25T23:35:06.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-25T23:35:06.550 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-25T23:35:06.584 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-25T23:35:06.585 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-25T23:35:06.585 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-25T23:35:06.585 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:06.586 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-25T23:35:06.631 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-25T23:35:06.785 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-25T23:35:06.812 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:06.812 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-25T23:35:06.828 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-25T23:35:06.956 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-25T23:35:06.988 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-25T23:35:06.989 INFO:tasks.ceph:config {'conf': {'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-25T23:35:06.989 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436391', 'branch': 'wip-batrick-testing-20231024.144545', 'description': 'fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7436391', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20231024.144545'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '384993681abceb8cb8affea10538d607052db4b4'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '384993681abceb8cb8affea10538d607052db4b4'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20231024.144545', 'sha1': '384993681abceb8cb8affea10538d607052db4b4'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 7595, 'sha1': '384993681abceb8cb8affea10538d607052db4b4', 'sleep_before_teardown': 0, 'subset': '66/256', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20231024.144545', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '384993681abceb8cb8affea10538d607052db4b4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi089.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '384993681abceb8cb8affea10538d607052db4b4'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '384993681abceb8cb8affea10538d607052db4b4', 'cluster': 'ceph'}}, {'kclient': None}, {'workunit': {'clients': {'all': ['fs/snaps']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '202b180cb047e798fb131047314a862593f45403', 'timestamp': '2023-10-24_19:52:40', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.770726'} 2023-10-25T23:35:06.991 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-25T23:35:06.993 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-25T23:35:07.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2023-10-25T23:35:07.050 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2023-10-25T23:35:07.107 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:07.107 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2023-10-25T23:35:07.131 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-25T23:35:07.131 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2023-10-25T23:35:07.188 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-25T23:35:07.188 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-25T23:35:07.188 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 379339 Links: 1 2023-10-25T23:35:07.189 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-25T23:35:07.189 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-10-25T23:35:07.189 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-10-25 23:34:44.305809114 +0000 2023-10-25T23:35:07.189 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-10-25 23:32:05.039578577 +0000 2023-10-25T23:35:07.189 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-10-25 23:32:05.039578577 +0000 2023-10-25T23:35:07.190 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-10-25T23:35:07.190 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-25T23:35:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-10-25T23:35:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-10-25T23:35:07.254 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000254519 s, 2.0 MB/s 2023-10-25T23:35:07.255 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-25T23:35:07.313 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2023-10-25T23:35:07.371 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-25T23:35:07.371 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-25T23:35:07.372 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 372667 Links: 1 2023-10-25T23:35:07.372 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-25T23:35:07.372 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-10-25T23:35:07.372 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-10-25 23:34:44.305809114 +0000 2023-10-25T23:35:07.372 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-10-25 23:32:05.555568749 +0000 2023-10-25T23:35:07.373 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-10-25 23:32:05.555568749 +0000 2023-10-25T23:35:07.373 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-10-25T23:35:07.373 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-25T23:35:07.436 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-10-25T23:35:07.437 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-10-25T23:35:07.437 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000198616 s, 2.6 MB/s 2023-10-25T23:35:07.438 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-25T23:35:07.496 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2023-10-25T23:35:07.553 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-25T23:35:07.554 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-25T23:35:07.554 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 370285 Links: 1 2023-10-25T23:35:07.554 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-25T23:35:07.555 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-10-25T23:35:07.555 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-10-25 23:34:44.305809114 +0000 2023-10-25T23:35:07.555 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-10-25 23:32:06.056559207 +0000 2023-10-25T23:35:07.555 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-10-25 23:32:06.056559207 +0000 2023-10-25T23:35:07.556 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-10-25T23:35:07.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-25T23:35:07.618 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-10-25T23:35:07.619 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-10-25T23:35:07.619 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000201671 s, 2.5 MB/s 2023-10-25T23:35:07.621 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-25T23:35:07.679 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2023-10-25T23:35:07.736 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-25T23:35:07.736 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-25T23:35:07.736 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 380758 Links: 1 2023-10-25T23:35:07.736 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-25T23:35:07.736 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2023-10-25T23:35:07.737 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-10-25 23:34:44.305809114 +0000 2023-10-25T23:35:07.737 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-10-25 23:32:06.575549322 +0000 2023-10-25T23:35:07.737 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-10-25 23:32:06.575549322 +0000 2023-10-25T23:35:07.737 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-10-25T23:35:07.738 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-25T23:35:07.800 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-10-25T23:35:07.801 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-10-25T23:35:07.801 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000173388 s, 3.0 MB/s 2023-10-25T23:35:07.802 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-25T23:35:07.859 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-25T23:35:07.860 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:07.860 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2023-10-25T23:35:07.881 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-25T23:35:07.881 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2023-10-25T23:35:07.941 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-25T23:35:07.942 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-25T23:35:07.942 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 377987 Links: 1 2023-10-25T23:35:07.942 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-25T23:35:07.943 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-10-25T23:35:07.943 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-10-25 23:34:58.998306708 +0000 2023-10-25T23:35:07.943 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-10-25 23:32:13.672334638 +0000 2023-10-25T23:35:07.943 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-10-25 23:32:13.672334638 +0000 2023-10-25T23:35:07.943 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-10-25T23:35:07.944 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-25T23:35:08.011 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-10-25T23:35:08.011 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-10-25T23:35:08.012 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000253354 s, 2.0 MB/s 2023-10-25T23:35:08.013 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-25T23:35:08.072 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2023-10-25T23:35:08.132 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-25T23:35:08.132 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-25T23:35:08.132 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 378113 Links: 1 2023-10-25T23:35:08.132 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-25T23:35:08.132 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-10-25T23:35:08.133 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-10-25 23:34:58.999306685 +0000 2023-10-25T23:35:08.133 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-10-25 23:32:14.214322253 +0000 2023-10-25T23:35:08.133 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-10-25 23:32:14.214322253 +0000 2023-10-25T23:35:08.133 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-10-25T23:35:08.134 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-25T23:35:08.199 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-10-25T23:35:08.200 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-10-25T23:35:08.200 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.00025233 s, 2.0 MB/s 2023-10-25T23:35:08.201 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-25T23:35:08.260 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2023-10-25T23:35:08.318 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-25T23:35:08.318 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-25T23:35:08.318 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 378293 Links: 1 2023-10-25T23:35:08.319 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-25T23:35:08.319 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-10-25T23:35:08.319 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-10-25 23:34:58.999306685 +0000 2023-10-25T23:35:08.319 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-10-25 23:32:14.720310692 +0000 2023-10-25T23:35:08.319 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-10-25 23:32:14.720310692 +0000 2023-10-25T23:35:08.319 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-10-25T23:35:08.320 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-25T23:35:08.385 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-10-25T23:35:08.386 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-10-25T23:35:08.386 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000227454 s, 2.3 MB/s 2023-10-25T23:35:08.387 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-25T23:35:08.446 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2023-10-25T23:35:08.505 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-25T23:35:08.506 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-25T23:35:08.506 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 378505 Links: 1 2023-10-25T23:35:08.506 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-25T23:35:08.506 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-10-25T23:35:08.506 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-10-25 23:34:58.999306685 +0000 2023-10-25T23:35:08.507 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-10-25 23:32:15.235298924 +0000 2023-10-25T23:35:08.507 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-10-25 23:32:15.235298924 +0000 2023-10-25T23:35:08.507 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-10-25T23:35:08.507 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-25T23:35:08.573 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-10-25T23:35:08.573 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-10-25T23:35:08.573 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000208732 s, 2.5 MB/s 2023-10-25T23:35:08.574 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-25T23:35:08.633 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-25T23:35:08.634 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-25T23:35:08.634 INFO:tasks.ceph:Generating config... 2023-10-25T23:35:08.636 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-25T23:35:08.636 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-25T23:35:08.636 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-25T23:35:08.637 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-25T23:35:08.637 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-25T23:35:08.637 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-25T23:35:08.638 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-25T23:35:08.638 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-25T23:35:08.638 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-25T23:35:08.638 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-25T23:35:08.639 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-25T23:35:08.639 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-25T23:35:08.640 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-25T23:35:08.640 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-25T23:35:08.640 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-25T23:35:08.641 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-25T23:35:08.641 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-25T23:35:08.641 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-25T23:35:08.641 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-25T23:35:08.642 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-25T23:35:08.642 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-25T23:35:08.642 INFO:tasks.ceph:Setting up mon.a... 2023-10-25T23:35:08.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-25T23:35:08.713 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.keyring 2023-10-25T23:35:08.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-25T23:35:08.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-25T23:35:08.792 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.81'), ('mon.b', '172.21.15.89'), ('mon.c', '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]')] 2023-10-25T23:35:08.793 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.81,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2023-10-25T23:35:08.794 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:08.794 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-25T23:35:08.849 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.81 --add b 172.21.15.89 --addv c '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-25T23:35:08.937 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-25T23:35:08.937 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: generated fsid 97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf 2023-10-25T23:35:08.938 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = pacific 2023-10-25T23:35:08.938 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 0 2023-10-25T23:35:08.938 INFO:teuthology.orchestra.run.smithi081.stdout:fsid 97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf 2023-10-25T23:35:08.938 INFO:teuthology.orchestra.run.smithi081.stdout:last_changed 2023-10-25T23:35:08.937096+0000 2023-10-25T23:35:08.939 INFO:teuthology.orchestra.run.smithi081.stdout:created 2023-10-25T23:35:08.937096+0000 2023-10-25T23:35:08.939 INFO:teuthology.orchestra.run.smithi081.stdout:min_mon_release 16 (pacific) 2023-10-25T23:35:08.939 INFO:teuthology.orchestra.run.smithi081.stdout:election_strategy: 1 2023-10-25T23:35:08.939 INFO:teuthology.orchestra.run.smithi081.stdout:0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2023-10-25T23:35:08.939 INFO:teuthology.orchestra.run.smithi081.stdout:1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2023-10-25T23:35:08.940 INFO:teuthology.orchestra.run.smithi081.stdout:2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2023-10-25T23:35:08.940 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-25T23:35:08.941 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-25T23:35:08.957 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf... 2023-10-25T23:35:08.958 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-25T23:35:08.999 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-25T23:35:09.042 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2023-10-25T23:35:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2023-10-25T23:35:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-25T23:35:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2023-10-25T23:35:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2023-10-25T23:35:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2023-10-25T23:35:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2023-10-25T23:35:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2023-10-25T23:35:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2023-10-25T23:35:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2023-10-25T23:35:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-25T23:35:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2023-10-25T23:35:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2023-10-25T23:35:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-25T23:35:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2023-10-25T23:35:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2023-10-25T23:35:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2023-10-25T23:35:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2023-10-25T23:35:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2023-10-25T23:35:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2023-10-25T23:35:09.048 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2023-10-25T23:35:09.048 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2023-10-25T23:35:09.048 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-25T23:35:09.048 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-25T23:35:09.048 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2023-10-25T23:35:09.049 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.049 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-25T23:35:09.049 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.049 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2023-10-25T23:35:09.049 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.049 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2023-10-25T23:35:09.050 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.050 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2023-10-25T23:35:09.050 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2023-10-25T23:35:09.050 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2023-10-25T23:35:09.050 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.81,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2023-10-25T23:35:09.051 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on skipped message = False 2023-10-25T23:35:09.051 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf 2023-10-25T23:35:09.051 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.051 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2023-10-25T23:35:09.051 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2023-10-25T23:35:09.052 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.052 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2023-10-25T23:35:09.052 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2023-10-25T23:35:09.052 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2023-10-25T23:35:09.053 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.053 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2023-10-25T23:35:09.053 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2023-10-25T23:35:09.053 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.053 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2023-10-25T23:35:09.053 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2023-10-25T23:35:09.054 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2023-10-25T23:35:09.054 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.054 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2023-10-25T23:35:09.054 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2023-10-25T23:35:09.054 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.055 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2023-10-25T23:35:09.055 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.055 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2023-10-25T23:35:09.055 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.055 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2023-10-25T23:35:09.056 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.056 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2023-10-25T23:35:09.056 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2023-10-25T23:35:09.056 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.056 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2023-10-25T23:35:09.057 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2023-10-25T23:35:09.057 INFO:teuthology.orchestra.run.smithi081.stdout: bdev async discard = True 2023-10-25T23:35:09.057 INFO:teuthology.orchestra.run.smithi081.stdout: bdev enable discard = True 2023-10-25T23:35:09.057 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore allocator = bitmap 2023-10-25T23:35:09.057 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2023-10-25T23:35:09.058 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2023-10-25T23:35:09.058 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 1/20 2023-10-25T23:35:09.058 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 1/20 2023-10-25T23:35:09.058 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-10-25T23:35:09.058 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2023-10-25T23:35:09.059 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 4/10 2023-10-25T23:35:09.059 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2023-10-25T23:35:09.059 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2023-10-25T23:35:09.059 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2023-10-25T23:35:09.059 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2023-10-25T23:35:09.060 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2023-10-25T23:35:09.060 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.060 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2023-10-25T23:35:09.060 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-10-25T23:35:09.060 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2023-10-25T23:35:09.061 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-10-25T23:35:09.061 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-10-25T23:35:09.061 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-10-25T23:35:09.061 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-10-25T23:35:09.061 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2023-10-25T23:35:09.061 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.062 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2023-10-25T23:35:09.062 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-10-25T23:35:09.062 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-10-25T23:35:09.062 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2023-10-25T23:35:09.062 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-10-25T23:35:09.063 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2023-10-25T23:35:09.063 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2023-10-25T23:35:09.063 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-10-25T23:35:09.063 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2023-10-25T23:35:09.063 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2023-10-25T23:35:09.064 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-10-25T23:35:09.064 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.064 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-25T23:35:09.064 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2023-10-25T23:35:09.064 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2023-10-25T23:35:09.065 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.065 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2023-10-25T23:35:09.065 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-25T23:35:09.065 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-25T23:35:09.065 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.065 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2023-10-25T23:35:09.066 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2023-10-25T23:35:09.066 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.066 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2023-10-25T23:35:09.066 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:09.066 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2023-10-25T23:35:09.067 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2023-10-25T23:35:09.067 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2023-10-25T23:35:09.067 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2023-10-25T23:35:09.067 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-25T23:35:09.067 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-25T23:35:09.068 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2023-10-25T23:35:09.068 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2023-10-25T23:35:09.068 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2023-10-25T23:35:09.068 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2023-10-25T23:35:09.068 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2023-10-25T23:35:09.068 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2023-10-25T23:35:09.069 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2023-10-25T23:35:09.070 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2023-10-25T23:35:09.071 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2023-10-25T23:35:09.071 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-25T23:35:09.071 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2023-10-25T23:35:09.071 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.072 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2023-10-25T23:35:09.072 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.072 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2023-10-25T23:35:09.072 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.072 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2023-10-25T23:35:09.072 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2023-10-25T23:35:09.073 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.073 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2023-10-25T23:35:09.073 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2023-10-25T23:35:09.073 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.073 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-25T23:35:09.074 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2023-10-25T23:35:09.074 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.074 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2023-10-25T23:35:09.074 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-25T23:35:09.075 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.075 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2023-10-25T23:35:09.075 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.075 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2023-10-25T23:35:09.075 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2023-10-25T23:35:09.076 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2023-10-25T23:35:09.076 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2023-10-25T23:35:09.076 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2023-10-25T23:35:09.076 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2023-10-25T23:35:09.076 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2023-10-25T23:35:09.077 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-25T23:35:09.077 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-25T23:35:09.077 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2023-10-25T23:35:09.077 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.077 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-25T23:35:09.077 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.078 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2023-10-25T23:35:09.078 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.078 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2023-10-25T23:35:09.078 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.078 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2023-10-25T23:35:09.079 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2023-10-25T23:35:09.079 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2023-10-25T23:35:09.079 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.81,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2023-10-25T23:35:09.079 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on skipped message = False 2023-10-25T23:35:09.079 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = 97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf 2023-10-25T23:35:09.080 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.080 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2023-10-25T23:35:09.080 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2023-10-25T23:35:09.080 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.080 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2023-10-25T23:35:09.081 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2023-10-25T23:35:09.081 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2023-10-25T23:35:09.081 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.081 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2023-10-25T23:35:09.081 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2023-10-25T23:35:09.081 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.082 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2023-10-25T23:35:09.082 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2023-10-25T23:35:09.082 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2023-10-25T23:35:09.082 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.082 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2023-10-25T23:35:09.083 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2023-10-25T23:35:09.083 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.083 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2023-10-25T23:35:09.083 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.083 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2023-10-25T23:35:09.084 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.084 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2023-10-25T23:35:09.084 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.084 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2023-10-25T23:35:09.084 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2023-10-25T23:35:09.085 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.085 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2023-10-25T23:35:09.085 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2023-10-25T23:35:09.085 INFO:teuthology.orchestra.run.smithi089.stdout: bdev async discard = True 2023-10-25T23:35:09.085 INFO:teuthology.orchestra.run.smithi089.stdout: bdev enable discard = True 2023-10-25T23:35:09.086 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore allocator = bitmap 2023-10-25T23:35:09.086 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2023-10-25T23:35:09.086 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2023-10-25T23:35:09.086 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 1/20 2023-10-25T23:35:09.086 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 1/20 2023-10-25T23:35:09.087 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-10-25T23:35:09.087 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2023-10-25T23:35:09.087 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 4/10 2023-10-25T23:35:09.087 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2023-10-25T23:35:09.087 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2023-10-25T23:35:09.088 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2023-10-25T23:35:09.088 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2023-10-25T23:35:09.088 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2023-10-25T23:35:09.088 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.088 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2023-10-25T23:35:09.088 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-10-25T23:35:09.089 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2023-10-25T23:35:09.089 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-10-25T23:35:09.089 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-10-25T23:35:09.089 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-10-25T23:35:09.089 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-10-25T23:35:09.090 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2023-10-25T23:35:09.090 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.090 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2023-10-25T23:35:09.090 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-10-25T23:35:09.090 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-10-25T23:35:09.091 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2023-10-25T23:35:09.091 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-10-25T23:35:09.091 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2023-10-25T23:35:09.091 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2023-10-25T23:35:09.091 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-10-25T23:35:09.092 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2023-10-25T23:35:09.092 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2023-10-25T23:35:09.092 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-10-25T23:35:09.092 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.092 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-25T23:35:09.092 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2023-10-25T23:35:09.093 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2023-10-25T23:35:09.093 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.093 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2023-10-25T23:35:09.093 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-25T23:35:09.093 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-25T23:35:09.094 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.094 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2023-10-25T23:35:09.094 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2023-10-25T23:35:09.094 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.094 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2023-10-25T23:35:09.095 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-25T23:35:09.096 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2023-10-25T23:35:09.096 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2023-10-25T23:35:09.096 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2023-10-25T23:35:09.096 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2023-10-25T23:35:09.096 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-25T23:35:09.097 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-25T23:35:09.097 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2023-10-25T23:35:09.097 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2023-10-25T23:35:09.097 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2023-10-25T23:35:09.097 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-10-25T23:35:09.098 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2023-10-25T23:35:09.098 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-10-25T23:35:09.098 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.d] 2023-10-25T23:35:09.099 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-25T23:35:09.099 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-25T23:35:09.179 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-25T23:35:09.179 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:09.180 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-25T23:35:09.196 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:09.196 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-25T23:35:09.253 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2023-10-25T23:35:09.254 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:09.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-25T23:35:09.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-25T23:35:09.339 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:09.340 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-25T23:35:09.409 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2023-10-25T23:35:09.409 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:09.410 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-25T23:35:09.410 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-25T23:35:09.453 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:09.454 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-25T23:35:09.513 INFO:tasks.ceph:Setting up mon nodes... 2023-10-25T23:35:09.514 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-25T23:35:09.514 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-25T23:35:09.571 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-25T23:35:09.574 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-25T23:35:09.646 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-25T23:35:09.649 INFO:tasks.ceph:Setting up mds nodes... 2023-10-25T23:35:09.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-25T23:35:09.705 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-25T23:35:09.707 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-25T23:35:09.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-25T23:35:09.827 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-25T23:35:09.830 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-25T23:35:09.856 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-25T23:35:09.915 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-25T23:35:09.918 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-25T23:35:09.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-25T23:35:10.038 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-25T23:35:10.041 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-25T23:35:10.067 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-25T23:35:10.068 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-25T23:35:10.112 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-25T23:35:10.125 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-25T23:35:10.125 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-25T23:35:10.126 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-25T23:35:10.152 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-25T23:35:10.152 INFO:tasks.ceph:role: osd.0 2023-10-25T23:35:10.152 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-25T23:35:10.153 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-25T23:35:10.225 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-25T23:35:10.225 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-25T23:35:10.225 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-25T23:35:10.225 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-25T23:35:10.226 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-25T23:35:10.226 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-10-25T23:35:10.226 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-25T23:35:10.226 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-25T23:35:10.226 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-25T23:35:10.227 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-25T23:35:10.664 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-10-25T23:35:10.666 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-10-25T23:35:10.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-25T23:35:10.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-25T23:35:10.857 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-25T23:35:10.924 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-25T23:35:10.925 INFO:tasks.ceph:role: osd.1 2023-10-25T23:35:10.925 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-25T23:35:10.925 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-25T23:35:10.998 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-25T23:35:10.998 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-25T23:35:10.998 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-25T23:35:10.998 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-25T23:35:10.999 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-25T23:35:10.999 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-10-25T23:35:10.999 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-25T23:35:10.999 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-25T23:35:10.999 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-25T23:35:11.000 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-25T23:35:11.430 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-10-25T23:35:11.431 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-10-25T23:35:11.432 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-25T23:35:11.532 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-25T23:35:11.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-25T23:35:11.632 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-25T23:35:11.632 INFO:tasks.ceph:role: osd.2 2023-10-25T23:35:11.632 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-25T23:35:11.633 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-25T23:35:11.708 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-25T23:35:11.708 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-25T23:35:11.708 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-25T23:35:11.709 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-25T23:35:11.709 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-25T23:35:11.709 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-10-25T23:35:11.709 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-25T23:35:11.709 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-25T23:35:11.710 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-25T23:35:11.710 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-25T23:35:12.154 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-10-25T23:35:12.156 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-10-25T23:35:12.156 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-25T23:35:12.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-25T23:35:12.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-25T23:35:12.413 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-25T23:35:12.414 INFO:tasks.ceph:role: osd.3 2023-10-25T23:35:12.414 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-25T23:35:12.414 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-25T23:35:12.488 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-25T23:35:12.488 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-25T23:35:12.488 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-25T23:35:12.489 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-25T23:35:12.489 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-25T23:35:12.489 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-10-25T23:35:12.489 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-25T23:35:12.489 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-25T23:35:12.490 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-25T23:35:12.490 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-25T23:35:12.926 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-10-25T23:35:12.929 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-10-25T23:35:12.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-25T23:35:13.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-25T23:35:13.121 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-25T23:35:13.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:13.229+0000 7f7688160640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-25T23:35:13.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:13.229+0000 7f7688160640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-25T23:35:13.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:13.229+0000 7f7688160640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-25T23:35:13.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:13.229+0000 7f7688160640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-25T23:35:13.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:13.229+0000 7f7688160640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-25T23:35:13.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:13.229+0000 7f7688160640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-25T23:35:16.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-25T23:35:16.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-25T23:35:16.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:16.227+0000 7fc12d9bb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-25T23:35:16.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:16.227+0000 7fc12d9bb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-25T23:35:16.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:16.227+0000 7fc12d9bb640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-25T23:35:16.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:16.227+0000 7fc12d9bb640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-25T23:35:16.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:16.227+0000 7fc12d9bb640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-25T23:35:16.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:16.228+0000 7fc12d9bb640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-25T23:35:19.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-25T23:35:19.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-25T23:35:19.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:19.220+0000 7fbf6b6ab640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-25T23:35:19.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:19.220+0000 7fbf6b6ab640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-25T23:35:19.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:19.220+0000 7fbf6b6ab640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-25T23:35:19.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:19.220+0000 7fbf6b6ab640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-25T23:35:19.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:19.220+0000 7fbf6b6ab640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-25T23:35:19.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:19.221+0000 7fbf6b6ab640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-25T23:35:22.087 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-25T23:35:22.119 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-25T23:35:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:22.211+0000 7faec428c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-25T23:35:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:22.211+0000 7faec428c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-25T23:35:22.212 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:22.211+0000 7faec428c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-25T23:35:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:22.211+0000 7faec428c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-25T23:35:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:22.211+0000 7faec428c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-25T23:35:22.213 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:22.212+0000 7faec428c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-25T23:35:25.077 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-25T23:35:25.109 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-25T23:35:25.142 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-25T23:35:25.142 INFO:tasks.ceph:role: osd.4 2023-10-25T23:35:25.143 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-25T23:35:25.143 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-25T23:35:25.221 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-25T23:35:25.221 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-25T23:35:25.221 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-25T23:35:25.221 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-25T23:35:25.222 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-25T23:35:25.222 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-10-25T23:35:25.222 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-25T23:35:25.222 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-25T23:35:25.222 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-25T23:35:25.223 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-25T23:35:25.655 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-10-25T23:35:25.657 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-10-25T23:35:25.657 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-25T23:35:25.837 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-25T23:35:25.874 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-25T23:35:25.943 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-25T23:35:25.944 INFO:tasks.ceph:role: osd.5 2023-10-25T23:35:25.944 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-25T23:35:25.944 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-25T23:35:26.018 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-25T23:35:26.019 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-25T23:35:26.019 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-25T23:35:26.019 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-25T23:35:26.019 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-25T23:35:26.019 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-10-25T23:35:26.020 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-25T23:35:26.020 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-25T23:35:26.020 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-25T23:35:26.020 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-25T23:35:26.444 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-10-25T23:35:26.445 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-10-25T23:35:26.446 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-25T23:35:26.562 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-25T23:35:26.595 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-25T23:35:26.665 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-25T23:35:26.665 INFO:tasks.ceph:role: osd.6 2023-10-25T23:35:26.666 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-25T23:35:26.666 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-25T23:35:26.741 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-25T23:35:26.742 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-25T23:35:26.742 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-25T23:35:26.742 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-25T23:35:26.742 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-25T23:35:26.743 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-10-25T23:35:26.743 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-25T23:35:26.743 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-25T23:35:26.743 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-25T23:35:26.743 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-25T23:35:27.186 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-10-25T23:35:27.188 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-10-25T23:35:27.189 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-25T23:35:27.362 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-25T23:35:27.397 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-25T23:35:27.468 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-25T23:35:27.468 INFO:tasks.ceph:role: osd.7 2023-10-25T23:35:27.468 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-25T23:35:27.469 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-25T23:35:27.545 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-25T23:35:27.545 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-25T23:35:27.545 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-25T23:35:27.545 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-25T23:35:27.546 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-25T23:35:27.546 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-10-25T23:35:27.546 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-25T23:35:27.546 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-25T23:35:27.546 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-25T23:35:27.547 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-25T23:35:27.981 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-10-25T23:35:27.983 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-10-25T23:35:27.983 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-25T23:35:28.170 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-25T23:35:28.207 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-25T23:35:28.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:28.312+0000 7f88bd297640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-25T23:35:28.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:28.312+0000 7f88bd297640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-25T23:35:28.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:28.312+0000 7f88bd297640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-25T23:35:28.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:28.312+0000 7f88bd297640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-25T23:35:28.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:28.312+0000 7f88bd297640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-25T23:35:28.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:28.312+0000 7f88bd297640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-25T23:35:31.190 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-25T23:35:31.222 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-25T23:35:31.313 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:31.310+0000 7fd6979b5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-25T23:35:31.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:31.310+0000 7fd6979b5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-25T23:35:31.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:31.311+0000 7fd6979b5640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-25T23:35:31.314 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:31.311+0000 7fd6979b5640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-25T23:35:31.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:31.311+0000 7fd6979b5640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-25T23:35:31.315 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:31.311+0000 7fd6979b5640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-25T23:35:34.178 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-25T23:35:34.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-25T23:35:34.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:34.299+0000 7fce36b19640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-25T23:35:34.301 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:34.300+0000 7fce36b19640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-25T23:35:34.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:34.300+0000 7fce36b19640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-25T23:35:34.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:34.300+0000 7fce36b19640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-25T23:35:34.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:34.300+0000 7fce36b19640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-25T23:35:34.302 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:34.300+0000 7fce36b19640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-25T23:35:36.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:35:36.995 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:35:37.172 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-25T23:35:37.203 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-25T23:35:37.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:37.294+0000 7f08ae46b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-25T23:35:37.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:37.294+0000 7f08ae46b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-25T23:35:37.296 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:37.294+0000 7f08ae46b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-25T23:35:37.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:37.294+0000 7f08ae46b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-25T23:35:37.297 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:37.294+0000 7f08ae46b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-25T23:35:37.298 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:37.295+0000 7f08ae46b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-25T23:35:40.173 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-25T23:35:40.204 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-25T23:35:40.204 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:40.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-25T23:35:40.237 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:40.237 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-25T23:35:40.308 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:40.309 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-25T23:35:40.379 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:40.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-25T23:35:40.448 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:40.449 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-25T23:35:40.518 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:40.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-25T23:35:40.587 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:40.587 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-25T23:35:40.655 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:40.656 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-25T23:35:40.687 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:40.687 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-25T23:35:40.758 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:40.759 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-25T23:35:40.828 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:40.828 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-25T23:35:40.897 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:40.897 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-25T23:35:40.965 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:40.965 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-25T23:35:41.033 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:41.033 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-25T23:35:41.100 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:41.101 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-25T23:35:41.121 INFO:tasks.ceph:Adding keys to all mons... 2023-10-25T23:35:41.121 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-25T23:35:41.164 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-25T23:35:41.190 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.y] 2023-10-25T23:35:41.191 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAtpjllf8kJIhAANwiGiLR+QzQ8VN7g3uQISA== 2023-10-25T23:35:41.191 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-10-25T23:35:41.191 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAtpjllP3MFKhAASVRjbXM6nb/KAx0TIQ3b3Q== 2023-10-25T23:35:41.191 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2023-10-25T23:35:41.191 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAtpjll+uBSMRAAz3A3r7R1gMsgL9Of9rCutg== 2023-10-25T23:35:41.192 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2023-10-25T23:35:41.192 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAxpjllMgW6DRAAzaJUEBdGi4swPc+JI9xQgw== 2023-10-25T23:35:41.192 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2023-10-25T23:35:41.192 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA0pjll6XKhDRAAb+FB63SrxE0xg1lT98Vp5A== 2023-10-25T23:35:41.192 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2023-10-25T23:35:41.193 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA3pjllBx41DRAAr7Z8KI2zCNUcSxoqC5ZxuQ== 2023-10-25T23:35:41.193 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2023-10-25T23:35:41.193 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA6pjll8OSYDBAAoMB54trGsPR+RyBgZ3VQTg== 2023-10-25T23:35:41.193 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2023-10-25T23:35:41.193 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAtpjllFTOFJhAAeAy545RznDoFG9zJSwdC/Q== 2023-10-25T23:35:41.194 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-10-25T23:35:41.194 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAtpjllRXuJNhAA/HbMis/fa7S/vbEPXULrVg== 2023-10-25T23:35:41.194 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.d] 2023-10-25T23:35:41.194 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAupjllsh1JAhAA3SZz2SWhQjcuq6UDmSJagA== 2023-10-25T23:35:41.194 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.4] 2023-10-25T23:35:41.195 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBApjllNYqyEhAAdPVaaumpnYvg+/BuSWBxGQ== 2023-10-25T23:35:41.195 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.5] 2023-10-25T23:35:41.195 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBDpjll5O+dEhAAHUJtDvr0eTv7ni60sVMkBg== 2023-10-25T23:35:41.195 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.6] 2023-10-25T23:35:41.195 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBGpjll7r7oERAAZ9VoDbe1Ad3I7hjgG25XSw== 2023-10-25T23:35:41.195 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.7] 2023-10-25T23:35:41.196 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQBJpjll2R2TERAAW0coSi4Yq28FlFMCMaMkDw== 2023-10-25T23:35:41.196 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2023-10-25T23:35:41.196 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAupjll2YyvBhAA5oXdeVbyEPjR6daqyH9hKQ== 2023-10-25T23:35:41.198 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2023-10-25T23:35:41.198 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAtpjllf8kJIhAANwiGiLR+QzQ8VN7g3uQISA== 2023-10-25T23:35:41.198 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2023-10-25T23:35:41.198 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAtpjllP3MFKhAASVRjbXM6nb/KAx0TIQ3b3Q== 2023-10-25T23:35:41.198 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2023-10-25T23:35:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAtpjll+uBSMRAAz3A3r7R1gMsgL9Of9rCutg== 2023-10-25T23:35:41.199 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2023-10-25T23:35:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAxpjllMgW6DRAAzaJUEBdGi4swPc+JI9xQgw== 2023-10-25T23:35:41.199 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2023-10-25T23:35:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA0pjll6XKhDRAAb+FB63SrxE0xg1lT98Vp5A== 2023-10-25T23:35:41.200 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2023-10-25T23:35:41.200 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA3pjllBx41DRAAr7Z8KI2zCNUcSxoqC5ZxuQ== 2023-10-25T23:35:41.200 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2023-10-25T23:35:41.200 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQA6pjll8OSYDBAAoMB54trGsPR+RyBgZ3VQTg== 2023-10-25T23:35:41.200 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2023-10-25T23:35:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAtpjllFTOFJhAAeAy545RznDoFG9zJSwdC/Q== 2023-10-25T23:35:41.201 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2023-10-25T23:35:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAtpjllRXuJNhAA/HbMis/fa7S/vbEPXULrVg== 2023-10-25T23:35:41.201 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2023-10-25T23:35:41.201 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAupjllsh1JAhAA3SZz2SWhQjcuq6UDmSJagA== 2023-10-25T23:35:41.201 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2023-10-25T23:35:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBApjllNYqyEhAAdPVaaumpnYvg+/BuSWBxGQ== 2023-10-25T23:35:41.202 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2023-10-25T23:35:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBDpjll5O+dEhAAHUJtDvr0eTv7ni60sVMkBg== 2023-10-25T23:35:41.202 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2023-10-25T23:35:41.202 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBGpjll7r7oERAAZ9VoDbe1Ad3I7hjgG25XSw== 2023-10-25T23:35:41.203 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2023-10-25T23:35:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBJpjll2R2TERAAW0coSi4Yq28FlFMCMaMkDw== 2023-10-25T23:35:41.203 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2023-10-25T23:35:41.203 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAupjll2YyvBhAA5oXdeVbyEPjR6daqyH9hKQ== 2023-10-25T23:35:41.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-25T23:35:41.241 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-25T23:35:41.297 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-25T23:35:41.299 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-25T23:35:41.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-25T23:35:41.358 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-25T23:35:41.414 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T23:35:41.416 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T23:35:41.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T23:35:41.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T23:35:41.525 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T23:35:41.527 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T23:35:41.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T23:35:41.583 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T23:35:41.635 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-25T23:35:41.638 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-25T23:35:41.691 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-25T23:35:41.693 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-25T23:35:41.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-25T23:35:41.751 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-25T23:35:41.807 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T23:35:41.810 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T23:35:41.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T23:35:41.865 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T23:35:41.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T23:35:41.921 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T23:35:41.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T23:35:41.976 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-25T23:35:42.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-25T23:35:42.031 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-25T23:35:42.088 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-25T23:35:42.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-25T23:35:42.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-25T23:35:42.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-25T23:35:42.239 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-25T23:35:42.266 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-25T23:35:42.364 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-25T23:35:42.391 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-25T23:35:42.457 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-25T23:35:42.554 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-25T23:35:42.580 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-25T23:35:42.583 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-25T23:35:42.637 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-25T23:35:42.637 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-25T23:35:42.638 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-25T23:35:42.641 INFO:tasks.ceph.mon.a:Started 2023-10-25T23:35:42.641 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-25T23:35:42.641 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-25T23:35:42.679 INFO:tasks.ceph.mon.b:Started 2023-10-25T23:35:42.680 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-25T23:35:42.680 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-25T23:35:42.682 INFO:tasks.ceph.mon.c:Started 2023-10-25T23:35:42.682 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-25T23:35:42.683 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-25T23:35:42.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-25T23:35:42.685 INFO:tasks.ceph.mgr.y:Started 2023-10-25T23:35:42.686 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-25T23:35:42.686 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-25T23:35:42.688 INFO:tasks.ceph.mgr.x:Started 2023-10-25T23:35:42.688 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2023-10-25T23:35:42.689 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2023-10-25T23:35:42.691 INFO:tasks.ceph:setting config [client] debug_client = 20 2023-10-25T23:35:42.691 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client debug_client 20 2023-10-25T23:35:42.735 INFO:tasks.ceph:setting config [client] debug_ms = 1 2023-10-25T23:35:42.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client debug_ms 1 2023-10-25T23:35:42.779 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2023-10-25T23:35:42.780 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2023-10-25T23:35:42.822 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2023-10-25T23:35:42.823 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2023-10-25T23:35:42.865 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2023-10-25T23:35:42.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds debug_mds 20 2023-10-25T23:35:42.909 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2023-10-25T23:35:42.910 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2023-10-25T23:35:42.953 INFO:tasks.ceph:setting config [mds] debug_ms = 1 2023-10-25T23:35:42.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds debug_ms 1 2023-10-25T23:35:42.996 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2023-10-25T23:35:42.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2023-10-25T23:35:43.044 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2023-10-25T23:35:43.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2023-10-25T23:35:43.106 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2023-10-25T23:35:43.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2023-10-25T23:35:43.186 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2023-10-25T23:35:43.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2023-10-25T23:35:43.231 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:43.228+0000 7f38f4890200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-25T23:35:43.232 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2023-10-25T23:35:43.232 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2023-10-25T23:35:43.252 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2023-10-25T23:35:43.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2023-10-25T23:35:43.295 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2023-10-25T23:35:43.296 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2023-10-25T23:35:43.306 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2023-10-25T23:35:43.307 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2023-10-25T23:35:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.307+0000 7ff231883700 1 -- 172.21.15.81:0/3421479171 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff22c148cb0 msgr2=0x7ff22c1e82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.307+0000 7ff231883700 1 --2- 172.21.15.81:0/3421479171 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff22c148cb0 0x7ff22c1e82c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff224007be0 tx=0x7ff224007ef0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.307+0000 7ff231883700 1 -- 172.21.15.81:0/3421479171 shutdown_connections 2023-10-25T23:35:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.307+0000 7ff231883700 1 --2- 172.21.15.81:0/3421479171 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff22c148cb0 0x7ff22c1e82c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.308+0000 7ff231883700 1 --2- 172.21.15.81:0/3421479171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff22c06b990 0x7ff22c156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.308+0000 7ff231883700 1 --2- 172.21.15.81:0/3421479171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff22c073050 0x7ff22c143140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.308+0000 7ff231883700 1 -- 172.21.15.81:0/3421479171 >> 172.21.15.81:0/3421479171 conn(0x7ff22c06d9b0 msgr2=0x7ff22c149d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.308+0000 7ff231883700 1 -- 172.21.15.81:0/3421479171 shutdown_connections 2023-10-25T23:35:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.308+0000 7ff231883700 1 -- 172.21.15.81:0/3421479171 wait complete. 2023-10-25T23:35:43.312 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2023-10-25T23:35:43.312 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2023-10-25T23:35:43.346 DEBUG:tasks.ceph:set 17 configs 2023-10-25T23:35:43.346 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi081') 2023-10-25T23:35:43.347 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi081') 2023-10-25T23:35:43.347 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi081') 2023-10-25T23:35:43.347 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi081') 2023-10-25T23:35:43.348 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi081') 2023-10-25T23:35:43.348 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi081') 2023-10-25T23:35:43.348 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi081') 2023-10-25T23:35:43.349 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:43.341+0000 7f38f4890200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-25T23:35:43.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.360+0000 7f860884a700 1 -- 172.21.15.81:0/3053269056 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) v1 -- 0x7f85e8001690 con 0x7f860406bb80 2023-10-25T23:35:43.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.364+0000 7f35301aa700 1 -- 172.21.15.81:0/3897613191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35280bb860 msgr2=0x7f35280ba970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.364+0000 7f35301aa700 1 --2- 172.21.15.81:0/3897613191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35280bb860 0x7f35280ba970 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f352806f980 tx=0x7f352000b380 comp rx=0 tx=0).stop 2023-10-25T23:35:43.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.366+0000 7f35301aa700 1 -- 172.21.15.81:0/3897613191 shutdown_connections 2023-10-25T23:35:43.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.366+0000 7f35301aa700 1 --2- 172.21.15.81:0/3897613191 >> v2:172.21.15.89:3300/0 conn(0x7f35280a4290 0x7f35280a2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.366+0000 7f35301aa700 1 --2- 172.21.15.81:0/3897613191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35280bb860 0x7f35280ba970 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.366+0000 7f35301aa700 1 --2- 172.21.15.81:0/3897613191 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f352806bb80 0x7f35280bbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.366+0000 7f35301aa700 1 -- 172.21.15.81:0/3897613191 >> 172.21.15.81:0/3897613191 conn(0x7f35280bf7c0 msgr2=0x7f35280bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.369+0000 7fb90f119700 1 -- 172.21.15.81:0/3645273817 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) v1 -- 0x7fb8e0005350 con 0x7fb9080bb860 2023-10-25T23:35:43.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.372+0000 7f85f2ffd700 1 -- 172.21.15.81:0/3053269056 <== mon.2 v2:172.21.15.89:3301/0 9 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v8)=0 v8) v1 ==== 106+0+0 (secure 0 0 0) 0x7f85f8017950 con 0x7f860406bb80 2023-10-25T23:35:43.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.383+0000 7f35301aa700 1 -- 172.21.15.81:0/3897613191 shutdown_connections 2023-10-25T23:35:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.386+0000 7f860884a700 1 -- 172.21.15.81:0/3053269056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f860406bb80 msgr2=0x7f86040b93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.386+0000 7f860884a700 1 --2- 172.21.15.81:0/3053269056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f860406bb80 0x7f86040b93b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f85f800b510 tx=0x7f85f800b8d0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.403 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.392+0000 7f35301aa700 1 -- 172.21.15.81:0/3897613191 wait complete. 2023-10-25T23:35:43.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.393+0000 7f35301aa700 1 Processor -- start 2023-10-25T23:35:43.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.393+0000 7f35301aa700 1 -- start start 2023-10-25T23:35:43.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.394+0000 7f35301aa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f352806bb80 0x7f35281e8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.394+0000 7f35301aa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35280a4290 0x7f352814a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.394+0000 7f35301aa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35280bb860 0x7f35281e72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.394+0000 7f35301aa700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35281e8ac0 con 0x7f35280bb860 2023-10-25T23:35:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.394+0000 7f35301aa700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35280b8b90 con 0x7f352806bb80 2023-10-25T23:35:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.394+0000 7f35301aa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35280b8e70 con 0x7f35280a4290 2023-10-25T23:35:43.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.395+0000 7f352d745700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35280a4290 0x7f352814a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.395+0000 7f352d745700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35280a4290 0x7f352814a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:58412/0 (socket says 172.21.15.81:58412) 2023-10-25T23:35:43.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.395+0000 7f352d745700 1 -- 172.21.15.81:0/3309119401 learned_addr learned my addr 172.21.15.81:0/3309119401 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:35:43.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.399+0000 7f352e747700 1 --2- 172.21.15.81:0/3309119401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35280bb860 0x7f35281e72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.399+0000 7f352e747700 1 -- 172.21.15.81:0/3309119401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35280a4290 msgr2=0x7f352814a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.399+0000 7f352e747700 1 --2- 172.21.15.81:0/3309119401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35280a4290 0x7f352814a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.399+0000 7f352e747700 1 -- 172.21.15.81:0/3309119401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f352806bb80 msgr2=0x7f35281e8580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-25T23:35:43.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.399+0000 7f352e747700 1 --2- 172.21.15.81:0/3309119401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f352806bb80 0x7f35281e8580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.399+0000 7f352e747700 1 -- 172.21.15.81:0/3309119401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3520009d00 con 0x7f35280bb860 2023-10-25T23:35:43.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.399+0000 7f352e747700 1 --2- 172.21.15.81:0/3309119401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35280bb860 0x7f35281e72e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f352400b3c0 tx=0x7f352400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:43.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.398+0000 7fb9057fa700 1 -- 172.21.15.81:0/3645273817 <== mon.1 v2:172.21.15.89:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v9)=0 v9) v1 ==== 117+0+0 (secure 0 0 0) 0x7fb8fc017b70 con 0x7fb9080bb860 2023-10-25T23:35:43.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.407+0000 7f860884a700 1 -- 172.21.15.81:0/3053269056 shutdown_connections 2023-10-25T23:35:43.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.407+0000 7f860884a700 1 --2- 172.21.15.81:0/3053269056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86040bb860 0x7f86040b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.407+0000 7f860884a700 1 --2- 172.21.15.81:0/3053269056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f860406bb80 0x7f86040b93b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.407+0000 7f860884a700 1 --2- 172.21.15.81:0/3053269056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86040a4290 0x7f86040b6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.407+0000 7f860884a700 1 -- 172.21.15.81:0/3053269056 >> 172.21.15.81:0/3053269056 conn(0x7f86040bf7c0 msgr2=0x7f86040a2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.407+0000 7f860884a700 1 -- 172.21.15.81:0/3053269056 shutdown_connections 2023-10-25T23:35:43.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.407+0000 7f860884a700 1 -- 172.21.15.81:0/3053269056 wait complete. 2023-10-25T23:35:43.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.410+0000 7f351e7fc700 1 -- 172.21.15.81:0/3309119401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524011830 con 0x7f35280bb860 2023-10-25T23:35:43.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.410+0000 7f351e7fc700 1 -- 172.21.15.81:0/3309119401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3524011a80 con 0x7f35280bb860 2023-10-25T23:35:43.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.410+0000 7f351e7fc700 1 -- 172.21.15.81:0/3309119401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524011e90 con 0x7f35280bb860 2023-10-25T23:35:43.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.411+0000 7f35301aa700 1 -- 172.21.15.81:0/3309119401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35280b9150 con 0x7f35280bb860 2023-10-25T23:35:43.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.411+0000 7f35301aa700 1 -- 172.21.15.81:0/3309119401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352814acc0 con 0x7f35280bb860 2023-10-25T23:35:43.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.423+0000 7f351e7fc700 1 -- 172.21.15.81:0/3309119401 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3524004320 con 0x7f35280bb860 2023-10-25T23:35:43.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.423+0000 7f351e7fc700 1 -- 172.21.15.81:0/3309119401 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f352401a4e0 con 0x7f35280bb860 2023-10-25T23:35:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.433+0000 7f35301aa700 1 -- 172.21.15.81:0/3309119401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35281e7130 con 0x7f35280bb860 2023-10-25T23:35:43.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.441+0000 7fb90f119700 1 -- 172.21.15.81:0/3645273817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9080bb860 msgr2=0x7fb9081eb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.441+0000 7fb90f119700 1 --2- 172.21.15.81:0/3645273817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9080bb860 0x7fb9081eb580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00b590 tx=0x7fb8fc00b8a0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.441+0000 7f351e7fc700 1 -- 172.21.15.81:0/3309119401 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3524015020 con 0x7f35280bb860 2023-10-25T23:35:43.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.448+0000 7fb90f119700 1 -- 172.21.15.81:0/3645273817 shutdown_connections 2023-10-25T23:35:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.448+0000 7fb90f119700 1 --2- 172.21.15.81:0/3645273817 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9080bb860 0x7fb9081eb580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.448+0000 7fb90f119700 1 --2- 172.21.15.81:0/3645273817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90806bb80 0x7fb90814c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.448+0000 7fb90f119700 1 --2- 172.21.15.81:0/3645273817 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9080a4290 0x7fb9081eb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.448+0000 7fb90f119700 1 -- 172.21.15.81:0/3645273817 >> 172.21.15.81:0/3645273817 conn(0x7fb9080bf7c0 msgr2=0x7fb90806fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.448+0000 7fb90f119700 1 -- 172.21.15.81:0/3645273817 shutdown_connections 2023-10-25T23:35:43.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.448+0000 7fb90f119700 1 -- 172.21.15.81:0/3645273817 wait complete. 2023-10-25T23:35:43.477 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '1'], check_status=True, hostname='smithi081') 2023-10-25T23:35:43.478 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi081') 2023-10-25T23:35:43.478 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:43.477+0000 7f7cc3dc9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-25T23:35:43.498 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:43.497+0000 7f38f4890200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-25T23:35:43.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.505+0000 7f5b5614c700 1 -- 172.21.15.81:0/237694053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b5006bb80 msgr2=0x7f5b500ba150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.505+0000 7f5b5614c700 1 --2- 172.21.15.81:0/237694053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b5006bb80 0x7f5b500ba150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5b500b6b10 tx=0x7f5b4800b380 comp rx=0 tx=0).stop 2023-10-25T23:35:43.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.516+0000 7f5b5614c700 1 -- 172.21.15.81:0/237694053 shutdown_connections 2023-10-25T23:35:43.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.516+0000 7f5b5614c700 1 --2- 172.21.15.81:0/237694053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b5006bb80 0x7f5b500ba150 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.516+0000 7f5b5614c700 1 --2- 172.21.15.81:0/237694053 >> v2:172.21.15.89:3300/0 conn(0x7f5b500bbc50 0x7f5b50072130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.516+0000 7f5b5614c700 1 -- 172.21.15.81:0/237694053 >> 172.21.15.81:0/237694053 conn(0x7f5b500bf7c0 msgr2=0x7f5b500bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.516+0000 7f5b5614c700 1 -- 172.21.15.81:0/237694053 shutdown_connections 2023-10-25T23:35:43.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.516+0000 7f5b5614c700 1 -- 172.21.15.81:0/237694053 wait complete. 2023-10-25T23:35:43.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.518+0000 7f5b5614c700 1 Processor -- start 2023-10-25T23:35:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.518+0000 7f5b5614c700 1 -- start start 2023-10-25T23:35:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.519+0000 7f5b5614c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b5006bb80 0x7f5b500b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.519+0000 7f5b5614c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b50088080 0x7f5b500982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.519+0000 7f5b5614c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b500bbc50 0x7f5b50085020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.519+0000 7f5b5614c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b500b6670 con 0x7f5b5006bb80 2023-10-25T23:35:43.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.519+0000 7f5b5614c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b50085560 con 0x7f5b50088080 2023-10-25T23:35:43.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.519+0000 7f5b5614c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b500987f0 con 0x7f5b500bbc50 2023-10-25T23:35:43.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.519+0000 7f5b4f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b5006bb80 0x7f5b500b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.520+0000 7f5b4f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b5006bb80 0x7f5b500b6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35504/0 (socket says 172.21.15.81:35504) 2023-10-25T23:35:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.520+0000 7f5b4f7fe700 1 -- 172.21.15.81:0/211898967 learned_addr learned my addr 172.21.15.81:0/211898967 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:35:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.520+0000 7f5b4effd700 1 --2- 172.21.15.81:0/211898967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b50088080 0x7f5b500982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.520+0000 7f5b4ffff700 1 --2- 172.21.15.81:0/211898967 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b500bbc50 0x7f5b50085020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.520+0000 7f5b4f7fe700 1 -- 172.21.15.81:0/211898967 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b500bbc50 msgr2=0x7f5b50085020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.520+0000 7f5b4f7fe700 1 --2- 172.21.15.81:0/211898967 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b500bbc50 0x7f5b50085020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.520+0000 7f5b4f7fe700 1 -- 172.21.15.81:0/211898967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b50088080 msgr2=0x7f5b500982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.520+0000 7f5b4f7fe700 1 --2- 172.21.15.81:0/211898967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b50088080 0x7f5b500982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.520+0000 7f5b4f7fe700 1 -- 172.21.15.81:0/211898967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b48009d00 con 0x7f5b5006bb80 2023-10-25T23:35:43.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.521+0000 7f5b4f7fe700 1 --2- 172.21.15.81:0/211898967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b5006bb80 0x7f5b500b6130 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800b070 tx=0x7f5b4800bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:43.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.522+0000 7f5b3ffff700 1 -- 172.21.15.81:0/211898967 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4800e070 con 0x7f5b5006bb80 2023-10-25T23:35:43.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.522+0000 7f5b3ffff700 1 -- 172.21.15.81:0/211898967 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5b48007b80 con 0x7f5b5006bb80 2023-10-25T23:35:43.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.522+0000 7f5b3ffff700 1 -- 172.21.15.81:0/211898967 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b48004030 con 0x7f5b5006bb80 2023-10-25T23:35:43.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.522+0000 7f5b5614c700 1 -- 172.21.15.81:0/211898967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b5016f7a0 con 0x7f5b5006bb80 2023-10-25T23:35:43.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.522+0000 7f5b5614c700 1 -- 172.21.15.81:0/211898967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5016fd60 con 0x7f5b5006bb80 2023-10-25T23:35:43.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.524+0000 7f5b3ffff700 1 -- 172.21.15.81:0/211898967 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5b48019040 con 0x7f5b5006bb80 2023-10-25T23:35:43.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.524+0000 7f5b3ffff700 1 -- 172.21.15.81:0/211898967 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5b480249c0 con 0x7f5b5006bb80 2023-10-25T23:35:43.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.525+0000 7f5b5614c700 1 -- 172.21.15.81:0/211898967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2c0052f0 con 0x7f5b5006bb80 2023-10-25T23:35:43.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.529+0000 7f5b3ffff700 1 -- 172.21.15.81:0/211898967 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f5b4801f070 con 0x7f5b5006bb80 2023-10-25T23:35:43.543 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:43.542+0000 7f7cc3dc9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-25T23:35:43.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.551+0000 7ff68354f700 1 -- 172.21.15.81:0/734427231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff67c0a4290 msgr2=0x7ff67c0ba970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.551+0000 7ff68354f700 1 --2- 172.21.15.81:0/734427231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff67c0a4290 0x7ff67c0ba970 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff674009f90 tx=0x7ff67400b330 comp rx=0 tx=0).stop 2023-10-25T23:35:43.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.552+0000 7ff68354f700 1 -- 172.21.15.81:0/734427231 shutdown_connections 2023-10-25T23:35:43.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.552+0000 7ff68354f700 1 --2- 172.21.15.81:0/734427231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff67c0a4290 0x7ff67c0ba970 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.552+0000 7ff68354f700 1 -- 172.21.15.81:0/734427231 >> 172.21.15.81:0/734427231 conn(0x7ff67c0bf7c0 msgr2=0x7ff67c0bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.558+0000 7ff68354f700 1 -- 172.21.15.81:0/734427231 shutdown_connections 2023-10-25T23:35:43.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.558+0000 7ff68354f700 1 -- 172.21.15.81:0/734427231 wait complete. 2023-10-25T23:35:43.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.560+0000 7ff68354f700 1 Processor -- start 2023-10-25T23:35:43.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.560+0000 7ff68354f700 1 -- start start 2023-10-25T23:35:43.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.561+0000 7ff68354f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff67c06bb80 0x7ff67c0b9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.561+0000 7ff68354f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c0a4290 0x7ff67c0993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.561+0000 7ff68354f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff67c0bb860 0x7ff67c09d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.561+0000 7ff68354f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c09d4d0 con 0x7ff67c0a4290 2023-10-25T23:35:43.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.561+0000 7ff68354f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0b9890 con 0x7ff67c06bb80 2023-10-25T23:35:43.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.561+0000 7ff68354f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c099910 con 0x7ff67c0bb860 2023-10-25T23:35:43.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.561+0000 7ff681aec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff67c0bb860 0x7ff67c09d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.561+0000 7ff6812eb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff67c06bb80 0x7ff67c0b9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.561+0000 7ff680aea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c0a4290 0x7ff67c0993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.561+0000 7ff680aea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c0a4290 0x7ff67c0993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35520/0 (socket says 172.21.15.81:35520) 2023-10-25T23:35:43.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.561+0000 7ff680aea700 1 -- 172.21.15.81:0/1997345741 learned_addr learned my addr 172.21.15.81:0/1997345741 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:35:43.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.562+0000 7ff680aea700 1 -- 172.21.15.81:0/1997345741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff67c0bb860 msgr2=0x7ff67c09d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.562+0000 7ff680aea700 1 --2- 172.21.15.81:0/1997345741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff67c0bb860 0x7ff67c09d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.562+0000 7ff680aea700 1 -- 172.21.15.81:0/1997345741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff67c06bb80 msgr2=0x7ff67c0b9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.562+0000 7ff680aea700 1 --2- 172.21.15.81:0/1997345741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff67c06bb80 0x7ff67c0b9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.562+0000 7ff680aea700 1 -- 172.21.15.81:0/1997345741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff674009c40 con 0x7ff67c0a4290 2023-10-25T23:35:43.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.562+0000 7ff680aea700 1 --2- 172.21.15.81:0/1997345741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c0a4290 0x7ff67c0993d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00c7b0 tx=0x7ff66c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:43.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.565+0000 7f834afb3700 1 -- 172.21.15.81:0/4192190940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f834406bb80 msgr2=0x7f83440ba970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.565+0000 7f834afb3700 1 --2- 172.21.15.81:0/4192190940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f834406bb80 0x7f83440ba970 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f83440a2570 tx=0x7f8334009ba0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.572+0000 7f834afb3700 1 -- 172.21.15.81:0/4192190940 shutdown_connections 2023-10-25T23:35:43.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.572+0000 7f834afb3700 1 --2- 172.21.15.81:0/4192190940 >> v2:172.21.15.81:3300/0 conn(0x7f83440a4290 0x7f83440bbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.572+0000 7f834afb3700 1 --2- 172.21.15.81:0/4192190940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f834406bb80 0x7f83440ba970 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.572+0000 7f834afb3700 1 -- 172.21.15.81:0/4192190940 >> 172.21.15.81:0/4192190940 conn(0x7f83440bf7c0 msgr2=0x7f83440bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.572+0000 7f834afb3700 1 -- 172.21.15.81:0/4192190940 shutdown_connections 2023-10-25T23:35:43.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.572+0000 7f7e71764700 1 -- 172.21.15.81:0/324813059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6c14b080 msgr2=0x7f7e6c14db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.573+0000 7f7e71764700 1 --2- 172.21.15.81:0/324813059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6c14b080 0x7f7e6c14db70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400ba50 tx=0x7f7e5400bd60 comp rx=0 tx=0).stop 2023-10-25T23:35:43.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.572+0000 7f834afb3700 1 -- 172.21.15.81:0/4192190940 wait complete. 2023-10-25T23:35:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.574+0000 7f834afb3700 1 Processor -- start 2023-10-25T23:35:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.574+0000 7f834afb3700 1 -- start start 2023-10-25T23:35:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.576+0000 7ff671ffb700 1 -- 172.21.15.81:0/1997345741 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c005480 con 0x7ff67c0a4290 2023-10-25T23:35:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.576+0000 7ff671ffb700 1 -- 172.21.15.81:0/1997345741 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff66c003770 con 0x7ff67c0a4290 2023-10-25T23:35:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.576+0000 7ff671ffb700 1 -- 172.21.15.81:0/1997345741 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c003b80 con 0x7ff67c0a4290 2023-10-25T23:35:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.576+0000 7ff68354f700 1 -- 172.21.15.81:0/1997345741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67c0b9c20 con 0x7ff67c0a4290 2023-10-25T23:35:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.576+0000 7ff68354f700 1 -- 172.21.15.81:0/1997345741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67c09a050 con 0x7ff67c0a4290 2023-10-25T23:35:43.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.578+0000 7ff68354f700 1 -- 172.21.15.81:0/1997345741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67c0670a0 con 0x7ff67c0a4290 2023-10-25T23:35:43.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.575+0000 7f834afb3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f834406bb80 0x7f834409fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.575+0000 7f834afb3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83440a4290 0x7f8344098e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.575+0000 7f834afb3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83440bb860 0x7f8344099370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.575+0000 7f834afb3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834409a4a0 con 0x7f83440a4290 2023-10-25T23:35:43.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.575+0000 7f834afb3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83440a02e0 con 0x7f83440bb860 2023-10-25T23:35:43.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.575+0000 7f834afb3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834409a6f0 con 0x7f834406bb80 2023-10-25T23:35:43.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.578+0000 7f8349550700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83440bb860 0x7f8344099370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.578+0000 7f8348d4f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f834406bb80 0x7f834409fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.578+0000 7f8343fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83440a4290 0x7f8344098e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.578+0000 7f8343fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83440a4290 0x7f8344098e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35536/0 (socket says 172.21.15.81:35536) 2023-10-25T23:35:43.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.578+0000 7f8343fff700 1 -- 172.21.15.81:0/1262117761 learned_addr learned my addr 172.21.15.81:0/1262117761 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:35:43.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.579+0000 7f8343fff700 1 -- 172.21.15.81:0/1262117761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f834406bb80 msgr2=0x7f834409fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.579+0000 7f8343fff700 1 --2- 172.21.15.81:0/1262117761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f834406bb80 0x7f834409fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.579+0000 7f8343fff700 1 -- 172.21.15.81:0/1262117761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83440bb860 msgr2=0x7f8344099370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.579+0000 7f8343fff700 1 --2- 172.21.15.81:0/1262117761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83440bb860 0x7f8344099370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.579+0000 7f8343fff700 1 -- 172.21.15.81:0/1262117761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8334009520 con 0x7f83440a4290 2023-10-25T23:35:43.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.579+0000 7f8343fff700 1 --2- 172.21.15.81:0/1262117761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83440a4290 0x7f8344098e30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8334000c00 tx=0x7f833400f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:43.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.580+0000 7f7e71764700 1 -- 172.21.15.81:0/324813059 shutdown_connections 2023-10-25T23:35:43.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.580+0000 7f7e71764700 1 --2- 172.21.15.81:0/324813059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e6c06a480 0x7f7e6c09ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.580+0000 7f7e71764700 1 --2- 172.21.15.81:0/324813059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6c14b080 0x7f7e6c14db70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.580+0000 7f7e71764700 1 -- 172.21.15.81:0/324813059 >> 172.21.15.81:0/324813059 conn(0x7f7e6c0bc4a0 msgr2=0x7f7e6c0bc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.581+0000 7f83417fa700 1 -- 172.21.15.81:0/1262117761 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833401b040 con 0x7f83440a4290 2023-10-25T23:35:43.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.581+0000 7f83417fa700 1 -- 172.21.15.81:0/1262117761 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8334004460 con 0x7f83440a4290 2023-10-25T23:35:43.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.581+0000 7f83417fa700 1 -- 172.21.15.81:0/1262117761 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833400fac0 con 0x7f83440a4290 2023-10-25T23:35:43.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.581+0000 7f834afb3700 1 -- 172.21.15.81:0/1262117761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834409a9d0 con 0x7f83440a4290 2023-10-25T23:35:43.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.581+0000 7f834afb3700 1 -- 172.21.15.81:0/1262117761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83440bbf90 con 0x7f83440a4290 2023-10-25T23:35:43.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.582+0000 7f7e71764700 1 -- 172.21.15.81:0/324813059 shutdown_connections 2023-10-25T23:35:43.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.582+0000 7f834afb3700 1 -- 172.21.15.81:0/1262117761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83440670a0 con 0x7f83440a4290 2023-10-25T23:35:43.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.583+0000 7f7e71764700 1 -- 172.21.15.81:0/324813059 wait complete. 2023-10-25T23:35:43.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.584+0000 7f7e71764700 1 Processor -- start 2023-10-25T23:35:43.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.584+0000 7f7e71764700 1 -- start start 2023-10-25T23:35:43.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.585+0000 7f7e71764700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e6c06a480 0x7f7e6c1f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.585+0000 7f7e71764700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6c0ba0c0 0x7f7e6c0b9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.585+0000 7f7e71764700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e6c14b080 0x7f7e6c0a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.585+0000 7f7e71764700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c0b9190 con 0x7f7e6c0ba0c0 2023-10-25T23:35:43.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.585+0000 7f7e71764700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c0a3e30 con 0x7f7e6c06a480 2023-10-25T23:35:43.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.585+0000 7f7e71764700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c0b3720 con 0x7f7e6c14b080 2023-10-25T23:35:43.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.586+0000 7f7e6affd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e6c06a480 0x7f7e6c1f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.586+0000 7f7e6affd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e6c06a480 0x7f7e6c1f47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:55620/0 (socket says 172.21.15.81:55620) 2023-10-25T23:35:43.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.586+0000 7f7e6affd700 1 -- 172.21.15.81:0/1165645795 learned_addr learned my addr 172.21.15.81:0/1165645795 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:35:43.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.586+0000 7f7e6affd700 1 -- 172.21.15.81:0/1165645795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e6c14b080 msgr2=0x7f7e6c0a38f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-25T23:35:43.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.586+0000 7f7e6affd700 1 --2- 172.21.15.81:0/1165645795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e6c14b080 0x7f7e6c0a38f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.586+0000 7f7e6affd700 1 -- 172.21.15.81:0/1165645795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6c0ba0c0 msgr2=0x7f7e6c0b9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.586+0000 7f7e6affd700 1 --2- 172.21.15.81:0/1165645795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6c0ba0c0 0x7f7e6c0b9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.586+0000 7f7e6affd700 1 -- 172.21.15.81:0/1165645795 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5400b730 con 0x7f7e6c06a480 2023-10-25T23:35:43.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.586+0000 7f7e6affd700 1 --2- 172.21.15.81:0/1165645795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e6c06a480 0x7f7e6c1f47f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c0078a0 tx=0x7f7e5c007c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:43.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.587+0000 7f606b17b700 1 -- 172.21.15.81:0/863880551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60640a4290 msgr2=0x7f60640bbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.587+0000 7f606b17b700 1 --2- 172.21.15.81:0/863880551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60640a4290 0x7f60640bbc40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f605c009fd0 tx=0x7f605c00b380 comp rx=0 tx=0).stop 2023-10-25T23:35:43.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.591+0000 7f606b17b700 1 -- 172.21.15.81:0/863880551 shutdown_connections 2023-10-25T23:35:43.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.591+0000 7f606b17b700 1 --2- 172.21.15.81:0/863880551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60640a4290 0x7f60640bbc40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.591+0000 7f606b17b700 1 --2- 172.21.15.81:0/863880551 >> v2:172.21.15.81:3300/0 conn(0x7f606406bb80 0x7f60640ba970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.591+0000 7f606b17b700 1 -- 172.21.15.81:0/863880551 >> 172.21.15.81:0/863880551 conn(0x7f60640bf7c0 msgr2=0x7f60640bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.591+0000 7f606b17b700 1 -- 172.21.15.81:0/863880551 shutdown_connections 2023-10-25T23:35:43.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.591+0000 7f606b17b700 1 -- 172.21.15.81:0/863880551 wait complete. 2023-10-25T23:35:43.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.593+0000 7f606b17b700 1 Processor -- start 2023-10-25T23:35:43.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.586+0000 7f7e637fe700 1 -- 172.21.15.81:0/1165645795 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00f040 con 0x7f7e6c06a480 2023-10-25T23:35:43.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.586+0000 7f7e637fe700 1 -- 172.21.15.81:0/1165645795 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7e5c00d960 con 0x7f7e6c06a480 2023-10-25T23:35:43.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.587+0000 7f7e637fe700 1 -- 172.21.15.81:0/1165645795 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c007ea0 con 0x7f7e6c06a480 2023-10-25T23:35:43.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.587+0000 7f7e71764700 1 -- 172.21.15.81:0/1165645795 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6c0b3a00 con 0x7f7e6c06a480 2023-10-25T23:35:43.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.587+0000 7f7e71764700 1 -- 172.21.15.81:0/1165645795 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6c0b5fc0 con 0x7f7e6c06a480 2023-10-25T23:35:43.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.588+0000 7f7e637fe700 1 -- 172.21.15.81:0/1165645795 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7e5c01c400 con 0x7f7e6c06a480 2023-10-25T23:35:43.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.588+0000 7f7e637fe700 1 -- 172.21.15.81:0/1165645795 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7e5c013630 con 0x7f7e6c06a480 2023-10-25T23:35:43.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.588+0000 7f7e71764700 1 -- 172.21.15.81:0/1165645795 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6c04e4c0 con 0x7f7e6c06a480 2023-10-25T23:35:43.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.591+0000 7f7e637fe700 1 -- 172.21.15.81:0/1165645795 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7e5c03bb40 con 0x7f7e6c06a480 2023-10-25T23:35:43.598 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.591+0000 7f35301aa700 1 -- 172.21.15.81:0/3309119401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) v1 -- 0x7f35280670a0 con 0x7f35280bb860 2023-10-25T23:35:43.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.587+0000 7ff671ffb700 1 -- 172.21.15.81:0/1997345741 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff66c01c440 con 0x7ff67c0a4290 2023-10-25T23:35:43.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.587+0000 7ff671ffb700 1 -- 172.21.15.81:0/1997345741 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff66c0127d0 con 0x7ff67c0a4290 2023-10-25T23:35:43.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.587+0000 7ff671ffb700 1 -- 172.21.15.81:0/1997345741 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7ff66c017070 con 0x7ff67c0a4290 2023-10-25T23:35:43.599 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.591+0000 7f83417fa700 1 -- 172.21.15.81:0/1262117761 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f833400fc20 con 0x7f83440a4290 2023-10-25T23:35:43.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.591+0000 7f83417fa700 1 -- 172.21.15.81:0/1262117761 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8334005360 con 0x7f83440a4290 2023-10-25T23:35:43.600 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.591+0000 7f83417fa700 1 -- 172.21.15.81:0/1262117761 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f83340056e0 con 0x7f83440a4290 2023-10-25T23:35:43.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.593+0000 7f606b17b700 1 -- start start 2023-10-25T23:35:43.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.595+0000 7f606b17b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f606406bb80 0x7f60640bd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.595+0000 7f606b17b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60640a4290 0x7f60641f0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.601 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.595+0000 7f606b17b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60640bb860 0x7f60641f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.595+0000 7f606b17b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606409ab60 con 0x7f60640bb860 2023-10-25T23:35:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.595+0000 7f606b17b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606409af80 con 0x7f606406bb80 2023-10-25T23:35:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.595+0000 7f606b17b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60640bdd70 con 0x7f60640a4290 2023-10-25T23:35:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.595+0000 7f6068f17700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f606406bb80 0x7f60640bd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.602 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.596+0000 7f6068f17700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f606406bb80 0x7f60640bd830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:55626/0 (socket says 172.21.15.81:55626) 2023-10-25T23:35:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.596+0000 7f6068f17700 1 -- 172.21.15.81:0/2691889324 learned_addr learned my addr 172.21.15.81:0/2691889324 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:35:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.596+0000 7f6063fff700 1 --2- 172.21.15.81:0/2691889324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60640a4290 0x7f60641f0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.597+0000 7f6068f17700 1 -- 172.21.15.81:0/2691889324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60640a4290 msgr2=0x7f60641f0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.597+0000 7f6068f17700 1 --2- 172.21.15.81:0/2691889324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60640a4290 0x7f60641f0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.597+0000 7f6068f17700 1 -- 172.21.15.81:0/2691889324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60640bb860 msgr2=0x7f60641f14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.603 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.597+0000 7f6068f17700 1 --2- 172.21.15.81:0/2691889324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60640bb860 0x7f60641f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.597+0000 7f6068f17700 1 -- 172.21.15.81:0/2691889324 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c009d00 con 0x7f606406bb80 2023-10-25T23:35:43.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.599+0000 7f6068f17700 1 --2- 172.21.15.81:0/2691889324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f606406bb80 0x7f60640bd830 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f605000b4a0 tx=0x7f605000b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:43.604 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.600+0000 7f60617fa700 1 -- 172.21.15.81:0/2691889324 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050011830 con 0x7f606406bb80 2023-10-25T23:35:43.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.600+0000 7f60617fa700 1 -- 172.21.15.81:0/2691889324 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6050011aa0 con 0x7f606406bb80 2023-10-25T23:35:43.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.600+0000 7f60617fa700 1 -- 172.21.15.81:0/2691889324 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050010380 con 0x7f606406bb80 2023-10-25T23:35:43.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.600+0000 7f606b17b700 1 -- 172.21.15.81:0/2691889324 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60640a0590 con 0x7f606406bb80 2023-10-25T23:35:43.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.600+0000 7f606b17b700 1 -- 172.21.15.81:0/2691889324 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606409eb90 con 0x7f606406bb80 2023-10-25T23:35:43.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.602+0000 7f60617fa700 1 -- 172.21.15.81:0/2691889324 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f60500107e0 con 0x7f606406bb80 2023-10-25T23:35:43.606 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.602+0000 7f60617fa700 1 -- 172.21.15.81:0/2691889324 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f605001a870 con 0x7f606406bb80 2023-10-25T23:35:43.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.607+0000 7f9501d2d700 1 -- 172.21.15.81:0/2534926192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94fc0a4290 msgr2=0x7f94fc0bbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.607+0000 7f9501d2d700 1 --2- 172.21.15.81:0/2534926192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94fc0a4290 0x7f94fc0bbc40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f94fc0c0790 tx=0x7f94f400b330 comp rx=0 tx=0).stop 2023-10-25T23:35:43.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.608+0000 7f9501d2d700 1 -- 172.21.15.81:0/2534926192 shutdown_connections 2023-10-25T23:35:43.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.608+0000 7f9501d2d700 1 --2- 172.21.15.81:0/2534926192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94fc0a4290 0x7f94fc0bbc40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.608+0000 7f9501d2d700 1 --2- 172.21.15.81:0/2534926192 >> v2:172.21.15.89:3300/0 conn(0x7f94fc0bb860 0x7f94fc0ba970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.608+0000 7f9501d2d700 1 -- 172.21.15.81:0/2534926192 >> 172.21.15.81:0/2534926192 conn(0x7f94fc0bf7c0 msgr2=0x7f94fc0bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.613+0000 7f606b17b700 1 -- 172.21.15.81:0/2691889324 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60400052f0 con 0x7f606406bb80 2023-10-25T23:35:43.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.615+0000 7f60617fa700 1 -- 172.21.15.81:0/2691889324 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f6050015020 con 0x7f606406bb80 2023-10-25T23:35:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.611+0000 7f351e7fc700 1 -- 172.21.15.81:0/3309119401 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v10)=0 v10) v1 ==== 115+0+0 (secure 0 0 0) 0x7f35240037d0 con 0x7f35280bb860 2023-10-25T23:35:43.622 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:43.621+0000 7f7cc3dc9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-25T23:35:43.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.613+0000 7f9501d2d700 1 -- 172.21.15.81:0/2534926192 shutdown_connections 2023-10-25T23:35:43.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.622+0000 7f9501d2d700 1 -- 172.21.15.81:0/2534926192 wait complete. 2023-10-25T23:35:43.625 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.624+0000 7f9501d2d700 1 Processor -- start 2023-10-25T23:35:43.626 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.625+0000 7f35301aa700 1 -- 172.21.15.81:0/3309119401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35280bb860 msgr2=0x7f35281e72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.625+0000 7f35301aa700 1 --2- 172.21.15.81:0/3309119401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35280bb860 0x7f35281e72e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f352400b3c0 tx=0x7f352400b780 comp rx=0 tx=0).stop 2023-10-25T23:35:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.625+0000 7f35301aa700 1 -- 172.21.15.81:0/3309119401 shutdown_connections 2023-10-25T23:35:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.625+0000 7f35301aa700 1 --2- 172.21.15.81:0/3309119401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35280bb860 0x7f35281e72e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.625+0000 7f35301aa700 1 --2- 172.21.15.81:0/3309119401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f352806bb80 0x7f35281e8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.625+0000 7f35301aa700 1 --2- 172.21.15.81:0/3309119401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35280a4290 0x7f352814a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.625+0000 7f35301aa700 1 -- 172.21.15.81:0/3309119401 >> 172.21.15.81:0/3309119401 conn(0x7f35280bf7c0 msgr2=0x7f35280bfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.624+0000 7f9501d2d700 1 -- start start 2023-10-25T23:35:43.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.625+0000 7f9501d2d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94fc06bb80 0x7f94fc1e3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.625+0000 7f9501d2d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94fc0a4290 0x7f94fc1e82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.625+0000 7f9501d2d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94fc0bb860 0x7f94fc1e45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.625+0000 7f9501d2d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc1f5520 con 0x7f94fc0bb860 2023-10-25T23:35:43.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.625+0000 7f9501d2d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc1e8800 con 0x7f94fc06bb80 2023-10-25T23:35:43.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.625+0000 7f9501d2d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc0b9a60 con 0x7f94fc0a4290 2023-10-25T23:35:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.626+0000 7f94f3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94fc0a4290 0x7f94fc1e82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.626+0000 7f94f3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94fc0a4290 0x7f94fc1e82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:58486/0 (socket says 172.21.15.81:58486) 2023-10-25T23:35:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.626+0000 7f94f3fff700 1 -- 172.21.15.81:0/3297628688 learned_addr learned my addr 172.21.15.81:0/3297628688 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:35:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.626+0000 7f27e30f5700 1 -- 172.21.15.81:0/1380766769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27dc14b080 msgr2=0x7f27dc14db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.626+0000 7f27e30f5700 1 --2- 172.21.15.81:0/1380766769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27dc14b080 0x7f27dc14db70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f27dc06b420 tx=0x7f27d400c5c0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.626+0000 7f94fb7fe700 1 --2- 172.21.15.81:0/3297628688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94fc06bb80 0x7f94fc1e3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.634 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:43.626+0000 7f38f4890200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-25T23:35:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.627+0000 7f94fbfff700 1 --2- 172.21.15.81:0/3297628688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94fc0bb860 0x7f94fc1e45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.627+0000 7f94fbfff700 1 -- 172.21.15.81:0/3297628688 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94fc0a4290 msgr2=0x7f94fc1e82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.627+0000 7f94fbfff700 1 --2- 172.21.15.81:0/3297628688 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94fc0a4290 0x7f94fc1e82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.627+0000 7f94fbfff700 1 -- 172.21.15.81:0/3297628688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94fc06bb80 msgr2=0x7f94fc1e3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.627+0000 7f94fbfff700 1 --2- 172.21.15.81:0/3297628688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94fc06bb80 0x7f94fc1e3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.627+0000 7f94fbfff700 1 -- 172.21.15.81:0/3297628688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f4009c40 con 0x7f94fc0bb860 2023-10-25T23:35:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.628+0000 7f94fbfff700 1 --2- 172.21.15.81:0/3297628688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94fc0bb860 0x7f94fc1e45b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f94f4014000 tx=0x7f94f400bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.628+0000 7f27e30f5700 1 -- 172.21.15.81:0/1380766769 shutdown_connections 2023-10-25T23:35:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.628+0000 7f27e30f5700 1 --2- 172.21.15.81:0/1380766769 >> v2:172.21.15.89:3300/0 conn(0x7f27dc06a480 0x7f27dc09ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.628+0000 7f27e30f5700 1 --2- 172.21.15.81:0/1380766769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27dc14b080 0x7f27dc14db70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.628+0000 7f27e30f5700 1 -- 172.21.15.81:0/1380766769 >> 172.21.15.81:0/1380766769 conn(0x7f27dc0bc4a0 msgr2=0x7f27dc0bc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.628+0000 7f27e30f5700 1 -- 172.21.15.81:0/1380766769 shutdown_connections 2023-10-25T23:35:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.628+0000 7f27e30f5700 1 -- 172.21.15.81:0/1380766769 wait complete. 2023-10-25T23:35:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.630+0000 7f27e30f5700 1 Processor -- start 2023-10-25T23:35:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.630+0000 7f27e30f5700 1 -- start start 2023-10-25T23:35:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.631+0000 7f27e30f5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27dc06a480 0x7f27dc0b9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.631+0000 7f27e30f5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27dc0ba0c0 0x7f27dc0b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.631+0000 7f27e30f5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27dc14b080 0x7f27dc0b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.631+0000 7f27e30f5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc0b97a0 con 0x7f27dc0ba0c0 2023-10-25T23:35:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.631+0000 7f27e30f5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc0b3bc0 con 0x7f27dc14b080 2023-10-25T23:35:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.631+0000 7f27e30f5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc0b62b0 con 0x7f27dc06a480 2023-10-25T23:35:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.632+0000 7f27e1692700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27dc14b080 0x7f27dc0b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.632+0000 7f27dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27dc0ba0c0 0x7f27dc0b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.632+0000 7f27e1692700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27dc14b080 0x7f27dc0b5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:55650/0 (socket says 172.21.15.81:55650) 2023-10-25T23:35:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.632+0000 7f27e1692700 1 -- 172.21.15.81:0/1215458819 learned_addr learned my addr 172.21.15.81:0/1215458819 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:35:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.632+0000 7f27dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27dc0ba0c0 0x7f27dc0b3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35578/0 (socket says 172.21.15.81:35578) 2023-10-25T23:35:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.632+0000 7f27e0e91700 1 --2- 172.21.15.81:0/1215458819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27dc06a480 0x7f27dc0b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.632+0000 7f27e1692700 1 -- 172.21.15.81:0/1215458819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27dc06a480 msgr2=0x7f27dc0b9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.632+0000 7f27e1692700 1 --2- 172.21.15.81:0/1215458819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27dc06a480 0x7f27dc0b9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.632+0000 7f27e1692700 1 -- 172.21.15.81:0/1215458819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27dc0ba0c0 msgr2=0x7f27dc0b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.632+0000 7f27e1692700 1 --2- 172.21.15.81:0/1215458819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27dc0ba0c0 0x7f27dc0b3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.632+0000 7f27e1692700 1 -- 172.21.15.81:0/1215458819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d400c050 con 0x7f27dc14b080 2023-10-25T23:35:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.632+0000 7f27e1692700 1 --2- 172.21.15.81:0/1215458819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27dc14b080 0x7f27dc0b5650 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f27d000c480 tx=0x7f27d000c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.639+0000 7f94f8ff9700 1 -- 172.21.15.81:0/3297628688 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f400e070 con 0x7f94fc0bb860 2023-10-25T23:35:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.639+0000 7f94f8ff9700 1 -- 172.21.15.81:0/3297628688 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f94f4004570 con 0x7f94fc0bb860 2023-10-25T23:35:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.639+0000 7f94f8ff9700 1 -- 172.21.15.81:0/3297628688 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f4007500 con 0x7f94fc0bb860 2023-10-25T23:35:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.640+0000 7f35301aa700 1 -- 172.21.15.81:0/3309119401 shutdown_connections 2023-10-25T23:35:43.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.639+0000 7f9501d2d700 1 -- 172.21.15.81:0/3297628688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94fc0b94a0 con 0x7f94fc0bb860 2023-10-25T23:35:43.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.639+0000 7f9501d2d700 1 -- 172.21.15.81:0/3297628688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94fc1e4090 con 0x7f94fc0bb860 2023-10-25T23:35:43.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.640+0000 7f94f8ff9700 1 -- 172.21.15.81:0/3297628688 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f94f4019040 con 0x7f94fc0bb860 2023-10-25T23:35:43.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.640+0000 7f94f8ff9700 1 -- 172.21.15.81:0/3297628688 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f94f4024540 con 0x7f94fc0bb860 2023-10-25T23:35:43.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.641+0000 7f9501d2d700 1 -- 172.21.15.81:0/3297628688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e00052f0 con 0x7f94fc0bb860 2023-10-25T23:35:43.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.645+0000 7f94f8ff9700 1 -- 172.21.15.81:0/3297628688 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f94f401f020 con 0x7f94fc0bb860 2023-10-25T23:35:43.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.647+0000 7f35301aa700 1 -- 172.21.15.81:0/3309119401 wait complete. 2023-10-25T23:35:43.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.651+0000 7f27d97fa700 1 -- 172.21.15.81:0/1215458819 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0011790 con 0x7f27dc14b080 2023-10-25T23:35:43.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.651+0000 7f27d97fa700 1 -- 172.21.15.81:0/1215458819 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f27d000ce90 con 0x7f27dc14b080 2023-10-25T23:35:43.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.651+0000 7f27d97fa700 1 -- 172.21.15.81:0/1215458819 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0011c60 con 0x7f27dc14b080 2023-10-25T23:35:43.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.651+0000 7f27e30f5700 1 -- 172.21.15.81:0/1215458819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27dc0b99e0 con 0x7f27dc14b080 2023-10-25T23:35:43.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.651+0000 7f27e30f5700 1 -- 172.21.15.81:0/1215458819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27dc0b85d0 con 0x7f27dc14b080 2023-10-25T23:35:43.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.657+0000 7f27d97fa700 1 -- 172.21.15.81:0/1215458819 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f27d001c760 con 0x7f27dc14b080 2023-10-25T23:35:43.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.657+0000 7f27d97fa700 1 -- 172.21.15.81:0/1215458819 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f27d0012720 con 0x7f27dc14b080 2023-10-25T23:35:43.672 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.668+0000 7f27e30f5700 1 -- 172.21.15.81:0/1215458819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27bc0052f0 con 0x7f27dc14b080 2023-10-25T23:35:43.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.680+0000 7f27d97fa700 1 -- 172.21.15.81:0/1215458819 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f27d0011dc0 con 0x7f27dc14b080 2023-10-25T23:35:43.692 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi081') 2023-10-25T23:35:43.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.693+0000 7f5b5614c700 1 -- 172.21.15.81:0/211898967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) v1 -- 0x7f5b2c005870 con 0x7f5b5006bb80 2023-10-25T23:35:43.702 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:43.701+0000 7f7cc3dc9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-25T23:35:43.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.718+0000 7f5b3ffff700 1 -- 172.21.15.81:0/211898967 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v11)=0 v11) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5b48017070 con 0x7f5b5006bb80 2023-10-25T23:35:43.725 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.724+0000 7f7e71764700 1 -- 172.21.15.81:0/1165645795 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) v1 -- 0x7f7e6c0bf120 con 0x7f7e6c06a480 2023-10-25T23:35:43.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.730+0000 7f5b5614c700 1 -- 172.21.15.81:0/211898967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b5006bb80 msgr2=0x7f5b500b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.730+0000 7f5b5614c700 1 --2- 172.21.15.81:0/211898967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b5006bb80 0x7f5b500b6130 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800b070 tx=0x7f5b4800bf00 comp rx=0 tx=0).stop 2023-10-25T23:35:43.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.730+0000 7f5b5614c700 1 -- 172.21.15.81:0/211898967 shutdown_connections 2023-10-25T23:35:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.730+0000 7f5b5614c700 1 --2- 172.21.15.81:0/211898967 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b500bbc50 0x7f5b50085020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.730+0000 7f5b5614c700 1 --2- 172.21.15.81:0/211898967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b5006bb80 0x7f5b500b6130 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800b070 tx=0x7f5b4800bf00 comp rx=0 tx=0).stop 2023-10-25T23:35:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.730+0000 7f5b5614c700 1 --2- 172.21.15.81:0/211898967 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b50088080 0x7f5b500982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.730+0000 7f5b5614c700 1 -- 172.21.15.81:0/211898967 >> 172.21.15.81:0/211898967 conn(0x7f5b500bf7c0 msgr2=0x7f5b500b9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.730+0000 7f5b5614c700 1 -- 172.21.15.81:0/211898967 shutdown_connections 2023-10-25T23:35:43.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.730+0000 7f5b5614c700 1 -- 172.21.15.81:0/211898967 wait complete. 2023-10-25T23:35:43.736 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.735+0000 7f7e637fe700 1 -- 172.21.15.81:0/1165645795 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v12)=0 v12) v1 ==== 120+0+0 (secure 0 0 0) 0x7f7e5c02a070 con 0x7f7e6c06a480 2023-10-25T23:35:43.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.737+0000 7f7e71764700 1 -- 172.21.15.81:0/1165645795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e6c06a480 msgr2=0x7f7e6c1f47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.737+0000 7f7e71764700 1 --2- 172.21.15.81:0/1165645795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e6c06a480 0x7f7e6c1f47f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c0078a0 tx=0x7f7e5c007c60 comp rx=0 tx=0).stop 2023-10-25T23:35:43.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.737+0000 7f7e71764700 1 -- 172.21.15.81:0/1165645795 shutdown_connections 2023-10-25T23:35:43.739 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.737+0000 7f7e71764700 1 --2- 172.21.15.81:0/1165645795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e6c14b080 0x7f7e6c0a38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.737+0000 7f7e71764700 1 --2- 172.21.15.81:0/1165645795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e6c06a480 0x7f7e6c1f47f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.737+0000 7f7e71764700 1 --2- 172.21.15.81:0/1165645795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e6c0ba0c0 0x7f7e6c0b9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.737+0000 7f7e71764700 1 -- 172.21.15.81:0/1165645795 >> 172.21.15.81:0/1165645795 conn(0x7f7e6c0bc4a0 msgr2=0x7f7e6c070410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.740 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.737+0000 7f7e71764700 1 -- 172.21.15.81:0/1165645795 shutdown_connections 2023-10-25T23:35:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.737+0000 7f7e71764700 1 -- 172.21.15.81:0/1165645795 wait complete. 2023-10-25T23:35:43.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.741+0000 7f834afb3700 1 -- 172.21.15.81:0/1262117761 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7f8344072030 con 0x7f83440a4290 2023-10-25T23:35:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.742+0000 7fda8b518700 1 -- 172.21.15.81:0/2061361632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda840bb8a0 msgr2=0x7fda8406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.742+0000 7fda8b518700 1 --2- 172.21.15.81:0/2061361632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda840bb8a0 0x7fda8406e3c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fda740098c0 tx=0x7fda74009bd0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.742+0000 7fda8b518700 1 -- 172.21.15.81:0/2061361632 shutdown_connections 2023-10-25T23:35:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.742+0000 7fda8b518700 1 --2- 172.21.15.81:0/2061361632 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda840bb8a0 0x7fda8406e3c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.742+0000 7fda8b518700 1 -- 172.21.15.81:0/2061361632 >> 172.21.15.81:0/2061361632 conn(0x7fda840bf7c0 msgr2=0x7fda840bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.743+0000 7fda8b518700 1 -- 172.21.15.81:0/2061361632 shutdown_connections 2023-10-25T23:35:43.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.743+0000 7fda8b518700 1 -- 172.21.15.81:0/2061361632 wait complete. 2023-10-25T23:35:43.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.744+0000 7fda8b518700 1 Processor -- start 2023-10-25T23:35:43.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.746+0000 7ff68354f700 1 -- 172.21.15.81:0/1997345741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) v1 -- 0x7ff67c04e4c0 con 0x7ff67c0a4290 2023-10-25T23:35:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.745+0000 7fda8b518700 1 -- start start 2023-10-25T23:35:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.746+0000 7fda8b518700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda840a3510 0x7fda841d7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.746+0000 7fda8b518700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda840bb8a0 0x7fda841e8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.746+0000 7fda8b518700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda840bf090 0x7fda841d0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.746+0000 7fda8b518700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda841ce050 con 0x7fda840bf090 2023-10-25T23:35:43.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.746+0000 7fda8b518700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda841e8ab0 con 0x7fda840bb8a0 2023-10-25T23:35:43.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.746+0000 7fda8b518700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda840b28d0 con 0x7fda840a3510 2023-10-25T23:35:43.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.747+0000 7fda89ab5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda840bf090 0x7fda841d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.747+0000 7fda89ab5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda840bf090 0x7fda841d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35586/0 (socket says 172.21.15.81:35586) 2023-10-25T23:35:43.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.747+0000 7fda89ab5700 1 -- 172.21.15.81:0/1661636276 learned_addr learned my addr 172.21.15.81:0/1661636276 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:35:43.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.747+0000 7fda892b4700 1 --2- 172.21.15.81:0/1661636276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda840a3510 0x7fda841d7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.747+0000 7fda89ab5700 1 -- 172.21.15.81:0/1661636276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda840a3510 msgr2=0x7fda841d7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.747+0000 7fda89ab5700 1 --2- 172.21.15.81:0/1661636276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda840a3510 0x7fda841d7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.747+0000 7fda89ab5700 1 -- 172.21.15.81:0/1661636276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda840bb8a0 msgr2=0x7fda841e8f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-25T23:35:43.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.747+0000 7fda89ab5700 1 --2- 172.21.15.81:0/1661636276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda840bb8a0 0x7fda841e8f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.747+0000 7fda89ab5700 1 -- 172.21.15.81:0/1661636276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda74009520 con 0x7fda840bf090 2023-10-25T23:35:43.755 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2023-10-25T23:35:43.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.747+0000 7fda89ab5700 1 --2- 172.21.15.81:0/1661636276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda840bf090 0x7fda841d0820 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00c780 tx=0x7fda7c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:43.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.748+0000 7fda79ffb700 1 -- 172.21.15.81:0/1661636276 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c003e10 con 0x7fda840bf090 2023-10-25T23:35:43.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.748+0000 7fda79ffb700 1 -- 172.21.15.81:0/1661636276 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fda7c005160 con 0x7fda840bf090 2023-10-25T23:35:43.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.748+0000 7fda79ffb700 1 -- 172.21.15.81:0/1661636276 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c005590 con 0x7fda840bf090 2023-10-25T23:35:43.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.748+0000 7fda8b518700 1 -- 172.21.15.81:0/1661636276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda840b25f0 con 0x7fda840bf090 2023-10-25T23:35:43.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.749+0000 7fda8b518700 1 -- 172.21.15.81:0/1661636276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda841ec9d0 con 0x7fda840bf090 2023-10-25T23:35:43.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.750+0000 7f83417fa700 1 -- 172.21.15.81:0/1262117761 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v13)=0 v13) v1 ==== 121+0+0 (secure 0 0 0) 0x7f8334004830 con 0x7f83440a4290 2023-10-25T23:35:43.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.752+0000 7fda79ffb700 1 -- 172.21.15.81:0/1661636276 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fda7c01c440 con 0x7fda840bf090 2023-10-25T23:35:43.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.752+0000 7fda79ffb700 1 -- 172.21.15.81:0/1661636276 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fda7c012900 con 0x7fda840bf090 2023-10-25T23:35:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.753+0000 7ff671ffb700 1 -- 172.21.15.81:0/1997345741 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v14)=0 v14) v1 ==== 119+0+0 (secure 0 0 0) 0x7ff66c012a40 con 0x7ff67c0a4290 2023-10-25T23:35:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.755+0000 7f834afb3700 1 -- 172.21.15.81:0/1262117761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83440a4290 msgr2=0x7f8344098e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.755+0000 7f834afb3700 1 --2- 172.21.15.81:0/1262117761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83440a4290 0x7f8344098e30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8334000c00 tx=0x7f833400f670 comp rx=0 tx=0).stop 2023-10-25T23:35:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.756+0000 7f834afb3700 1 -- 172.21.15.81:0/1262117761 shutdown_connections 2023-10-25T23:35:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.756+0000 7f834afb3700 1 --2- 172.21.15.81:0/1262117761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83440bb860 0x7f8344099370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.756+0000 7f834afb3700 1 --2- 172.21.15.81:0/1262117761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f834406bb80 0x7f834409fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.756+0000 7f834afb3700 1 --2- 172.21.15.81:0/1262117761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83440a4290 0x7f8344098e30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.756+0000 7f834afb3700 1 -- 172.21.15.81:0/1262117761 >> 172.21.15.81:0/1262117761 conn(0x7f83440bf7c0 msgr2=0x7f83440a2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.756+0000 7f834afb3700 1 -- 172.21.15.81:0/1262117761 shutdown_connections 2023-10-25T23:35:43.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.756+0000 7f834afb3700 1 -- 172.21.15.81:0/1262117761 wait complete. 2023-10-25T23:35:43.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.758+0000 7ff68354f700 1 -- 172.21.15.81:0/1997345741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c0a4290 msgr2=0x7ff67c0993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.758+0000 7ff68354f700 1 --2- 172.21.15.81:0/1997345741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c0a4290 0x7ff67c0993d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00c7b0 tx=0x7ff66c00cb70 comp rx=0 tx=0).stop 2023-10-25T23:35:43.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.758+0000 7fda8b518700 1 -- 172.21.15.81:0/1661636276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda840670a0 con 0x7fda840bf090 2023-10-25T23:35:43.763 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.758+0000 7ff68354f700 1 -- 172.21.15.81:0/1997345741 shutdown_connections 2023-10-25T23:35:43.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.758+0000 7ff68354f700 1 --2- 172.21.15.81:0/1997345741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff67c0bb860 0x7ff67c09d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.758+0000 7ff68354f700 1 --2- 172.21.15.81:0/1997345741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff67c06bb80 0x7ff67c0b9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.758+0000 7ff68354f700 1 --2- 172.21.15.81:0/1997345741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff67c0a4290 0x7ff67c0993d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.758+0000 7ff68354f700 1 -- 172.21.15.81:0/1997345741 >> 172.21.15.81:0/1997345741 conn(0x7ff67c0bf7c0 msgr2=0x7ff67c0a2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.758+0000 7f606b17b700 1 -- 172.21.15.81:0/2691889324 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) v1 -- 0x7f6040005160 con 0x7f606406bb80 2023-10-25T23:35:43.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.759+0000 7ff68354f700 1 -- 172.21.15.81:0/1997345741 shutdown_connections 2023-10-25T23:35:43.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.759+0000 7ff68354f700 1 -- 172.21.15.81:0/1997345741 wait complete. 2023-10-25T23:35:43.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.761+0000 7fda79ffb700 1 -- 172.21.15.81:0/1661636276 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fda7c017070 con 0x7fda840bf090 2023-10-25T23:35:43.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.770+0000 7f60617fa700 1 -- 172.21.15.81:0/2691889324 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v15)=0 v15) v1 ==== 120+0+0 (secure 0 0 0) 0x7f605001a410 con 0x7f606406bb80 2023-10-25T23:35:43.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.772+0000 7f606b17b700 1 -- 172.21.15.81:0/2691889324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f606406bb80 msgr2=0x7f60640bd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.772+0000 7f606b17b700 1 --2- 172.21.15.81:0/2691889324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f606406bb80 0x7f60640bd830 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f605000b4a0 tx=0x7f605000b7b0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.773+0000 7f606b17b700 1 -- 172.21.15.81:0/2691889324 shutdown_connections 2023-10-25T23:35:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.773+0000 7f606b17b700 1 --2- 172.21.15.81:0/2691889324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60640bb860 0x7f60641f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.773+0000 7f606b17b700 1 --2- 172.21.15.81:0/2691889324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f606406bb80 0x7f60640bd830 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.773+0000 7f606b17b700 1 --2- 172.21.15.81:0/2691889324 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60640a4290 0x7f60641f0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.773+0000 7f606b17b700 1 -- 172.21.15.81:0/2691889324 >> 172.21.15.81:0/2691889324 conn(0x7f60640bf7c0 msgr2=0x7f606415b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.774+0000 7f606b17b700 1 -- 172.21.15.81:0/2691889324 shutdown_connections 2023-10-25T23:35:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.774+0000 7f606b17b700 1 -- 172.21.15.81:0/2691889324 wait complete. 2023-10-25T23:35:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.784+0000 7f9501d2d700 1 -- 172.21.15.81:0/3297628688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) v1 -- 0x7f94e0005160 con 0x7f94fc0bb860 2023-10-25T23:35:43.788 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.787+0000 7f94f8ff9700 1 -- 172.21.15.81:0/3297628688 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v16)=0 v16) v1 ==== 121+0+0 (secure 0 0 0) 0x7f94f40330c0 con 0x7f94fc0bb860 2023-10-25T23:35:43.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.788+0000 7f9501d2d700 1 -- 172.21.15.81:0/3297628688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94fc0bb860 msgr2=0x7f94fc1e45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.788+0000 7f9501d2d700 1 --2- 172.21.15.81:0/3297628688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94fc0bb860 0x7f94fc1e45b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f94f4014000 tx=0x7f94f400bf20 comp rx=0 tx=0).stop 2023-10-25T23:35:43.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.788+0000 7f9501d2d700 1 -- 172.21.15.81:0/3297628688 shutdown_connections 2023-10-25T23:35:43.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.788+0000 7f9501d2d700 1 --2- 172.21.15.81:0/3297628688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94fc0bb860 0x7f94fc1e45b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.790 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.788+0000 7f9501d2d700 1 --2- 172.21.15.81:0/3297628688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94fc06bb80 0x7f94fc1e3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.788+0000 7f9501d2d700 1 --2- 172.21.15.81:0/3297628688 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94fc0a4290 0x7f94fc1e82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.788+0000 7f9501d2d700 1 -- 172.21.15.81:0/3297628688 >> 172.21.15.81:0/3297628688 conn(0x7f94fc0bf7c0 msgr2=0x7f94fc0a2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.788+0000 7f9501d2d700 1 -- 172.21.15.81:0/3297628688 shutdown_connections 2023-10-25T23:35:43.791 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.788+0000 7f9501d2d700 1 -- 172.21.15.81:0/3297628688 wait complete. 2023-10-25T23:35:43.802 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi081') 2023-10-25T23:35:43.802 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2023-10-25T23:35:43.802 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi081') 2023-10-25T23:35:43.803 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi081') 2023-10-25T23:35:43.803 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi081') 2023-10-25T23:35:43.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.827+0000 7f27e30f5700 1 -- 172.21.15.81:0/1215458819 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) v1 -- 0x7f27bc005160 con 0x7f27dc14b080 2023-10-25T23:35:43.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.831+0000 7f27d97fa700 1 -- 172.21.15.81:0/1215458819 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v17)=0 v17) v1 ==== 121+0+0 (secure 0 0 0) 0x7f27d001cba0 con 0x7f27dc14b080 2023-10-25T23:35:43.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.832+0000 7f27e30f5700 1 -- 172.21.15.81:0/1215458819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27dc14b080 msgr2=0x7f27dc0b5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.832+0000 7f27e30f5700 1 --2- 172.21.15.81:0/1215458819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27dc14b080 0x7f27dc0b5650 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f27d000c480 tx=0x7f27d000c790 comp rx=0 tx=0).stop 2023-10-25T23:35:43.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.832+0000 7f27e30f5700 1 -- 172.21.15.81:0/1215458819 shutdown_connections 2023-10-25T23:35:43.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.832+0000 7f27e30f5700 1 --2- 172.21.15.81:0/1215458819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27dc14b080 0x7f27dc0b5650 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.832+0000 7f27e30f5700 1 --2- 172.21.15.81:0/1215458819 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27dc06a480 0x7f27dc0b9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.832+0000 7f27e30f5700 1 --2- 172.21.15.81:0/1215458819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27dc0ba0c0 0x7f27dc0b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.832+0000 7f27e30f5700 1 -- 172.21.15.81:0/1215458819 >> 172.21.15.81:0/1215458819 conn(0x7f27dc0bc4a0 msgr2=0x7f27dc0bd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.832+0000 7f27e30f5700 1 -- 172.21.15.81:0/1215458819 shutdown_connections 2023-10-25T23:35:43.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.832+0000 7f27e30f5700 1 -- 172.21.15.81:0/1215458819 wait complete. 2023-10-25T23:35:43.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.839+0000 7fda8b518700 1 -- 172.21.15.81:0/1661636276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) v1 -- 0x7fda8404e4c0 con 0x7fda840bf090 2023-10-25T23:35:43.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.841+0000 7fda79ffb700 1 -- 172.21.15.81:0/1661636276 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v18)=0 v18) v1 ==== 121+0+0 (secure 0 0 0) 0x7fda7c012c50 con 0x7fda840bf090 2023-10-25T23:35:43.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.842+0000 7fda8b518700 1 -- 172.21.15.81:0/1661636276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda840bf090 msgr2=0x7fda841d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.842+0000 7fda8b518700 1 --2- 172.21.15.81:0/1661636276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda840bf090 0x7fda841d0820 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00c780 tx=0x7fda7c00cb40 comp rx=0 tx=0).stop 2023-10-25T23:35:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.842+0000 7fda8b518700 1 -- 172.21.15.81:0/1661636276 shutdown_connections 2023-10-25T23:35:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.842+0000 7fda8b518700 1 --2- 172.21.15.81:0/1661636276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda840bf090 0x7fda841d0820 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.842+0000 7fda8b518700 1 --2- 172.21.15.81:0/1661636276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fda840a3510 0x7fda841d7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.842+0000 7fda8b518700 1 --2- 172.21.15.81:0/1661636276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda840bb8a0 0x7fda841e8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.843+0000 7fda8b518700 1 -- 172.21.15.81:0/1661636276 >> 172.21.15.81:0/1661636276 conn(0x7fda840bf7c0 msgr2=0x7fda8409f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.843+0000 7fda8b518700 1 -- 172.21.15.81:0/1661636276 shutdown_connections 2023-10-25T23:35:43.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.843+0000 7fda8b518700 1 -- 172.21.15.81:0/1661636276 wait complete. 2023-10-25T23:35:43.847 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2023-10-25T23:35:43.848 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:43.846+0000 7f7cc3dc9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-25T23:35:43.856 INFO:tasks.ceph:Setting crush tunables to default 2023-10-25T23:35:43.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd crush tunables default 2023-10-25T23:35:43.867 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:43.866+0000 7f38f4890200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-25T23:35:43.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.989+0000 7f0305e21700 1 -- 172.21.15.81:0/2601293189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0300145de0 msgr2=0x7f0300146290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.989+0000 7f0305e21700 1 --2- 172.21.15.81:0/2601293189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0300145de0 0x7f0300146290 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f03000bd250 tx=0x7f02f8009c70 comp rx=0 tx=0).stop 2023-10-25T23:35:43.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.989+0000 7f0305e21700 1 -- 172.21.15.81:0/2601293189 shutdown_connections 2023-10-25T23:35:43.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.989+0000 7f0305e21700 1 --2- 172.21.15.81:0/2601293189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0300145de0 0x7f0300146290 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.989+0000 7f0305e21700 1 --2- 172.21.15.81:0/2601293189 >> v2:172.21.15.89:3300/0 conn(0x7f030006f660 0x7f03000bd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.989+0000 7f0305e21700 1 -- 172.21.15.81:0/2601293189 >> 172.21.15.81:0/2601293189 conn(0x7f030006b320 msgr2=0x7f030006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:43.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.990+0000 7f0305e21700 1 -- 172.21.15.81:0/2601293189 shutdown_connections 2023-10-25T23:35:43.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.990+0000 7f0305e21700 1 -- 172.21.15.81:0/2601293189 wait complete. 2023-10-25T23:35:43.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.991+0000 7f0305e21700 1 Processor -- start 2023-10-25T23:35:43.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.991+0000 7f0305e21700 1 -- start start 2023-10-25T23:35:43.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.991+0000 7f0305e21700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f030006f660 0x7f03000ba330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.991+0000 7f0305e21700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03000bd570 0x7f03000ba870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.991+0000 7f0305e21700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0300145de0 0x7f03001dbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:43.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.991+0000 7f0305e21700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03001e2b90 con 0x7f0300145de0 2023-10-25T23:35:43.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.991+0000 7f0305e21700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03001dc670 con 0x7f030006f660 2023-10-25T23:35:43.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f0305e21700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03001e2e50 con 0x7f03000bd570 2023-10-25T23:35:43.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f02fffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0300145de0 0x7f03001dbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f02fffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0300145de0 0x7f03001dbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35602/0 (socket says 172.21.15.81:35602) 2023-10-25T23:35:43.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f02feffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03000bd570 0x7f03000ba870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f02ff7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f030006f660 0x7f03000ba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:43.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f02fffff700 1 -- 172.21.15.81:0/2734285963 learned_addr learned my addr 172.21.15.81:0/2734285963 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:35:43.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f02fffff700 1 -- 172.21.15.81:0/2734285963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03000bd570 msgr2=0x7f03000ba870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f02fffff700 1 --2- 172.21.15.81:0/2734285963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03000bd570 0x7f03000ba870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f02fffff700 1 -- 172.21.15.81:0/2734285963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f030006f660 msgr2=0x7f03000ba330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f02fffff700 1 --2- 172.21.15.81:0/2734285963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f030006f660 0x7f03000ba330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f02fffff700 1 -- 172.21.15.81:0/2734285963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f80095f0 con 0x7f0300145de0 2023-10-25T23:35:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f02fffff700 1 --2- 172.21.15.81:0/2734285963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0300145de0 0x7f03001dbae0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f02f8005fd0 tx=0x7f02f8004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:43.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f02e7fff700 1 -- 172.21.15.81:0/2734285963 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f801c070 con 0x7f0300145de0 2023-10-25T23:35:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f02e7fff700 1 -- 172.21.15.81:0/2734285963 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f02f8005a00 con 0x7f0300145de0 2023-10-25T23:35:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f0305e21700 1 -- 172.21.15.81:0/2734285963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0300136b80 con 0x7f0300145de0 2023-10-25T23:35:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f02e7fff700 1 -- 172.21.15.81:0/2734285963 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f80045f0 con 0x7f0300145de0 2023-10-25T23:35:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f0305e21700 1 -- 172.21.15.81:0/2734285963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03001566a0 con 0x7f0300145de0 2023-10-25T23:35:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f02e7fff700 1 -- 172.21.15.81:0/2734285963 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f02f800b9f0 con 0x7f0300145de0 2023-10-25T23:35:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.992+0000 7f02e7fff700 1 -- 172.21.15.81:0/2734285963 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f02f800fa80 con 0x7f0300145de0 2023-10-25T23:35:44.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.993+0000 7f0305e21700 1 -- 172.21.15.81:0/2734285963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03001e3010 con 0x7f0300145de0 2023-10-25T23:35:44.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:43.997+0000 7f02e7fff700 1 -- 172.21.15.81:0/2734285963 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f02f802e060 con 0x7f0300145de0 2023-10-25T23:35:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:44.072+0000 7f0305e21700 1 -- 172.21.15.81:0/2734285963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f0300156b10 con 0x7f0300145de0 2023-10-25T23:35:44.075 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:44.073+0000 7f02e7fff700 1 -- 172.21.15.81:0/2734285963 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0300156b10 con 0x7f0300145de0 2023-10-25T23:35:44.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:44.074+0000 7f0305e21700 1 -- 172.21.15.81:0/2734285963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0300145de0 msgr2=0x7f03001dbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:44.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:44.074+0000 7f0305e21700 1 --2- 172.21.15.81:0/2734285963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0300145de0 0x7f03001dbae0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f02f8005fd0 tx=0x7f02f8004260 comp rx=0 tx=0).stop 2023-10-25T23:35:44.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:44.074+0000 7f0305e21700 1 -- 172.21.15.81:0/2734285963 shutdown_connections 2023-10-25T23:35:44.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:44.074+0000 7f0305e21700 1 --2- 172.21.15.81:0/2734285963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0300145de0 0x7f03001dbae0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:44.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:44.074+0000 7f0305e21700 1 --2- 172.21.15.81:0/2734285963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f030006f660 0x7f03000ba330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:44.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:44.074+0000 7f0305e21700 1 --2- 172.21.15.81:0/2734285963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03000bd570 0x7f03000ba870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:44.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:44.074+0000 7f0305e21700 1 -- 172.21.15.81:0/2734285963 >> 172.21.15.81:0/2734285963 conn(0x7f030006b320 msgr2=0x7f0300066420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:44.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:44.074+0000 7f0305e21700 1 -- 172.21.15.81:0/2734285963 shutdown_connections 2023-10-25T23:35:44.078 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:44.074+0000 7f0305e21700 1 -- 172.21.15.81:0/2734285963 wait complete. 2023-10-25T23:35:44.078 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2023-10-25T23:35:44.088 INFO:tasks.ceph:check_enable_crimson: False 2023-10-25T23:35:44.088 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-25T23:35:44.089 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:44.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-25T23:35:44.115 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:44.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-25T23:35:44.182 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:44.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-25T23:35:44.237 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:44.236+0000 7f7cc3dc9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-25T23:35:44.247 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:35:44.250 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-25T23:35:44.277 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:44.275+0000 7f38f4890200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-25T23:35:44.302 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:44.302 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-25T23:35:44.330 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:44.330 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-25T23:35:44.356 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:44.354+0000 7f7cc3dc9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-25T23:35:44.384 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:44.385 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-25T23:35:44.395 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:44.393+0000 7f38f4890200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-25T23:35:44.451 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-25T23:35:44.451 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-25T23:35:44.453 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:44.451+0000 7f7cc3dc9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-25T23:35:44.476 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:44.474+0000 7f38f4890200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-25T23:35:44.478 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 48415836-8f22-4dcd-baa3-1d09c90c9a0b 0 2023-10-25T23:35:44.536 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:44.535+0000 7f7cc3dc9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-25T23:35:44.556 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:44.554+0000 7f38f4890200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-25T23:35:44.642 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.641+0000 7f654b5bf700 1 -- 172.21.15.89:0/1347559728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65440bb530 msgr2=0x7f65440bd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:44.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.641+0000 7f654b5bf700 1 --2- 172.21.15.89:0/1347559728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65440bb530 0x7f65440bd5c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f654414b4b0 tx=0x7f6534009ba0 comp rx=0 tx=0).stop 2023-10-25T23:35:44.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.641+0000 7f654b5bf700 1 -- 172.21.15.89:0/1347559728 shutdown_connections 2023-10-25T23:35:44.643 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.641+0000 7f654b5bf700 1 --2- 172.21.15.89:0/1347559728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65440bb530 0x7f65440bd5c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:44.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.641+0000 7f654b5bf700 1 -- 172.21.15.89:0/1347559728 >> 172.21.15.89:0/1347559728 conn(0x7f654406b320 msgr2=0x7f654406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:44.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.641+0000 7f654b5bf700 1 -- 172.21.15.89:0/1347559728 shutdown_connections 2023-10-25T23:35:44.644 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.641+0000 7f654b5bf700 1 -- 172.21.15.89:0/1347559728 wait complete. 2023-10-25T23:35:44.648 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.642+0000 7f654b5bf700 1 Processor -- start 2023-10-25T23:35:44.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.642+0000 7f654b5bf700 1 -- start start 2023-10-25T23:35:44.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.643+0000 7f654b5bf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65440bb530 0x7f65440bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:44.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.643+0000 7f654b5bf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65440bdb00 0x7f654414a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:44.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.643+0000 7f654b5bf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6544144f60 0x7f65440c0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:44.649 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.643+0000 7f654b5bf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65441e2650 con 0x7f65440bb530 2023-10-25T23:35:44.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.643+0000 7f654b5bf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65441e2930 con 0x7f6544144f60 2023-10-25T23:35:44.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.643+0000 7f654b5bf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65441e2c10 con 0x7f65440bdb00 2023-10-25T23:35:44.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.643+0000 7f6548b5a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65440bdb00 0x7f654414a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:44.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.643+0000 7f6549b5c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6544144f60 0x7f65440c0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:44.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.643+0000 7f6548b5a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65440bdb00 0x7f654414a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:55070/0 (socket says 172.21.15.89:55070) 2023-10-25T23:35:44.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.643+0000 7f6548b5a700 1 -- 172.21.15.89:0/4141760399 learned_addr learned my addr 172.21.15.89:0/4141760399 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-25T23:35:44.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.643+0000 7f654935b700 1 --2- 172.21.15.89:0/4141760399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65440bb530 0x7f65440bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:44.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.644+0000 7f6548b5a700 1 -- 172.21.15.89:0/4141760399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6544144f60 msgr2=0x7f65440c0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:44.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.644+0000 7f6548b5a700 1 --2- 172.21.15.89:0/4141760399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6544144f60 0x7f65440c0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:44.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.644+0000 7f6548b5a700 1 -- 172.21.15.89:0/4141760399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65440bb530 msgr2=0x7f65440bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:44.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.644+0000 7f6548b5a700 1 --2- 172.21.15.89:0/4141760399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65440bb530 0x7f65440bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:44.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.644+0000 7f6548b5a700 1 -- 172.21.15.89:0/4141760399 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6534009520 con 0x7f65440bdb00 2023-10-25T23:35:44.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.644+0000 7f6548b5a700 1 --2- 172.21.15.89:0/4141760399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65440bdb00 0x7f654414a360 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6534004000 tx=0x7f65340042e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:44.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.644+0000 7f6539ffb700 1 -- 172.21.15.89:0/4141760399 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653400b910 con 0x7f65440bdb00 2023-10-25T23:35:44.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.644+0000 7f6539ffb700 1 -- 172.21.15.89:0/4141760399 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6534003e90 con 0x7f65440bdb00 2023-10-25T23:35:44.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.644+0000 7f654b5bf700 1 -- 172.21.15.89:0/4141760399 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65441e2ef0 con 0x7f65440bdb00 2023-10-25T23:35:44.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.644+0000 7f6539ffb700 1 -- 172.21.15.89:0/4141760399 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653400bde0 con 0x7f65440bdb00 2023-10-25T23:35:44.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.644+0000 7f654b5bf700 1 -- 172.21.15.89:0/4141760399 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6544143c90 con 0x7f65440bdb00 2023-10-25T23:35:44.653 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.644+0000 7f6539ffb700 1 -- 172.21.15.89:0/4141760399 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6534029460 con 0x7f65440bdb00 2023-10-25T23:35:44.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.644+0000 7f6539ffb700 1 -- 172.21.15.89:0/4141760399 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f653400f460 con 0x7f65440bdb00 2023-10-25T23:35:44.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.645+0000 7f654b5bf700 1 -- 172.21.15.89:0/4141760399 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65240052f0 con 0x7f65440bdb00 2023-10-25T23:35:44.654 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.647+0000 7f6539ffb700 1 -- 172.21.15.89:0/4141760399 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f653400f670 con 0x7f65440bdb00 2023-10-25T23:35:44.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.744+0000 7f654b5bf700 1 -- 172.21.15.89:0/4141760399 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "48415836-8f22-4dcd-baa3-1d09c90c9a0b", "id": 0} v 0) v1 -- 0x7f6524005910 con 0x7f65440bdb00 2023-10-25T23:35:44.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.747+0000 7f6539ffb700 1 -- 172.21.15.89:0/4141760399 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "48415836-8f22-4dcd-baa3-1d09c90c9a0b", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6534029a70 con 0x7f65440bdb00 2023-10-25T23:35:44.749 INFO:teuthology.orchestra.run.smithi089.stdout:0 2023-10-25T23:35:44.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.748+0000 7f654b5bf700 1 -- 172.21.15.89:0/4141760399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65440bdb00 msgr2=0x7f654414a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:44.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.748+0000 7f654b5bf700 1 --2- 172.21.15.89:0/4141760399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65440bdb00 0x7f654414a360 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6534004000 tx=0x7f65340042e0 comp rx=0 tx=0).stop 2023-10-25T23:35:44.750 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.749+0000 7f654b5bf700 1 -- 172.21.15.89:0/4141760399 shutdown_connections 2023-10-25T23:35:44.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.749+0000 7f654b5bf700 1 --2- 172.21.15.89:0/4141760399 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6544144f60 0x7f65440c0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:44.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.749+0000 7f654b5bf700 1 --2- 172.21.15.89:0/4141760399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65440bb530 0x7f65440bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:44.751 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.749+0000 7f654b5bf700 1 --2- 172.21.15.89:0/4141760399 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65440bdb00 0x7f654414a360 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:44.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.749+0000 7f654b5bf700 1 -- 172.21.15.89:0/4141760399 >> 172.21.15.89:0/4141760399 conn(0x7f654406b320 msgr2=0x7f6544140e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:44.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.749+0000 7f654b5bf700 1 -- 172.21.15.89:0/4141760399 shutdown_connections 2023-10-25T23:35:44.752 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.749+0000 7f654b5bf700 1 -- 172.21.15.89:0/4141760399 wait complete. 2023-10-25T23:35:44.761 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 19a4f6b5-e75c-45ae-aa08-b3467e69eed5 1 2023-10-25T23:35:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.921+0000 7fd0c00e9700 1 -- 172.21.15.89:0/19928349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b80bd570 msgr2=0x7fd0b80bd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:44.923 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.921+0000 7fd0c00e9700 1 --2- 172.21.15.89:0/19928349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b80bd570 0x7fd0b80bd950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009990 tx=0x7fd0b4009ca0 comp rx=0 tx=0).stop 2023-10-25T23:35:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.921+0000 7fd0c00e9700 1 -- 172.21.15.89:0/19928349 shutdown_connections 2023-10-25T23:35:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.921+0000 7fd0c00e9700 1 --2- 172.21.15.89:0/19928349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b80bd570 0x7fd0b80bd950 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.921+0000 7fd0c00e9700 1 --2- 172.21.15.89:0/19928349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b8145de0 0x7fd0b8146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.921+0000 7fd0c00e9700 1 -- 172.21.15.89:0/19928349 >> 172.21.15.89:0/19928349 conn(0x7fd0b806b320 msgr2=0x7fd0b806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:44.924 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.921+0000 7fd0c00e9700 1 -- 172.21.15.89:0/19928349 shutdown_connections 2023-10-25T23:35:44.925 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.921+0000 7fd0c00e9700 1 -- 172.21.15.89:0/19928349 wait complete. 2023-10-25T23:35:44.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.923+0000 7fd0c00e9700 1 Processor -- start 2023-10-25T23:35:44.927 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.923+0000 7fd0c00e9700 1 -- start start 2023-10-25T23:35:44.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0c00e9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0b806f660 0x7fd0b8136e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:44.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0c00e9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b80bd570 0x7fd0b813c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:44.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0c00e9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b8145de0 0x7fd0b813ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:44.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0c00e9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b813c520 con 0x7fd0b806f660 2023-10-25T23:35:44.928 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0c00e9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80c1160 con 0x7fd0b8145de0 2023-10-25T23:35:44.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0c00e9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b80c0ba0 con 0x7fd0b80bd570 2023-10-25T23:35:44.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0be686700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b8145de0 0x7fd0b813ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:44.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0bd684700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b80bd570 0x7fd0b813c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:44.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0be686700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b8145de0 0x7fd0b813ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48142/0 (socket says 172.21.15.89:48142) 2023-10-25T23:35:44.929 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0be686700 1 -- 172.21.15.89:0/533060511 learned_addr learned my addr 172.21.15.89:0/533060511 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-25T23:35:44.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0bde85700 1 --2- 172.21.15.89:0/533060511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0b806f660 0x7fd0b8136e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:44.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0be686700 1 -- 172.21.15.89:0/533060511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b80bd570 msgr2=0x7fd0b813c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:44.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0be686700 1 --2- 172.21.15.89:0/533060511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b80bd570 0x7fd0b813c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:44.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0be686700 1 -- 172.21.15.89:0/533060511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0b806f660 msgr2=0x7fd0b8136e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:44.930 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0be686700 1 --2- 172.21.15.89:0/533060511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0b806f660 0x7fd0b8136e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:44.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0be686700 1 -- 172.21.15.89:0/533060511 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b0009c40 con 0x7fd0b8145de0 2023-10-25T23:35:44.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0bd684700 1 --2- 172.21.15.89:0/533060511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b80bd570 0x7fd0b813c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-25T23:35:44.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0be686700 1 --2- 172.21.15.89:0/533060511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b8145de0 0x7fd0b813ce80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd0b000c0f0 tx=0x7fd0b000c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:44.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.924+0000 7fd0ae7fc700 1 -- 172.21.15.89:0/533060511 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0003a00 con 0x7fd0b8145de0 2023-10-25T23:35:44.931 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.925+0000 7fd0c00e9700 1 -- 172.21.15.89:0/533060511 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b40095f0 con 0x7fd0b8145de0 2023-10-25T23:35:44.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.925+0000 7fd0ae7fc700 1 -- 172.21.15.89:0/533060511 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd0b000e030 con 0x7fd0b8145de0 2023-10-25T23:35:44.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.925+0000 7fd0ae7fc700 1 -- 172.21.15.89:0/533060511 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0003de0 con 0x7fd0b8145de0 2023-10-25T23:35:44.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.925+0000 7fd0c00e9700 1 -- 172.21.15.89:0/533060511 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b806db90 con 0x7fd0b8145de0 2023-10-25T23:35:44.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.925+0000 7fd0ae7fc700 1 -- 172.21.15.89:0/533060511 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd0b000cd00 con 0x7fd0b8145de0 2023-10-25T23:35:44.932 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.925+0000 7fd0ae7fc700 1 -- 172.21.15.89:0/533060511 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fd0b00043e0 con 0x7fd0b8145de0 2023-10-25T23:35:44.933 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.925+0000 7fd0c00e9700 1 -- 172.21.15.89:0/533060511 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b813c660 con 0x7fd0b8145de0 2023-10-25T23:35:44.933 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:44.928+0000 7fd0ae7fc700 1 -- 172.21.15.89:0/533060511 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fd0b813c660 con 0x7fd0b8145de0 2023-10-25T23:35:44.999 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:44.997+0000 7f7cc3dc9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-25T23:35:45.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.011+0000 7fd0c00e9700 1 -- 172.21.15.89:0/533060511 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "19a4f6b5-e75c-45ae-aa08-b3467e69eed5", "id": 1} v 0) v1 -- 0x7fd0b804e4c0 con 0x7fd0b8145de0 2023-10-25T23:35:45.019 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.018+0000 7fd0ae7fc700 1 -- 172.21.15.89:0/533060511 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "19a4f6b5-e75c-45ae-aa08-b3467e69eed5", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd0b0018020 con 0x7fd0b8145de0 2023-10-25T23:35:45.019 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-25T23:35:45.020 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.019+0000 7fd0c00e9700 1 -- 172.21.15.89:0/533060511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b8145de0 msgr2=0x7fd0b813ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:45.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.019+0000 7fd0c00e9700 1 --2- 172.21.15.89:0/533060511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b8145de0 0x7fd0b813ce80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd0b000c0f0 tx=0x7fd0b000c400 comp rx=0 tx=0).stop 2023-10-25T23:35:45.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.019+0000 7fd0c00e9700 1 -- 172.21.15.89:0/533060511 shutdown_connections 2023-10-25T23:35:45.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.019+0000 7fd0c00e9700 1 --2- 172.21.15.89:0/533060511 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0b8145de0 0x7fd0b813ce80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.021 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.019+0000 7fd0c00e9700 1 --2- 172.21.15.89:0/533060511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0b806f660 0x7fd0b8136e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.019+0000 7fd0c00e9700 1 --2- 172.21.15.89:0/533060511 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0b80bd570 0x7fd0b813c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.019+0000 7fd0c00e9700 1 -- 172.21.15.89:0/533060511 >> 172.21.15.89:0/533060511 conn(0x7fd0b806b320 msgr2=0x7fd0b81433d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:45.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.019+0000 7fd0c00e9700 1 -- 172.21.15.89:0/533060511 shutdown_connections 2023-10-25T23:35:45.022 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.019+0000 7fd0c00e9700 1 -- 172.21.15.89:0/533060511 wait complete. 2023-10-25T23:35:45.023 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:45.022+0000 7f38f4890200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-25T23:35:45.032 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 60645312-54f5-4a74-ae52-68d17ff2d6e9 2 2023-10-25T23:35:45.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.154+0000 7f30bbeb2700 1 -- 172.21.15.89:0/78593571 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b4145de0 msgr2=0x7f30b4146290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:45.156 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.154+0000 7f30bbeb2700 1 --2- 172.21.15.89:0/78593571 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b4145de0 0x7f30b4146290 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009f60 tx=0x7f30ac009f90 comp rx=0 tx=0).stop 2023-10-25T23:35:45.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.154+0000 7f30bbeb2700 1 -- 172.21.15.89:0/78593571 shutdown_connections 2023-10-25T23:35:45.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.154+0000 7f30bbeb2700 1 --2- 172.21.15.89:0/78593571 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b4145de0 0x7f30b4146290 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.154+0000 7f30bbeb2700 1 --2- 172.21.15.89:0/78593571 >> v2:172.21.15.81:3300/0 conn(0x7f30b406f660 0x7f30b40bd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.157 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.154+0000 7f30bbeb2700 1 -- 172.21.15.89:0/78593571 >> 172.21.15.89:0/78593571 conn(0x7f30b406b320 msgr2=0x7f30b406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:45.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.155+0000 7f30bbeb2700 1 -- 172.21.15.89:0/78593571 shutdown_connections 2023-10-25T23:35:45.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.155+0000 7f30bbeb2700 1 -- 172.21.15.89:0/78593571 wait complete. 2023-10-25T23:35:45.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.156+0000 7f30bbeb2700 1 Processor -- start 2023-10-25T23:35:45.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.156+0000 7f30bbeb2700 1 -- start start 2023-10-25T23:35:45.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.156+0000 7f30bbeb2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b406f660 0x7f30b413e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:45.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.156+0000 7f30bbeb2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30b40bd570 0x7f30b40b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:45.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.156+0000 7f30bbeb2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30b4145de0 0x7f30b40b8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:45.162 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.156+0000 7f30bbeb2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b40b9c50 con 0x7f30b40bd570 2023-10-25T23:35:45.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.156+0000 7f30bbeb2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b41e86e0 con 0x7f30b4145de0 2023-10-25T23:35:45.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.156+0000 7f30bbeb2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b41e7880 con 0x7f30b406f660 2023-10-25T23:35:45.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.156+0000 7f30b9c4e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b406f660 0x7f30b413e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:45.163 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.156+0000 7f30b9c4e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b406f660 0x7f30b413e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:55092/0 (socket says 172.21.15.89:55092) 2023-10-25T23:35:45.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.156+0000 7f30b9c4e700 1 -- 172.21.15.89:0/3779327725 learned_addr learned my addr 172.21.15.89:0/3779327725 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-25T23:35:45.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.156+0000 7f30ba44f700 1 --2- 172.21.15.89:0/3779327725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30b4145de0 0x7f30b40b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:45.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.156+0000 7f30b944d700 1 --2- 172.21.15.89:0/3779327725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30b40bd570 0x7f30b40b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:45.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.157+0000 7f30b9c4e700 1 -- 172.21.15.89:0/3779327725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30b4145de0 msgr2=0x7f30b40b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:45.164 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.157+0000 7f30b9c4e700 1 --2- 172.21.15.89:0/3779327725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30b4145de0 0x7f30b40b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.157+0000 7f30b9c4e700 1 -- 172.21.15.89:0/3779327725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30b40bd570 msgr2=0x7f30b40b82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:45.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.157+0000 7f30b9c4e700 1 --2- 172.21.15.89:0/3779327725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30b40bd570 0x7f30b40b82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.157+0000 7f30b9c4e700 1 -- 172.21.15.89:0/3779327725 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac009c40 con 0x7f30b406f660 2023-10-25T23:35:45.165 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.157+0000 7f30ba44f700 1 --2- 172.21.15.89:0/3779327725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30b4145de0 0x7f30b40b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-25T23:35:45.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.157+0000 7f30b9c4e700 1 --2- 172.21.15.89:0/3779327725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b406f660 0x7f30b413e420 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f30b000c700 tx=0x7f30b000ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:45.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.157+0000 7f30aa7fc700 1 -- 172.21.15.89:0/3779327725 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b0005230 con 0x7f30b406f660 2023-10-25T23:35:45.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.157+0000 7f30aa7fc700 1 -- 172.21.15.89:0/3779327725 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f30b0005480 con 0x7f30b406f660 2023-10-25T23:35:45.166 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.157+0000 7f30bbeb2700 1 -- 172.21.15.89:0/3779327725 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b413e960 con 0x7f30b406f660 2023-10-25T23:35:45.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.157+0000 7f30aa7fc700 1 -- 172.21.15.89:0/3779327725 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b0004990 con 0x7f30b406f660 2023-10-25T23:35:45.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.157+0000 7f30bbeb2700 1 -- 172.21.15.89:0/3779327725 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b41e7db0 con 0x7f30b406f660 2023-10-25T23:35:45.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.157+0000 7f30aa7fc700 1 -- 172.21.15.89:0/3779327725 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f30b0011590 con 0x7f30b406f660 2023-10-25T23:35:45.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.157+0000 7f30aa7fc700 1 -- 172.21.15.89:0/3779327725 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f30b0012840 con 0x7f30b406f660 2023-10-25T23:35:45.167 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.158+0000 7f30bbeb2700 1 -- 172.21.15.89:0/3779327725 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30b40b8140 con 0x7f30b406f660 2023-10-25T23:35:45.168 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.160+0000 7f30aa7fc700 1 -- 172.21.15.89:0/3779327725 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f30b0017070 con 0x7f30b406f660 2023-10-25T23:35:45.244 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.243+0000 7f30bbeb2700 1 -- 172.21.15.89:0/3779327725 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "60645312-54f5-4a74-ae52-68d17ff2d6e9", "id": 2} v 0) v1 -- 0x7f30b404e4c0 con 0x7f30b406f660 2023-10-25T23:35:45.252 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.251+0000 7f30aa7fc700 1 -- 172.21.15.89:0/3779327725 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "60645312-54f5-4a74-ae52-68d17ff2d6e9", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f30b0012420 con 0x7f30b406f660 2023-10-25T23:35:45.252 INFO:teuthology.orchestra.run.smithi089.stdout:2 2023-10-25T23:35:45.253 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.252+0000 7f30bbeb2700 1 -- 172.21.15.89:0/3779327725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b406f660 msgr2=0x7f30b413e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:45.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.252+0000 7f30bbeb2700 1 --2- 172.21.15.89:0/3779327725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b406f660 0x7f30b413e420 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f30b000c700 tx=0x7f30b000ca10 comp rx=0 tx=0).stop 2023-10-25T23:35:45.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.252+0000 7f30bbeb2700 1 -- 172.21.15.89:0/3779327725 shutdown_connections 2023-10-25T23:35:45.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.252+0000 7f30bbeb2700 1 --2- 172.21.15.89:0/3779327725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30b4145de0 0x7f30b40b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.254 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.252+0000 7f30bbeb2700 1 --2- 172.21.15.89:0/3779327725 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f30b406f660 0x7f30b413e420 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.252+0000 7f30bbeb2700 1 --2- 172.21.15.89:0/3779327725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30b40bd570 0x7f30b40b82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.252+0000 7f30bbeb2700 1 -- 172.21.15.89:0/3779327725 >> 172.21.15.89:0/3779327725 conn(0x7f30b406b320 msgr2=0x7f30b406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:45.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.252+0000 7f30bbeb2700 1 -- 172.21.15.89:0/3779327725 shutdown_connections 2023-10-25T23:35:45.255 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.252+0000 7f30bbeb2700 1 -- 172.21.15.89:0/3779327725 wait complete. 2023-10-25T23:35:45.264 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new c636a4a2-c1e8-4306-a78b-fe37eebab526 3 2023-10-25T23:35:45.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.387+0000 7f0575566700 1 -- 172.21.15.89:0/219335848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0570071190 msgr2=0x7f057006b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:45.389 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.387+0000 7f0575566700 1 --2- 172.21.15.89:0/219335848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0570071190 0x7f057006b220 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f057006d810 tx=0x7f0564009ba0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.388+0000 7f0575566700 1 -- 172.21.15.89:0/219335848 shutdown_connections 2023-10-25T23:35:45.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.388+0000 7f0575566700 1 --2- 172.21.15.89:0/219335848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f057006b760 0x7f057014e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.388+0000 7f0575566700 1 --2- 172.21.15.89:0/219335848 >> v2:172.21.15.81:3300/0 conn(0x7f0570144e80 0x7f0570072240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.388+0000 7f0575566700 1 --2- 172.21.15.89:0/219335848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0570071190 0x7f057006b220 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.390 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.388+0000 7f0575566700 1 -- 172.21.15.89:0/219335848 >> 172.21.15.89:0/219335848 conn(0x7f057006d9b0 msgr2=0x7f057006ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:45.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.388+0000 7f0575566700 1 -- 172.21.15.89:0/219335848 shutdown_connections 2023-10-25T23:35:45.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.388+0000 7f0575566700 1 -- 172.21.15.89:0/219335848 wait complete. 2023-10-25T23:35:45.391 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.390+0000 7f0575566700 1 Processor -- start 2023-10-25T23:35:45.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.390+0000 7f0575566700 1 -- start start 2023-10-25T23:35:45.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.391+0000 7f0575566700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057006b760 0x7f0570143580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:45.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.391+0000 7f0575566700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0570071190 0x7f05700b90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:45.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.391+0000 7f0575566700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0570144e80 0x7f05701eb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:45.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.391+0000 7f0575566700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0570143ee0 con 0x7f057006b760 2023-10-25T23:35:45.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.391+0000 7f0575566700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05700b7420 con 0x7f0570071190 2023-10-25T23:35:45.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.391+0000 7f0575566700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0570143ac0 con 0x7f0570144e80 2023-10-25T23:35:45.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.391+0000 7f056effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057006b760 0x7f0570143580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:45.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.391+0000 7f056effd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057006b760 0x7f0570143580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.89:53492/0 (socket says 172.21.15.89:53492) 2023-10-25T23:35:45.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.391+0000 7f056effd700 1 -- 172.21.15.89:0/3785758138 learned_addr learned my addr 172.21.15.89:0/3785758138 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-25T23:35:45.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.391+0000 7f056e7fc700 1 --2- 172.21.15.89:0/3785758138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0570071190 0x7f05700b90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:45.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.391+0000 7f056f7fe700 1 --2- 172.21.15.89:0/3785758138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0570144e80 0x7f05701eb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:45.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.391+0000 7f056effd700 1 -- 172.21.15.89:0/3785758138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0570144e80 msgr2=0x7f05701eb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:45.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.391+0000 7f056effd700 1 --2- 172.21.15.89:0/3785758138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0570144e80 0x7f05701eb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.391+0000 7f056effd700 1 -- 172.21.15.89:0/3785758138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0570071190 msgr2=0x7f05700b90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:45.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.391+0000 7f056effd700 1 --2- 172.21.15.89:0/3785758138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0570071190 0x7f05700b90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.395 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.391+0000 7f056effd700 1 -- 172.21.15.89:0/3785758138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0560009520 con 0x7f057006b760 2023-10-25T23:35:45.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.391+0000 7f056effd700 1 --2- 172.21.15.89:0/3785758138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057006b760 0x7f0570143580 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f056000e9f0 tx=0x7f056000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:45.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.392+0000 7f05577fe700 1 -- 172.21.15.89:0/3785758138 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056000cbd0 con 0x7f057006b760 2023-10-25T23:35:45.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.392+0000 7f05577fe700 1 -- 172.21.15.89:0/3785758138 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f056000cd30 con 0x7f057006b760 2023-10-25T23:35:45.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.392+0000 7f0575566700 1 -- 172.21.15.89:0/3785758138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0564009520 con 0x7f057006b760 2023-10-25T23:35:45.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.392+0000 7f05577fe700 1 -- 172.21.15.89:0/3785758138 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056000cee0 con 0x7f057006b760 2023-10-25T23:35:45.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.392+0000 7f0575566700 1 -- 172.21.15.89:0/3785758138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05700b79a0 con 0x7f057006b760 2023-10-25T23:35:45.397 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.393+0000 7f05577fe700 1 -- 172.21.15.89:0/3785758138 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0560004280 con 0x7f057006b760 2023-10-25T23:35:45.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.393+0000 7f05577fe700 1 -- 172.21.15.89:0/3785758138 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f0560014070 con 0x7f057006b760 2023-10-25T23:35:45.398 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.393+0000 7f0575566700 1 -- 172.21.15.89:0/3785758138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0570067490 con 0x7f057006b760 2023-10-25T23:35:45.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.396+0000 7f05577fe700 1 -- 172.21.15.89:0/3785758138 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0560003680 con 0x7f057006b760 2023-10-25T23:35:45.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.506+0000 7f0575566700 1 -- 172.21.15.89:0/3785758138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c636a4a2-c1e8-4306-a78b-fe37eebab526", "id": 3} v 0) v1 -- 0x7f057004e4c0 con 0x7f057006b760 2023-10-25T23:35:45.511 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.510+0000 7f05577fe700 1 -- 172.21.15.89:0/3785758138 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c636a4a2-c1e8-4306-a78b-fe37eebab526", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f05600038c0 con 0x7f057006b760 2023-10-25T23:35:45.511 INFO:teuthology.orchestra.run.smithi089.stdout:3 2023-10-25T23:35:45.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.511+0000 7f0575566700 1 -- 172.21.15.89:0/3785758138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057006b760 msgr2=0x7f0570143580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:45.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.511+0000 7f0575566700 1 --2- 172.21.15.89:0/3785758138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057006b760 0x7f0570143580 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f056000e9f0 tx=0x7f056000ed00 comp rx=0 tx=0).stop 2023-10-25T23:35:45.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.511+0000 7f0575566700 1 -- 172.21.15.89:0/3785758138 shutdown_connections 2023-10-25T23:35:45.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.511+0000 7f0575566700 1 --2- 172.21.15.89:0/3785758138 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0570144e80 0x7f05701eb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.511+0000 7f0575566700 1 --2- 172.21.15.89:0/3785758138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057006b760 0x7f0570143580 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.511+0000 7f0575566700 1 --2- 172.21.15.89:0/3785758138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0570071190 0x7f05700b90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.511+0000 7f0575566700 1 -- 172.21.15.89:0/3785758138 >> 172.21.15.89:0/3785758138 conn(0x7f057006d9b0 msgr2=0x7f05701490f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:45.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.511+0000 7f0575566700 1 -- 172.21.15.89:0/3785758138 shutdown_connections 2023-10-25T23:35:45.514 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.511+0000 7f0575566700 1 -- 172.21.15.89:0/3785758138 wait complete. 2023-10-25T23:35:45.524 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 3cafc826-e531-4aa7-8b2a-b592f318f138 4 2023-10-25T23:35:45.650 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.649+0000 7f102305a700 1 -- 172.21.15.89:0/1631136393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f101c151c50 msgr2=0x7f101c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:45.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.649+0000 7f102305a700 1 --2- 172.21.15.89:0/1631136393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f101c151c50 0x7f101c06b760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1010009840 tx=0x7f1010009b50 comp rx=0 tx=0).stop 2023-10-25T23:35:45.651 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.649+0000 7f102305a700 1 -- 172.21.15.89:0/1631136393 shutdown_connections 2023-10-25T23:35:45.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.649+0000 7f102305a700 1 --2- 172.21.15.89:0/1631136393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f101c151c50 0x7f101c06b760 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.649+0000 7f102305a700 1 -- 172.21.15.89:0/1631136393 >> 172.21.15.89:0/1631136393 conn(0x7f101c0c3c10 msgr2=0x7f101c0c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:45.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.649+0000 7f102305a700 1 -- 172.21.15.89:0/1631136393 shutdown_connections 2023-10-25T23:35:45.652 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.649+0000 7f102305a700 1 -- 172.21.15.89:0/1631136393 wait complete. 2023-10-25T23:35:45.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.650+0000 7f102305a700 1 Processor -- start 2023-10-25T23:35:45.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.650+0000 7f102305a700 1 -- start start 2023-10-25T23:35:45.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.651+0000 7f102305a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f101c06bca0 0x7f101c0a8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:45.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.651+0000 7f102305a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f101c151c50 0x7f101c0baf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:45.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.651+0000 7f102305a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f101c156d00 0x7f101c149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:45.657 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.651+0000 7f102305a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c1e57e0 con 0x7f101c156d00 2023-10-25T23:35:45.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.651+0000 7f102305a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c0baa30 con 0x7f101c151c50 2023-10-25T23:35:45.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.651+0000 7f102305a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101c0a9190 con 0x7f101c06bca0 2023-10-25T23:35:45.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.651+0000 7f1020df6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f101c06bca0 0x7f101c0a8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:45.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.651+0000 7f101bfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f101c151c50 0x7f101c0baf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:45.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.651+0000 7f1020df6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f101c06bca0 0x7f101c0a8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:55116/0 (socket says 172.21.15.89:55116) 2023-10-25T23:35:45.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.651+0000 7f1020df6700 1 -- 172.21.15.89:0/2669703163 learned_addr learned my addr 172.21.15.89:0/2669703163 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-25T23:35:45.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.651+0000 7f10215f7700 1 --2- 172.21.15.89:0/2669703163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f101c156d00 0x7f101c149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:45.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.651+0000 7f101bfff700 1 -- 172.21.15.89:0/2669703163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f101c06bca0 msgr2=0x7f101c0a8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:45.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.651+0000 7f101bfff700 1 --2- 172.21.15.89:0/2669703163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f101c06bca0 0x7f101c0a8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.651+0000 7f101bfff700 1 -- 172.21.15.89:0/2669703163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f101c156d00 msgr2=0x7f101c149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:45.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.651+0000 7f101bfff700 1 --2- 172.21.15.89:0/2669703163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f101c156d00 0x7f101c149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.660 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.651+0000 7f101bfff700 1 -- 172.21.15.89:0/2669703163 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1010009520 con 0x7f101c151c50 2023-10-25T23:35:45.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.651+0000 7f1020df6700 1 --2- 172.21.15.89:0/2669703163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f101c06bca0 0x7f101c0a8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-25T23:35:45.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.652+0000 7f101bfff700 1 --2- 172.21.15.89:0/2669703163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f101c151c50 0x7f101c0baf10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f100800c470 tx=0x7f1008001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:45.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.652+0000 7f10197fa700 1 -- 172.21.15.89:0/2669703163 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10080052d0 con 0x7f101c151c50 2023-10-25T23:35:45.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.652+0000 7f10197fa700 1 -- 172.21.15.89:0/2669703163 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1008005520 con 0x7f101c151c50 2023-10-25T23:35:45.661 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.652+0000 7f102305a700 1 -- 172.21.15.89:0/2669703163 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101c1e4a20 con 0x7f101c151c50 2023-10-25T23:35:45.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.652+0000 7f10197fa700 1 -- 172.21.15.89:0/2669703163 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008006ac0 con 0x7f101c151c50 2023-10-25T23:35:45.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.652+0000 7f102305a700 1 -- 172.21.15.89:0/2669703163 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101c1e4fe0 con 0x7f101c151c50 2023-10-25T23:35:45.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.652+0000 7f10197fa700 1 -- 172.21.15.89:0/2669703163 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1008003980 con 0x7f101c151c50 2023-10-25T23:35:45.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.652+0000 7f10197fa700 1 -- 172.21.15.89:0/2669703163 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f100801b3f0 con 0x7f101c151c50 2023-10-25T23:35:45.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.653+0000 7f102305a700 1 -- 172.21.15.89:0/2669703163 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101c0beac0 con 0x7f101c151c50 2023-10-25T23:35:45.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.655+0000 7f10197fa700 1 -- 172.21.15.89:0/2669703163 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f1008020060 con 0x7f101c151c50 2023-10-25T23:35:45.663 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:45.658+0000 7f7cc3dc9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-25T23:35:45.664 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:45.662+0000 7f38f4890200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-25T23:35:45.730 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:45.729+0000 7f7cc3dc9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-25T23:35:45.733 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:45.732+0000 7f38f4890200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-25T23:35:45.739 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.738+0000 7f102305a700 1 -- 172.21.15.89:0/2669703163 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3cafc826-e531-4aa7-8b2a-b592f318f138", "id": 4} v 0) v1 -- 0x7f101c0a34a0 con 0x7f101c151c50 2023-10-25T23:35:45.745 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.744+0000 7f10197fa700 1 -- 172.21.15.89:0/2669703163 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3cafc826-e531-4aa7-8b2a-b592f318f138", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1008003dc0 con 0x7f101c151c50 2023-10-25T23:35:45.745 INFO:teuthology.orchestra.run.smithi089.stdout:4 2023-10-25T23:35:45.746 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.745+0000 7f102305a700 1 -- 172.21.15.89:0/2669703163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f101c151c50 msgr2=0x7f101c0baf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:45.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.745+0000 7f102305a700 1 --2- 172.21.15.89:0/2669703163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f101c151c50 0x7f101c0baf10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f100800c470 tx=0x7f1008001e70 comp rx=0 tx=0).stop 2023-10-25T23:35:45.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.745+0000 7f102305a700 1 -- 172.21.15.89:0/2669703163 shutdown_connections 2023-10-25T23:35:45.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.745+0000 7f102305a700 1 --2- 172.21.15.89:0/2669703163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f101c156d00 0x7f101c149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.745+0000 7f102305a700 1 --2- 172.21.15.89:0/2669703163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f101c06bca0 0x7f101c0a8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.747 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.745+0000 7f102305a700 1 --2- 172.21.15.89:0/2669703163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f101c151c50 0x7f101c0baf10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.745+0000 7f102305a700 1 -- 172.21.15.89:0/2669703163 >> 172.21.15.89:0/2669703163 conn(0x7f101c0c3c10 msgr2=0x7f101c14f310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:45.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.745+0000 7f102305a700 1 -- 172.21.15.89:0/2669703163 shutdown_connections 2023-10-25T23:35:45.748 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.745+0000 7f102305a700 1 -- 172.21.15.89:0/2669703163 wait complete. 2023-10-25T23:35:45.757 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 6098deb2-258e-47e1-b283-9a24c9dddf27 5 2023-10-25T23:35:45.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.879+0000 7fd04fe81700 1 -- 172.21.15.89:0/3549751955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0480bd570 msgr2=0x7fd0480bd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:45.881 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.879+0000 7fd04fe81700 1 --2- 172.21.15.89:0/3549751955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0480bd570 0x7fd0480bd950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd0440098f0 tx=0x7fd044009c00 comp rx=0 tx=0).stop 2023-10-25T23:35:45.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.879+0000 7fd04fe81700 1 -- 172.21.15.89:0/3549751955 shutdown_connections 2023-10-25T23:35:45.882 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.879+0000 7fd04fe81700 1 --2- 172.21.15.89:0/3549751955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0480bd570 0x7fd0480bd950 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.879+0000 7fd04fe81700 1 -- 172.21.15.89:0/3549751955 >> 172.21.15.89:0/3549751955 conn(0x7fd04806b320 msgr2=0x7fd04806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:45.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.879+0000 7fd04fe81700 1 -- 172.21.15.89:0/3549751955 shutdown_connections 2023-10-25T23:35:45.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.879+0000 7fd04fe81700 1 -- 172.21.15.89:0/3549751955 wait complete. 2023-10-25T23:35:45.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.880+0000 7fd04fe81700 1 Processor -- start 2023-10-25T23:35:45.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.880+0000 7fd04fe81700 1 -- start start 2023-10-25T23:35:45.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.881+0000 7fd04fe81700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd04806f660 0x7fd0481e62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:45.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.881+0000 7fd04fe81700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0480bd570 0x7fd0480c0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:45.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.881+0000 7fd04fe81700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd048145de0 0x7fd0480c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:45.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.881+0000 7fd04fe81700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480bc5d0 con 0x7fd048145de0 2023-10-25T23:35:45.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.881+0000 7fd04fe81700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0481e7040 con 0x7fd0480bd570 2023-10-25T23:35:45.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.881+0000 7fd04fe81700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480bee90 con 0x7fd04806f660 2023-10-25T23:35:45.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.881+0000 7fd04d41c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0480bd570 0x7fd0480c0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:45.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.881+0000 7fd04dc1d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd04806f660 0x7fd0481e62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:45.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.881+0000 7fd04d41c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0480bd570 0x7fd0480c0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48188/0 (socket says 172.21.15.89:48188) 2023-10-25T23:35:45.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.881+0000 7fd04d41c700 1 -- 172.21.15.89:0/2917497295 learned_addr learned my addr 172.21.15.89:0/2917497295 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-25T23:35:45.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.881+0000 7fd04e41e700 1 --2- 172.21.15.89:0/2917497295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd048145de0 0x7fd0480c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:45.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.881+0000 7fd04dc1d700 1 -- 172.21.15.89:0/2917497295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0480bd570 msgr2=0x7fd0480c0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:45.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.881+0000 7fd04dc1d700 1 --2- 172.21.15.89:0/2917497295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0480bd570 0x7fd0480c0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.881+0000 7fd04dc1d700 1 -- 172.21.15.89:0/2917497295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd048145de0 msgr2=0x7fd0480c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:45.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.881+0000 7fd04dc1d700 1 --2- 172.21.15.89:0/2917497295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd048145de0 0x7fd0480c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.881+0000 7fd04dc1d700 1 -- 172.21.15.89:0/2917497295 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd044009520 con 0x7fd04806f660 2023-10-25T23:35:45.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.882+0000 7fd04dc1d700 1 --2- 172.21.15.89:0/2917497295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd04806f660 0x7fd0481e62d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd044016000 tx=0x7fd04400f710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:45.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.882+0000 7fd03e7fc700 1 -- 172.21.15.89:0/2917497295 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04400fbd0 con 0x7fd04806f660 2023-10-25T23:35:45.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.882+0000 7fd03e7fc700 1 -- 172.21.15.89:0/2917497295 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd04400fe40 con 0x7fd04806f660 2023-10-25T23:35:45.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.882+0000 7fd04fe81700 1 -- 172.21.15.89:0/2917497295 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0481e6810 con 0x7fd04806f660 2023-10-25T23:35:45.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.882+0000 7fd03e7fc700 1 -- 172.21.15.89:0/2917497295 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044004a90 con 0x7fd04806f660 2023-10-25T23:35:45.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.882+0000 7fd04fe81700 1 -- 172.21.15.89:0/2917497295 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0481e6d60 con 0x7fd04806f660 2023-10-25T23:35:45.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.882+0000 7fd03e7fc700 1 -- 172.21.15.89:0/2917497295 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd04402a450 con 0x7fd04806f660 2023-10-25T23:35:45.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.882+0000 7fd03e7fc700 1 -- 172.21.15.89:0/2917497295 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fd044021990 con 0x7fd04806f660 2023-10-25T23:35:45.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.883+0000 7fd04fe81700 1 -- 172.21.15.89:0/2917497295 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0480ba780 con 0x7fd04806f660 2023-10-25T23:35:45.893 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.885+0000 7fd03e7fc700 1 -- 172.21.15.89:0/2917497295 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fd044021410 con 0x7fd04806f660 2023-10-25T23:35:45.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.968+0000 7fd04fe81700 1 -- 172.21.15.89:0/2917497295 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6098deb2-258e-47e1-b283-9a24c9dddf27", "id": 5} v 0) v1 -- 0x7fd04804e4c0 con 0x7fd04806f660 2023-10-25T23:35:45.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.974+0000 7fd03e7fc700 1 -- 172.21.15.89:0/2917497295 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6098deb2-258e-47e1-b283-9a24c9dddf27", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd044021680 con 0x7fd04806f660 2023-10-25T23:35:45.976 INFO:teuthology.orchestra.run.smithi089.stdout:5 2023-10-25T23:35:45.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.974+0000 7fd04fe81700 1 -- 172.21.15.89:0/2917497295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd04806f660 msgr2=0x7fd0481e62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:45.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.974+0000 7fd04fe81700 1 --2- 172.21.15.89:0/2917497295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd04806f660 0x7fd0481e62d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd044016000 tx=0x7fd04400f710 comp rx=0 tx=0).stop 2023-10-25T23:35:45.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.975+0000 7fd04fe81700 1 -- 172.21.15.89:0/2917497295 shutdown_connections 2023-10-25T23:35:45.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.975+0000 7fd04fe81700 1 --2- 172.21.15.89:0/2917497295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd048145de0 0x7fd0480c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.975+0000 7fd04fe81700 1 --2- 172.21.15.89:0/2917497295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd04806f660 0x7fd0481e62d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.975+0000 7fd04fe81700 1 --2- 172.21.15.89:0/2917497295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0480bd570 0x7fd0480c0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:45.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.975+0000 7fd04fe81700 1 -- 172.21.15.89:0/2917497295 >> 172.21.15.89:0/2917497295 conn(0x7fd04806b320 msgr2=0x7fd0481452f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:45.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.975+0000 7fd04fe81700 1 -- 172.21.15.89:0/2917497295 shutdown_connections 2023-10-25T23:35:45.979 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:45.975+0000 7fd04fe81700 1 -- 172.21.15.89:0/2917497295 wait complete. 2023-10-25T23:35:45.987 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new d79f68de-3c19-4f68-bbd1-59c8484dfaa2 6 2023-10-25T23:35:46.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.109+0000 7eff43b5d700 1 -- 172.21.15.89:0/809101584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c06b780 msgr2=0x7eff3c072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:46.116 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.109+0000 7eff43b5d700 1 --2- 172.21.15.89:0/809101584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c06b780 0x7eff3c072de0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7eff3c0729a0 tx=0x7eff2c009c70 comp rx=0 tx=0).stop 2023-10-25T23:35:46.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.109+0000 7eff43b5d700 1 -- 172.21.15.89:0/809101584 shutdown_connections 2023-10-25T23:35:46.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.109+0000 7eff43b5d700 1 --2- 172.21.15.89:0/809101584 >> v2:172.21.15.81:3300/0 conn(0x7eff3c146300 0x7eff3c06e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.117 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.109+0000 7eff43b5d700 1 --2- 172.21.15.89:0/809101584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c06b780 0x7eff3c072de0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.109+0000 7eff43b5d700 1 -- 172.21.15.89:0/809101584 >> 172.21.15.89:0/809101584 conn(0x7eff3c06d9b0 msgr2=0x7eff3c06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:46.118 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.109+0000 7eff43b5d700 1 -- 172.21.15.89:0/809101584 shutdown_connections 2023-10-25T23:35:46.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.109+0000 7eff43b5d700 1 -- 172.21.15.89:0/809101584 wait complete. 2023-10-25T23:35:46.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.110+0000 7eff43b5d700 1 Processor -- start 2023-10-25T23:35:46.119 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.110+0000 7eff43b5d700 1 -- start start 2023-10-25T23:35:46.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.111+0000 7eff43b5d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c06b780 0x7eff3c070af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:46.120 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.111+0000 7eff43b5d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3c073320 0x7eff3c149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:46.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.111+0000 7eff43b5d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff3c146300 0x7eff3c0b9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:46.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.111+0000 7eff43b5d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c1e5420 con 0x7eff3c073320 2023-10-25T23:35:46.121 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.111+0000 7eff43b5d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c1e5700 con 0x7eff3c06b780 2023-10-25T23:35:46.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.111+0000 7eff43b5d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c146de0 con 0x7eff3c146300 2023-10-25T23:35:46.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.111+0000 7eff410f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3c073320 0x7eff3c149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:46.122 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.111+0000 7eff420fa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff3c146300 0x7eff3c0b9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:46.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.111+0000 7eff410f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3c073320 0x7eff3c149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.89:53530/0 (socket says 172.21.15.89:53530) 2023-10-25T23:35:46.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.111+0000 7eff410f8700 1 -- 172.21.15.89:0/3769205749 learned_addr learned my addr 172.21.15.89:0/3769205749 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-25T23:35:46.123 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.111+0000 7eff418f9700 1 --2- 172.21.15.89:0/3769205749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c06b780 0x7eff3c070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:46.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.112+0000 7eff410f8700 1 -- 172.21.15.89:0/3769205749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff3c146300 msgr2=0x7eff3c0b9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:46.124 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.112+0000 7eff410f8700 1 --2- 172.21.15.89:0/3769205749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff3c146300 0x7eff3c0b9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.112+0000 7eff410f8700 1 -- 172.21.15.89:0/3769205749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c06b780 msgr2=0x7eff3c070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:46.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.112+0000 7eff410f8700 1 --2- 172.21.15.89:0/3769205749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c06b780 0x7eff3c070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.125 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.112+0000 7eff410f8700 1 -- 172.21.15.89:0/3769205749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c0095f0 con 0x7eff3c073320 2023-10-25T23:35:46.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.112+0000 7eff420fa700 1 --2- 172.21.15.89:0/3769205749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff3c146300 0x7eff3c0b9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-25T23:35:46.126 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.112+0000 7eff410f8700 1 --2- 172.21.15.89:0/3769205749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3c073320 0x7eff3c149320 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff2c005fd0 tx=0x7eff2c004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:46.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.112+0000 7eff327fc700 1 -- 172.21.15.89:0/3769205749 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c01c070 con 0x7eff3c073320 2023-10-25T23:35:46.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.112+0000 7eff327fc700 1 -- 172.21.15.89:0/3769205749 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7eff2c004830 con 0x7eff3c073320 2023-10-25T23:35:46.127 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.112+0000 7eff43b5d700 1 -- 172.21.15.89:0/3769205749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c1470c0 con 0x7eff3c073320 2023-10-25T23:35:46.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.112+0000 7eff327fc700 1 -- 172.21.15.89:0/3769205749 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2c0045f0 con 0x7eff3c073320 2023-10-25T23:35:46.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.112+0000 7eff43b5d700 1 -- 172.21.15.89:0/3769205749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c14ea40 con 0x7eff3c073320 2023-10-25T23:35:46.128 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.112+0000 7eff327fc700 1 -- 172.21.15.89:0/3769205749 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7eff2c00b7b0 con 0x7eff3c073320 2023-10-25T23:35:46.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.112+0000 7eff327fc700 1 -- 172.21.15.89:0/3769205749 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7eff2c00fcd0 con 0x7eff3c073320 2023-10-25T23:35:46.129 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.113+0000 7eff43b5d700 1 -- 172.21.15.89:0/3769205749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c067490 con 0x7eff3c073320 2023-10-25T23:35:46.130 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.115+0000 7eff327fc700 1 -- 172.21.15.89:0/3769205749 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7eff2c02e060 con 0x7eff3c073320 2023-10-25T23:35:46.199 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.198+0000 7eff43b5d700 1 -- 172.21.15.89:0/3769205749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d79f68de-3c19-4f68-bbd1-59c8484dfaa2", "id": 6} v 0) v1 -- 0x7eff3c1475e0 con 0x7eff3c073320 2023-10-25T23:35:46.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.202+0000 7eff327fc700 1 -- 172.21.15.89:0/3769205749 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d79f68de-3c19-4f68-bbd1-59c8484dfaa2", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7eff3c1475e0 con 0x7eff3c073320 2023-10-25T23:35:46.203 INFO:teuthology.orchestra.run.smithi089.stdout:6 2023-10-25T23:35:46.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.202+0000 7eff43b5d700 1 -- 172.21.15.89:0/3769205749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3c073320 msgr2=0x7eff3c149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:46.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.202+0000 7eff43b5d700 1 --2- 172.21.15.89:0/3769205749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3c073320 0x7eff3c149320 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff2c005fd0 tx=0x7eff2c004260 comp rx=0 tx=0).stop 2023-10-25T23:35:46.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.203+0000 7eff43b5d700 1 -- 172.21.15.89:0/3769205749 shutdown_connections 2023-10-25T23:35:46.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.203+0000 7eff43b5d700 1 --2- 172.21.15.89:0/3769205749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff3c146300 0x7eff3c0b9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.203+0000 7eff43b5d700 1 --2- 172.21.15.89:0/3769205749 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff3c06b780 0x7eff3c070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.203+0000 7eff43b5d700 1 --2- 172.21.15.89:0/3769205749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff3c073320 0x7eff3c149320 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.203+0000 7eff43b5d700 1 -- 172.21.15.89:0/3769205749 >> 172.21.15.89:0/3769205749 conn(0x7eff3c06d9b0 msgr2=0x7eff3c0be9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:46.205 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.203+0000 7eff43b5d700 1 -- 172.21.15.89:0/3769205749 shutdown_connections 2023-10-25T23:35:46.206 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.203+0000 7eff43b5d700 1 -- 172.21.15.89:0/3769205749 wait complete. 2023-10-25T23:35:46.217 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new f1f7002e-4de9-4a08-97a1-fb52a116687f 7 2023-10-25T23:35:46.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.343+0000 7f3e7b677700 1 -- 172.21.15.89:0/4157846938 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e74144f60 msgr2=0x7f3e7414b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:46.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.343+0000 7f3e7b677700 1 --2- 172.21.15.89:0/4157846938 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e74144f60 0x7f3e7414b990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3e740bb1f0 tx=0x7f3e70009c70 comp rx=0 tx=0).stop 2023-10-25T23:35:46.345 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.343+0000 7f3e7b677700 1 -- 172.21.15.89:0/4157846938 shutdown_connections 2023-10-25T23:35:46.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.343+0000 7f3e7b677700 1 --2- 172.21.15.89:0/4157846938 >> v2:172.21.15.81:3300/0 conn(0x7f3e741538f0 0x7f3e74155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.343+0000 7f3e7b677700 1 --2- 172.21.15.89:0/4157846938 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e74144f60 0x7f3e7414b990 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.343+0000 7f3e7b677700 1 -- 172.21.15.89:0/4157846938 >> 172.21.15.89:0/4157846938 conn(0x7f3e7406b320 msgr2=0x7f3e7406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:46.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.343+0000 7f3e7b677700 1 -- 172.21.15.89:0/4157846938 shutdown_connections 2023-10-25T23:35:46.346 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.343+0000 7f3e7b677700 1 -- 172.21.15.89:0/4157846938 wait complete. 2023-10-25T23:35:46.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.345+0000 7f3e7b677700 1 Processor -- start 2023-10-25T23:35:46.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.345+0000 7f3e7b677700 1 -- start start 2023-10-25T23:35:46.349 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.346+0000 7f3e7b677700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e740bb530 0x7f3e741e30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:46.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.346+0000 7f3e7b677700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e74144f60 0x7f3e741e6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:46.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.346+0000 7f3e7b677700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e741538f0 0x7f3e740ba140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:46.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.346+0000 7f3e7b677700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7413d8b0 con 0x7f3e741538f0 2023-10-25T23:35:46.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.346+0000 7f3e7b677700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e741e3600 con 0x7f3e74144f60 2023-10-25T23:35:46.350 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.346+0000 7f3e7b677700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e74142e60 con 0x7f3e740bb530 2023-10-25T23:35:46.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.346+0000 7f3e78c12700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e74144f60 0x7f3e741e6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:46.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.346+0000 7f3e78c12700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e74144f60 0x7f3e741e6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48212/0 (socket says 172.21.15.89:48212) 2023-10-25T23:35:46.351 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.346+0000 7f3e78c12700 1 -- 172.21.15.89:0/2057947273 learned_addr learned my addr 172.21.15.89:0/2057947273 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-25T23:35:46.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.346+0000 7f3e79413700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e740bb530 0x7f3e741e30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:46.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.347+0000 7f3e79c14700 1 --2- 172.21.15.89:0/2057947273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e741538f0 0x7f3e740ba140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:46.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.347+0000 7f3e78c12700 1 -- 172.21.15.89:0/2057947273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e740bb530 msgr2=0x7f3e741e30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:46.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.347+0000 7f3e78c12700 1 --2- 172.21.15.89:0/2057947273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e740bb530 0x7f3e741e30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.352 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.347+0000 7f3e78c12700 1 -- 172.21.15.89:0/2057947273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e741538f0 msgr2=0x7f3e740ba140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:46.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.347+0000 7f3e78c12700 1 --2- 172.21.15.89:0/2057947273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e741538f0 0x7f3e740ba140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.347+0000 7f3e78c12700 1 -- 172.21.15.89:0/2057947273 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e700095f0 con 0x7f3e74144f60 2023-10-25T23:35:46.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.347+0000 7f3e78c12700 1 --2- 172.21.15.89:0/2057947273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e74144f60 0x7f3e741e6560 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400c420 tx=0x7f3e6400c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:46.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.347+0000 7f3e69ffb700 1 -- 172.21.15.89:0/2057947273 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e640052d0 con 0x7f3e74144f60 2023-10-25T23:35:46.353 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.347+0000 7f3e69ffb700 1 -- 172.21.15.89:0/2057947273 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3e64005520 con 0x7f3e74144f60 2023-10-25T23:35:46.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.347+0000 7f3e69ffb700 1 -- 172.21.15.89:0/2057947273 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e640038e0 con 0x7f3e74144f60 2023-10-25T23:35:46.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.347+0000 7f3e7b677700 1 -- 172.21.15.89:0/2057947273 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e741e60d0 con 0x7f3e74144f60 2023-10-25T23:35:46.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.347+0000 7f3e69ffb700 1 -- 172.21.15.89:0/2057947273 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3e64003d40 con 0x7f3e74144f60 2023-10-25T23:35:46.355 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.347+0000 7f3e7b677700 1 -- 172.21.15.89:0/2057947273 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7413d5d0 con 0x7f3e74144f60 2023-10-25T23:35:46.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.347+0000 7f3e69ffb700 1 -- 172.21.15.89:0/2057947273 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f3e64012420 con 0x7f3e74144f60 2023-10-25T23:35:46.356 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.348+0000 7f3e7b677700 1 -- 172.21.15.89:0/2057947273 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e7406dcc0 con 0x7f3e74144f60 2023-10-25T23:35:46.357 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.351+0000 7f3e69ffb700 1 -- 172.21.15.89:0/2057947273 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3e64017070 con 0x7f3e74144f60 2023-10-25T23:35:46.425 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:46.423+0000 7f38f4890200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-25T23:35:46.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.442+0000 7f3e7b677700 1 -- 172.21.15.89:0/2057947273 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f1f7002e-4de9-4a08-97a1-fb52a116687f", "id": 7} v 0) v1 -- 0x7f3e7404e4c0 con 0x7f3e74144f60 2023-10-25T23:35:46.446 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.445+0000 7f3e69ffb700 1 -- 172.21.15.89:0/2057947273 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f1f7002e-4de9-4a08-97a1-fb52a116687f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3e64011e50 con 0x7f3e74144f60 2023-10-25T23:35:46.446 INFO:teuthology.orchestra.run.smithi089.stdout:7 2023-10-25T23:35:46.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.446+0000 7f3e7b677700 1 -- 172.21.15.89:0/2057947273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e74144f60 msgr2=0x7f3e741e6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:46.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.446+0000 7f3e7b677700 1 --2- 172.21.15.89:0/2057947273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e74144f60 0x7f3e741e6560 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400c420 tx=0x7f3e6400c730 comp rx=0 tx=0).stop 2023-10-25T23:35:46.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.446+0000 7f3e7b677700 1 -- 172.21.15.89:0/2057947273 shutdown_connections 2023-10-25T23:35:46.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.446+0000 7f3e7b677700 1 --2- 172.21.15.89:0/2057947273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e741538f0 0x7f3e740ba140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.446+0000 7f3e7b677700 1 --2- 172.21.15.89:0/2057947273 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e740bb530 0x7f3e741e30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.446+0000 7f3e7b677700 1 --2- 172.21.15.89:0/2057947273 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e74144f60 0x7f3e741e6560 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.446+0000 7f3e7b677700 1 -- 172.21.15.89:0/2057947273 >> 172.21.15.89:0/2057947273 conn(0x7f3e7406b320 msgr2=0x7f3e740bd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:46.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.446+0000 7f3e7b677700 1 -- 172.21.15.89:0/2057947273 shutdown_connections 2023-10-25T23:35:46.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-25T23:35:46.446+0000 7f3e7b677700 1 -- 172.21.15.89:0/2057947273 wait complete. 2023-10-25T23:35:46.459 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-25T23:35:46.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-25T23:35:46.461 INFO:tasks.ceph.osd.0:Started 2023-10-25T23:35:46.462 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-25T23:35:46.462 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-25T23:35:46.463 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:46.461+0000 7f7cc3dc9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-25T23:35:46.466 INFO:tasks.ceph.osd.1:Started 2023-10-25T23:35:46.466 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-25T23:35:46.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-25T23:35:46.469 INFO:tasks.ceph.osd.2:Started 2023-10-25T23:35:46.469 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-25T23:35:46.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-25T23:35:46.472 INFO:tasks.ceph.osd.3:Started 2023-10-25T23:35:46.472 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-25T23:35:46.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-25T23:35:46.474 INFO:tasks.ceph.osd.4:Started 2023-10-25T23:35:46.475 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-25T23:35:46.475 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-25T23:35:46.477 INFO:tasks.ceph.osd.5:Started 2023-10-25T23:35:46.477 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-25T23:35:46.478 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-25T23:35:46.480 INFO:tasks.ceph.osd.6:Started 2023-10-25T23:35:46.480 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-25T23:35:46.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-25T23:35:46.483 INFO:tasks.ceph.osd.7:Started 2023-10-25T23:35:46.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T23:35:46.517 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:46.515+0000 7f38f4890200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-25T23:35:46.554 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:46.553+0000 7f7cc3dc9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-25T23:35:46.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.643+0000 7f6ac0c4b700 1 -- 172.21.15.81:0/1481923313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6abc0bce60 msgr2=0x7f6abc0bc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:46.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.643+0000 7f6ac0c4b700 1 --2- 172.21.15.81:0/1481923313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6abc0bce60 0x7f6abc0bc060 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0005fd0 tx=0x7f6ab0009c70 comp rx=0 tx=0).stop 2023-10-25T23:35:46.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.643+0000 7f6ac0c4b700 1 -- 172.21.15.81:0/1481923313 shutdown_connections 2023-10-25T23:35:46.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.643+0000 7f6ac0c4b700 1 --2- 172.21.15.81:0/1481923313 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6abc0bc5a0 0x7f6abc156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.643+0000 7f6ac0c4b700 1 --2- 172.21.15.81:0/1481923313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6abc0bce60 0x7f6abc0bc060 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.643+0000 7f6ac0c4b700 1 -- 172.21.15.81:0/1481923313 >> 172.21.15.81:0/1481923313 conn(0x7f6abc0c0a60 msgr2=0x7f6abc0c0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:46.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.643+0000 7f6ac0c4b700 1 -- 172.21.15.81:0/1481923313 shutdown_connections 2023-10-25T23:35:46.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.643+0000 7f6ac0c4b700 1 -- 172.21.15.81:0/1481923313 wait complete. 2023-10-25T23:35:46.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.644+0000 7f6ac0c4b700 1 Processor -- start 2023-10-25T23:35:46.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.644+0000 7f6ac0c4b700 1 -- start start 2023-10-25T23:35:46.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.645+0000 7f6ac0c4b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6abc0bc5a0 0x7f6abc132e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:46.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.645+0000 7f6ac0c4b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6abc0bce60 0x7f6abc1d81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:46.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.645+0000 7f6ac0c4b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6abc1357e0 0x7f6abc1d61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:46.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.645+0000 7f6ac0c4b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc1e6060 con 0x7f6abc0bc5a0 2023-10-25T23:35:46.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.645+0000 7f6ac0c4b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc1e6340 con 0x7f6abc1357e0 2023-10-25T23:35:46.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.645+0000 7f6ac0c4b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc1d76f0 con 0x7f6abc0bce60 2023-10-25T23:35:46.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.645+0000 7f6aba59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6abc0bc5a0 0x7f6abc132e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:46.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.645+0000 7f6aba59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6abc0bc5a0 0x7f6abc132e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35634/0 (socket says 172.21.15.81:35634) 2023-10-25T23:35:46.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.645+0000 7f6ab9d9b700 1 --2- 172.21.15.81:0/1882238129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6abc0bce60 0x7f6abc1d81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.645+0000 7f6aba59c700 1 -- 172.21.15.81:0/1882238129 learned_addr learned my addr 172.21.15.81:0/1882238129 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:35:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.645+0000 7f6abad9d700 1 --2- 172.21.15.81:0/1882238129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6abc1357e0 0x7f6abc1d61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.645+0000 7f6aba59c700 1 -- 172.21.15.81:0/1882238129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6abc0bce60 msgr2=0x7f6abc1d81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.645+0000 7f6aba59c700 1 --2- 172.21.15.81:0/1882238129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6abc0bce60 0x7f6abc1d81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.645+0000 7f6aba59c700 1 -- 172.21.15.81:0/1882238129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6abc1357e0 msgr2=0x7f6abc1d61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:46.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.645+0000 7f6aba59c700 1 --2- 172.21.15.81:0/1882238129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6abc1357e0 0x7f6abc1d61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.646+0000 7f6aba59c700 1 -- 172.21.15.81:0/1882238129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab00095f0 con 0x7f6abc0bc5a0 2023-10-25T23:35:46.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.646+0000 7f6ab9d9b700 1 --2- 172.21.15.81:0/1882238129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6abc0bce60 0x7f6abc1d81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-25T23:35:46.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.646+0000 7f6aba59c700 1 --2- 172.21.15.81:0/1882238129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6abc0bc5a0 0x7f6abc132e60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00c550 tx=0x7f6aac00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:46.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.646+0000 7f6aaaffd700 1 -- 172.21.15.81:0/1882238129 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac0054e0 con 0x7f6abc0bc5a0 2023-10-25T23:35:46.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.646+0000 7f6aaaffd700 1 -- 172.21.15.81:0/1882238129 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6aac003680 con 0x7f6abc0bc5a0 2023-10-25T23:35:46.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.646+0000 7f6ac0c4b700 1 -- 172.21.15.81:0/1882238129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6abc1d79d0 con 0x7f6abc0bc5a0 2023-10-25T23:35:46.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.646+0000 7f6aaaffd700 1 -- 172.21.15.81:0/1882238129 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac003a90 con 0x7f6abc0bc5a0 2023-10-25T23:35:46.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.646+0000 7f6ac0c4b700 1 -- 172.21.15.81:0/1882238129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6abc1d6730 con 0x7f6abc0bc5a0 2023-10-25T23:35:46.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.646+0000 7f6aaaffd700 1 -- 172.21.15.81:0/1882238129 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6aac01c440 con 0x7f6abc0bc5a0 2023-10-25T23:35:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.646+0000 7f6aaaffd700 1 -- 172.21.15.81:0/1882238129 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f6aac012ad0 con 0x7f6abc0bc5a0 2023-10-25T23:35:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.647+0000 7f6ac0c4b700 1 -- 172.21.15.81:0/1882238129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6abc1d7ef0 con 0x7f6abc0bc5a0 2023-10-25T23:35:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.649+0000 7f6aaaffd700 1 -- 172.21.15.81:0/1882238129 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f6aac017070 con 0x7f6abc0bc5a0 2023-10-25T23:35:46.682 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:46.680+0000 7f38f4890200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-25T23:35:46.704 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:46.702+0000 7f7cc3dc9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-25T23:35:46.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.717+0000 7f6ac0c4b700 1 -- 172.21.15.81:0/1882238129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6abc04e4c0 con 0x7f6abc0bc5a0 2023-10-25T23:35:46.720 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.718+0000 7f6aaaffd700 1 -- 172.21.15.81:0/1882238129 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f6aac01c920 con 0x7f6abc0bc5a0 2023-10-25T23:35:46.720 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:35:46.721 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":10,"fsid":"97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf","created":"2023-10-25T23:35:42.986840+0000","modified":"2023-10-25T23:35:46.443490+0000","last_up_change":"0.000000","last_in_change":"2023-10-25T23:35:46.443490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"48415836-8f22-4dcd-baa3-1d09c90c9a0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"19a4f6b5-e75c-45ae-aa08-b3467e69eed5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"60645312-54f5-4a74-ae52-68d17ff2d6e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c636a4a2-c1e8-4306-a78b-fe37eebab526","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3cafc826-e531-4aa7-8b2a-b592f318f138","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6098deb2-258e-47e1-b283-9a24c9dddf27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d79f68de-3c19-4f68-bbd1-59c8484dfaa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f1f7002e-4de9-4a08-97a1-fb52a116687f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T23:35:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.719+0000 7f6ac0c4b700 1 -- 172.21.15.81:0/1882238129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6abc0bc5a0 msgr2=0x7f6abc132e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.719+0000 7f6ac0c4b700 1 --2- 172.21.15.81:0/1882238129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6abc0bc5a0 0x7f6abc132e60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00c550 tx=0x7f6aac00c860 comp rx=0 tx=0).stop 2023-10-25T23:35:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.719+0000 7f6ac0c4b700 1 -- 172.21.15.81:0/1882238129 shutdown_connections 2023-10-25T23:35:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.719+0000 7f6ac0c4b700 1 --2- 172.21.15.81:0/1882238129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6abc1357e0 0x7f6abc1d61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.719+0000 7f6ac0c4b700 1 --2- 172.21.15.81:0/1882238129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6abc0bc5a0 0x7f6abc132e60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.719+0000 7f6ac0c4b700 1 --2- 172.21.15.81:0/1882238129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6abc0bce60 0x7f6abc1d81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.719+0000 7f6ac0c4b700 1 -- 172.21.15.81:0/1882238129 >> 172.21.15.81:0/1882238129 conn(0x7f6abc0c0a60 msgr2=0x7f6abc06a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.719+0000 7f6ac0c4b700 1 -- 172.21.15.81:0/1882238129 shutdown_connections 2023-10-25T23:35:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:35:46.719+0000 7f6ac0c4b700 1 -- 172.21.15.81:0/1882238129 wait complete. 2023-10-25T23:35:46.733 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-25T23:35:46.733 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-25T23:35:46.923 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:46.921+0000 7f38f4890200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-25T23:35:46.937 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:46.936+0000 7f7cc3dc9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-25T23:35:47.078 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-10-25T23:35:47.076+0000 7f759f219640 -1 Falling back to public interface 2023-10-25T23:35:47.083 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-10-25T23:35:47.082+0000 7f80af760640 -1 Falling back to public interface 2023-10-25T23:35:47.088 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-10-25T23:35:47.087+0000 7fde03535640 -1 Falling back to public interface 2023-10-25T23:35:47.090 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-10-25T23:35:47.088+0000 7f6592711640 -1 Falling back to public interface 2023-10-25T23:35:47.093 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-10-25T23:35:47.092+0000 7f3ab2896640 -1 Falling back to public interface 2023-10-25T23:35:47.100 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-10-25T23:35:47.099+0000 7fcdb07d1640 -1 Falling back to public interface 2023-10-25T23:35:47.104 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-10-25T23:35:47.103+0000 7fe49074e640 -1 Falling back to public interface 2023-10-25T23:35:47.111 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-10-25T23:35:47.110+0000 7f9eeee28640 -1 Falling back to public interface 2023-10-25T23:35:47.139 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:47.137+0000 7f38f4890200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-25T23:35:47.150 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:47.149+0000 7f7cc3dc9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-25T23:35:47.270 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:47.269+0000 7f38f4890200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-25T23:35:47.280 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:47.279+0000 7f7cc3dc9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-25T23:35:47.491 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:47.489+0000 7f38f4890200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-25T23:35:47.498 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:47.497+0000 7f7cc3dc9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-25T23:35:47.538 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-25T23:35:47.652 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:47.651+0000 7f7cc3dc9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-25T23:35:47.653 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.651+0000 7f7a28edd700 1 -- 172.21.15.81:0/2019266710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a241485d0 msgr2=0x7f7a240be7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:47.654 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.651+0000 7f7a28edd700 1 --2- 172.21.15.81:0/2019266710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a241485d0 0x7f7a240be7c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c0098f0 tx=0x7f7a1c009c00 comp rx=0 tx=0).stop 2023-10-25T23:35:47.654 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.651+0000 7f7a28edd700 1 -- 172.21.15.81:0/2019266710 shutdown_connections 2023-10-25T23:35:47.654 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.651+0000 7f7a28edd700 1 --2- 172.21.15.81:0/2019266710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a241485d0 0x7f7a240be7c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:47.654 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.652+0000 7f7a28edd700 1 -- 172.21.15.81:0/2019266710 >> 172.21.15.81:0/2019266710 conn(0x7f7a240a5950 msgr2=0x7f7a240a5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:47.655 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.652+0000 7f7a28edd700 1 -- 172.21.15.81:0/2019266710 shutdown_connections 2023-10-25T23:35:47.655 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.652+0000 7f7a28edd700 1 -- 172.21.15.81:0/2019266710 wait complete. 2023-10-25T23:35:47.657 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.653+0000 7f7a28edd700 1 Processor -- start 2023-10-25T23:35:47.657 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.653+0000 7f7a28edd700 1 -- start start 2023-10-25T23:35:47.657 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.653+0000 7f7a28edd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a240bed00 0x7f7a240b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:47.657 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.653+0000 7f7a28edd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a240c3970 0x7f7a240bc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:47.657 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.653+0000 7f7a28edd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a241485d0 0x7f7a241e4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:47.658 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.653+0000 7f7a28edd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a240b8fe0 con 0x7f7a240bed00 2023-10-25T23:35:47.658 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.653+0000 7f7a28edd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a240bc940 con 0x7f7a240c3970 2023-10-25T23:35:47.658 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.653+0000 7f7a28edd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a240ba490 con 0x7f7a241485d0 2023-10-25T23:35:47.658 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f7a2259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a240bed00 0x7f7a240b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:47.659 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f7a2259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a240bed00 0x7f7a240b8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35646/0 (socket says 172.21.15.81:35646) 2023-10-25T23:35:47.659 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f7a21d9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a240c3970 0x7f7a240bc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:47.659 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f7a2259c700 1 -- 172.21.15.81:0/2543448579 learned_addr learned my addr 172.21.15.81:0/2543448579 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:35:47.659 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f7a22d9d700 1 --2- 172.21.15.81:0/2543448579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a241485d0 0x7f7a241e4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:47.659 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f7a22d9d700 1 -- 172.21.15.81:0/2543448579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a240c3970 msgr2=0x7f7a240bc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:47.660 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f7a22d9d700 1 --2- 172.21.15.81:0/2543448579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a240c3970 0x7f7a240bc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:47.660 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f7a22d9d700 1 -- 172.21.15.81:0/2543448579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a240bed00 msgr2=0x7f7a240b8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:47.660 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f7a22d9d700 1 --2- 172.21.15.81:0/2543448579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a240bed00 0x7f7a240b8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:47.660 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f7a22d9d700 1 -- 172.21.15.81:0/2543448579 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c009520 con 0x7f7a241485d0 2023-10-25T23:35:47.661 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f38f4890200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-25T23:35:47.662 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f7a22d9d700 1 --2- 172.21.15.81:0/2543448579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a241485d0 0x7f7a241e4ba0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7a2408a610 tx=0x7f7a1400ce70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:47.662 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f7a12ffd700 1 -- 172.21.15.81:0/2543448579 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14003c00 con 0x7f7a241485d0 2023-10-25T23:35:47.662 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f7a12ffd700 1 -- 172.21.15.81:0/2543448579 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7a14003d60 con 0x7f7a241485d0 2023-10-25T23:35:47.662 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f7a28edd700 1 -- 172.21.15.81:0/2543448579 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a240ba750 con 0x7f7a241485d0 2023-10-25T23:35:47.663 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f7a12ffd700 1 -- 172.21.15.81:0/2543448579 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1400a9e0 con 0x7f7a241485d0 2023-10-25T23:35:47.663 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f7a28edd700 1 -- 172.21.15.81:0/2543448579 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a240bd290 con 0x7f7a241485d0 2023-10-25T23:35:47.663 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f7a12ffd700 1 -- 172.21.15.81:0/2543448579 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7a140050d0 con 0x7f7a241485d0 2023-10-25T23:35:47.663 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.654+0000 7f7a12ffd700 1 -- 172.21.15.81:0/2543448579 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7a14012560 con 0x7f7a241485d0 2023-10-25T23:35:47.663 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.655+0000 7f7a28edd700 1 -- 172.21.15.81:0/2543448579 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a2404e4c0 con 0x7f7a241485d0 2023-10-25T23:35:47.664 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.657+0000 7f7a12ffd700 1 -- 172.21.15.81:0/2543448579 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f7a14005380 con 0x7f7a241485d0 2023-10-25T23:35:47.729 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.727+0000 7f7a28edd700 1 -- 172.21.15.81:0/2543448579 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a2406cc90 con 0x7f7a241485d0 2023-10-25T23:35:47.730 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.728+0000 7f7a12ffd700 1 -- 172.21.15.81:0/2543448579 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7a14005520 con 0x7f7a241485d0 2023-10-25T23:35:47.731 INFO:teuthology.misc.health.smithi081.stdout: 2023-10-25T23:35:47.731 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":10,"fsid":"97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf","created":"2023-10-25T23:35:42.986840+0000","modified":"2023-10-25T23:35:46.443490+0000","last_up_change":"0.000000","last_in_change":"2023-10-25T23:35:46.443490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"48415836-8f22-4dcd-baa3-1d09c90c9a0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"19a4f6b5-e75c-45ae-aa08-b3467e69eed5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"60645312-54f5-4a74-ae52-68d17ff2d6e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c636a4a2-c1e8-4306-a78b-fe37eebab526","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3cafc826-e531-4aa7-8b2a-b592f318f138","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6098deb2-258e-47e1-b283-9a24c9dddf27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d79f68de-3c19-4f68-bbd1-59c8484dfaa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f1f7002e-4de9-4a08-97a1-fb52a116687f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T23:35:47.732 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.729+0000 7f7a28edd700 1 -- 172.21.15.81:0/2543448579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a241485d0 msgr2=0x7f7a241e4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:47.732 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.729+0000 7f7a28edd700 1 --2- 172.21.15.81:0/2543448579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a241485d0 0x7f7a241e4ba0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7a2408a610 tx=0x7f7a1400ce70 comp rx=0 tx=0).stop 2023-10-25T23:35:47.732 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.729+0000 7f7a28edd700 1 -- 172.21.15.81:0/2543448579 shutdown_connections 2023-10-25T23:35:47.732 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.729+0000 7f7a28edd700 1 --2- 172.21.15.81:0/2543448579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a241485d0 0x7f7a241e4ba0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:47.733 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.729+0000 7f7a28edd700 1 --2- 172.21.15.81:0/2543448579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a240bed00 0x7f7a240b8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:47.733 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.729+0000 7f7a28edd700 1 --2- 172.21.15.81:0/2543448579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a240c3970 0x7f7a240bc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:47.733 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.729+0000 7f7a28edd700 1 -- 172.21.15.81:0/2543448579 >> 172.21.15.81:0/2543448579 conn(0x7f7a240a5950 msgr2=0x7f7a2414d100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:47.733 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.729+0000 7f7a28edd700 1 -- 172.21.15.81:0/2543448579 shutdown_connections 2023-10-25T23:35:47.733 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:47.729+0000 7f7a28edd700 1 -- 172.21.15.81:0/2543448579 wait complete. 2023-10-25T23:35:47.743 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-25T23:35:47.769 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:47.768+0000 7f7cc3dc9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-25T23:35:47.776 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:47.774+0000 7f38f4890200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-25T23:35:48.090 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:48.089+0000 7f7cc3dc9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-25T23:35:48.099 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:48.098+0000 7f38f4890200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-25T23:35:48.189 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:48.188+0000 7f7cc3dc9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-25T23:35:48.199 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:48.197+0000 7f38f4890200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-25T23:35:48.376 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:48.375+0000 7f7cc3dc9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-25T23:35:48.386 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:48.385+0000 7f38f4890200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-25T23:35:48.967 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:48.964+0000 7f7cc3dc9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-25T23:35:48.988 INFO:tasks.ceph.mgr.y.smithi081.stderr:2023-10-25T23:35:48.986+0000 7f38f4890200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-25T23:35:49.990 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:49.989+0000 7f7c7bd58700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-25T23:35:49.991 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-25T23:35:49.989+0000 7f7c7bd58700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-25T23:35:50.582 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-10-25T23:35:50.581+0000 7f80af760640 -1 osd.5 0 log_to_monitors true 2023-10-25T23:35:50.592 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-10-25T23:35:50.591+0000 7f759f219640 -1 osd.1 0 log_to_monitors true 2023-10-25T23:35:50.635 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-10-25T23:35:50.634+0000 7f6592711640 -1 osd.0 0 log_to_monitors true 2023-10-25T23:35:50.657 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-10-25T23:35:50.656+0000 7fde03535640 -1 osd.6 0 log_to_monitors true 2023-10-25T23:35:50.669 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-10-25T23:35:50.668+0000 7fe49074e640 -1 osd.4 0 log_to_monitors true 2023-10-25T23:35:50.671 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-10-25T23:35:50.670+0000 7f9eeee28640 -1 osd.7 0 log_to_monitors true 2023-10-25T23:35:50.680 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-10-25T23:35:50.679+0000 7fcdb07d1640 -1 osd.2 0 log_to_monitors true 2023-10-25T23:35:50.689 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-10-25T23:35:50.687+0000 7f3ab2896640 -1 osd.3 0 log_to_monitors true 2023-10-25T23:35:54.030 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-10-25T23:35:54.029+0000 7f80a3317700 -1 osd.5 0 waiting for initial osdmap 2023-10-25T23:35:54.044 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-10-25T23:35:54.043+0000 7f809b6f2700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-25T23:35:54.046 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-10-25T23:35:54.045+0000 7fe484305700 -1 osd.4 0 waiting for initial osdmap 2023-10-25T23:35:54.050 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-10-25T23:35:54.049+0000 7fddf70ec700 -1 osd.6 0 waiting for initial osdmap 2023-10-25T23:35:54.059 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-10-25T23:35:54.057+0000 7f65862c8700 -1 osd.0 0 waiting for initial osdmap 2023-10-25T23:35:54.061 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-10-25T23:35:54.060+0000 7fe47c6e0700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-25T23:35:54.063 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-10-25T23:35:54.063+0000 7fddef4c7700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-25T23:35:54.075 INFO:tasks.ceph.osd.0.smithi081.stderr:2023-10-25T23:35:54.074+0000 7f657e6a3700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-25T23:35:54.085 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-10-25T23:35:54.084+0000 7f9ee29df700 -1 osd.7 0 waiting for initial osdmap 2023-10-25T23:35:54.087 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-10-25T23:35:54.085+0000 7fcda4388700 -1 osd.2 0 waiting for initial osdmap 2023-10-25T23:35:54.096 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-10-25T23:35:54.095+0000 7f9edadba700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-25T23:35:54.102 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-10-25T23:35:54.100+0000 7f3aa644d700 -1 osd.3 0 waiting for initial osdmap 2023-10-25T23:35:54.102 INFO:tasks.ceph.osd.2.smithi081.stderr:2023-10-25T23:35:54.101+0000 7fcd9c763700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-25T23:35:54.121 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-10-25T23:35:54.120+0000 7f7592dd0700 -1 osd.1 0 waiting for initial osdmap 2023-10-25T23:35:54.125 INFO:tasks.ceph.osd.3.smithi081.stderr:2023-10-25T23:35:54.124+0000 7f3a9e828700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-25T23:35:54.138 INFO:tasks.ceph.osd.1.smithi081.stderr:2023-10-25T23:35:54.137+0000 7f758b1ab700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-25T23:35:54.550 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-25T23:35:54.665 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.663+0000 7ff740c76700 1 -- 172.21.15.81:0/848623957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff73c06cd80 msgr2=0x7ff73c14f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:54.665 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.663+0000 7ff740c76700 1 --2- 172.21.15.81:0/848623957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff73c06cd80 0x7ff73c14f160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff72c0098c0 tx=0x7ff72c009bd0 comp rx=0 tx=0).stop 2023-10-25T23:35:54.665 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.663+0000 7ff740c76700 1 -- 172.21.15.81:0/848623957 shutdown_connections 2023-10-25T23:35:54.665 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.663+0000 7ff740c76700 1 --2- 172.21.15.81:0/848623957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff73c1454f0 0x7ff73c14ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:54.666 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.663+0000 7ff740c76700 1 --2- 172.21.15.81:0/848623957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff73c06cd80 0x7ff73c14f160 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:54.666 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.663+0000 7ff740c76700 1 -- 172.21.15.81:0/848623957 >> 172.21.15.81:0/848623957 conn(0x7ff73c0c0a40 msgr2=0x7ff73c0c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:54.666 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.663+0000 7ff740c76700 1 -- 172.21.15.81:0/848623957 shutdown_connections 2023-10-25T23:35:54.666 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.663+0000 7ff740c76700 1 -- 172.21.15.81:0/848623957 wait complete. 2023-10-25T23:35:54.669 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.664+0000 7ff740c76700 1 Processor -- start 2023-10-25T23:35:54.669 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.664+0000 7ff740c76700 1 -- start start 2023-10-25T23:35:54.669 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff740c76700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff73c06cd80 0x7ff73c12beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:54.670 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff740c76700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff73c1454f0 0x7ff73c12cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:54.670 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff740c76700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff73c14b220 0x7ff73c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:54.670 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff740c76700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c12d1b0 con 0x7ff73c1454f0 2023-10-25T23:35:54.670 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff740c76700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c12bcc0 con 0x7ff73c14b220 2023-10-25T23:35:54.670 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff740c76700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73c06a9c0 con 0x7ff73c06cd80 2023-10-25T23:35:54.671 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff739d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff73c1454f0 0x7ff73c12cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:54.671 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff739d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff73c1454f0 0x7ff73c12cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35712/0 (socket says 172.21.15.81:35712) 2023-10-25T23:35:54.671 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff739d9b700 1 -- 172.21.15.81:0/4070245603 learned_addr learned my addr 172.21.15.81:0/4070245603 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:35:54.671 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff73a59c700 1 --2- 172.21.15.81:0/4070245603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff73c06cd80 0x7ff73c12beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:54.671 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff73ad9d700 1 --2- 172.21.15.81:0/4070245603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff73c14b220 0x7ff73c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:54.672 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff739d9b700 1 -- 172.21.15.81:0/4070245603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff73c06cd80 msgr2=0x7ff73c12beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:54.672 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff739d9b700 1 --2- 172.21.15.81:0/4070245603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff73c06cd80 0x7ff73c12beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:54.672 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff739d9b700 1 -- 172.21.15.81:0/4070245603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff73c14b220 msgr2=0x7ff73c06a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:54.672 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff739d9b700 1 --2- 172.21.15.81:0/4070245603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff73c14b220 0x7ff73c06a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:54.672 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff739d9b700 1 -- 172.21.15.81:0/4070245603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff730009520 con 0x7ff73c1454f0 2023-10-25T23:35:54.673 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff739d9b700 1 --2- 172.21.15.81:0/4070245603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff73c1454f0 0x7ff73c12cc70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff73c070610 tx=0x7ff72c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:54.673 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff72affd700 1 -- 172.21.15.81:0/4070245603 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c01b040 con 0x7ff73c1454f0 2023-10-25T23:35:54.673 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff72affd700 1 -- 172.21.15.81:0/4070245603 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff72c00fc90 con 0x7ff73c1454f0 2023-10-25T23:35:54.673 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff740c76700 1 -- 172.21.15.81:0/4070245603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72c009520 con 0x7ff73c1454f0 2023-10-25T23:35:54.673 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff72affd700 1 -- 172.21.15.81:0/4070245603 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff72c004a90 con 0x7ff73c1454f0 2023-10-25T23:35:54.674 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.665+0000 7ff740c76700 1 -- 172.21.15.81:0/4070245603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73c0b6410 con 0x7ff73c1454f0 2023-10-25T23:35:54.674 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.666+0000 7ff740c76700 1 -- 172.21.15.81:0/4070245603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73c04e4c0 con 0x7ff73c1454f0 2023-10-25T23:35:54.674 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.667+0000 7ff72affd700 1 -- 172.21.15.81:0/4070245603 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7ff72c020440 con 0x7ff73c1454f0 2023-10-25T23:35:54.674 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.667+0000 7ff72affd700 1 --2- 172.21.15.81:0/4070245603 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff71c06ae40 0x7ff71c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:35:54.674 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.667+0000 7ff72affd700 1 -- 172.21.15.81:0/4070245603 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7ff72c089e50 con 0x7ff73c1454f0 2023-10-25T23:35:54.675 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.667+0000 7ff73a59c700 1 --2- 172.21.15.81:0/4070245603 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff71c06ae40 0x7ff71c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:35:54.675 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.667+0000 7ff73a59c700 1 --2- 172.21.15.81:0/4070245603 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff71c06ae40 0x7ff71c06d300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff730009df0 tx=0x7ff730009260 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:35:54.675 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.672+0000 7ff72affd700 1 -- 172.21.15.81:0/4070245603 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff72c055f20 con 0x7ff73c1454f0 2023-10-25T23:35:54.862 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.860+0000 7ff740c76700 1 -- 172.21.15.81:0/4070245603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff73c0bae70 con 0x7ff73c1454f0 2023-10-25T23:35:54.863 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.861+0000 7ff72affd700 1 -- 172.21.15.81:0/4070245603 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff72c024070 con 0x7ff73c1454f0 2023-10-25T23:35:54.863 INFO:teuthology.misc.health.smithi081.stdout: 2023-10-25T23:35:54.863 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":12,"fsid":"97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf","created":"2023-10-25T23:35:42.986840+0000","modified":"2023-10-25T23:35:52.022453+0000","last_up_change":"0.000000","last_in_change":"2023-10-25T23:35:46.443490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"48415836-8f22-4dcd-baa3-1d09c90c9a0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"19a4f6b5-e75c-45ae-aa08-b3467e69eed5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"60645312-54f5-4a74-ae52-68d17ff2d6e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c636a4a2-c1e8-4306-a78b-fe37eebab526","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3cafc826-e531-4aa7-8b2a-b592f318f138","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6098deb2-258e-47e1-b283-9a24c9dddf27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d79f68de-3c19-4f68-bbd1-59c8484dfaa2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f1f7002e-4de9-4a08-97a1-fb52a116687f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T23:35:54.865 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.863+0000 7ff740c76700 1 -- 172.21.15.81:0/4070245603 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff71c06ae40 msgr2=0x7ff71c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:54.866 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.863+0000 7ff740c76700 1 --2- 172.21.15.81:0/4070245603 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff71c06ae40 0x7ff71c06d300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff730009df0 tx=0x7ff730009260 comp rx=0 tx=0).stop 2023-10-25T23:35:54.866 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.863+0000 7ff740c76700 1 -- 172.21.15.81:0/4070245603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff73c1454f0 msgr2=0x7ff73c12cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:35:54.866 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.863+0000 7ff740c76700 1 --2- 172.21.15.81:0/4070245603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff73c1454f0 0x7ff73c12cc70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff73c070610 tx=0x7ff72c00f690 comp rx=0 tx=0).stop 2023-10-25T23:35:54.866 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.863+0000 7ff740c76700 1 -- 172.21.15.81:0/4070245603 shutdown_connections 2023-10-25T23:35:54.866 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.863+0000 7ff740c76700 1 --2- 172.21.15.81:0/4070245603 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff71c06ae40 0x7ff71c06d300 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:54.867 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.863+0000 7ff740c76700 1 --2- 172.21.15.81:0/4070245603 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff73c14b220 0x7ff73c06a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:54.867 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.863+0000 7ff740c76700 1 --2- 172.21.15.81:0/4070245603 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff73c06cd80 0x7ff73c12beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:54.867 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.863+0000 7ff740c76700 1 --2- 172.21.15.81:0/4070245603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff73c1454f0 0x7ff73c12cc70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:35:54.867 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.863+0000 7ff740c76700 1 -- 172.21.15.81:0/4070245603 >> 172.21.15.81:0/4070245603 conn(0x7ff73c0c0a40 msgr2=0x7ff73c0c0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:35:54.867 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.863+0000 7ff740c76700 1 -- 172.21.15.81:0/4070245603 shutdown_connections 2023-10-25T23:35:54.868 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:35:54.863+0000 7ff740c76700 1 -- 172.21.15.81:0/4070245603 wait complete. 2023-10-25T23:35:54.876 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-25T23:36:01.683 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-25T23:36:01.808 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.806+0000 7fd7f6050700 1 -- 172.21.15.81:0/1022874956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7f00c1050 msgr2=0x7fd7f00bd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:01.808 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.806+0000 7fd7f6050700 1 --2- 172.21.15.81:0/1022874956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7f00c1050 0x7fd7f00bd090 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009fd0 tx=0x7fd7e800b380 comp rx=0 tx=0).stop 2023-10-25T23:36:01.808 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.806+0000 7fd7f6050700 1 -- 172.21.15.81:0/1022874956 shutdown_connections 2023-10-25T23:36:01.808 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.806+0000 7fd7f6050700 1 --2- 172.21.15.81:0/1022874956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7f00c1050 0x7fd7f00bd090 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:01.809 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.806+0000 7fd7f6050700 1 --2- 172.21.15.81:0/1022874956 >> v2:172.21.15.89:3300/0 conn(0x7fd7f00bc390 0x7fd7f006e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:01.809 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.806+0000 7fd7f6050700 1 -- 172.21.15.81:0/1022874956 >> 172.21.15.81:0/1022874956 conn(0x7fd7f00c1b30 msgr2=0x7fd7f00c1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:01.809 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.806+0000 7fd7f6050700 1 -- 172.21.15.81:0/1022874956 shutdown_connections 2023-10-25T23:36:01.809 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.806+0000 7fd7f6050700 1 -- 172.21.15.81:0/1022874956 wait complete. 2023-10-25T23:36:01.812 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.807+0000 7fd7f6050700 1 Processor -- start 2023-10-25T23:36:01.813 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.807+0000 7fd7f6050700 1 -- start start 2023-10-25T23:36:01.813 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7f6050700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7f006dd90 0x7fd7f00b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:01.813 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7f6050700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7f00bc390 0x7fd7f00ba5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:01.813 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7f6050700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7f00c1050 0x7fd7f006bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:01.813 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7f6050700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00a7a60 con 0x7fd7f006dd90 2023-10-25T23:36:01.814 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7f6050700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f006d0e0 con 0x7fd7f00c1050 2023-10-25T23:36:01.814 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7f6050700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00b8230 con 0x7fd7f00bc390 2023-10-25T23:36:01.814 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7ef7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7f006dd90 0x7fd7f00b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:01.814 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7ef7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7f006dd90 0x7fd7f00b7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35908/0 (socket says 172.21.15.81:35908) 2023-10-25T23:36:01.814 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7ef7fe700 1 -- 172.21.15.81:0/916534146 learned_addr learned my addr 172.21.15.81:0/916534146 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:01.815 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7eeffd700 1 --2- 172.21.15.81:0/916534146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7f00bc390 0x7fd7f00ba5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:01.815 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7effff700 1 --2- 172.21.15.81:0/916534146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7f00c1050 0x7fd7f006bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:01.815 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7ef7fe700 1 -- 172.21.15.81:0/916534146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7f00bc390 msgr2=0x7fd7f00ba5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:01.815 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7ef7fe700 1 --2- 172.21.15.81:0/916534146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7f00bc390 0x7fd7f00ba5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:01.816 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7ef7fe700 1 -- 172.21.15.81:0/916534146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7f00c1050 msgr2=0x7fd7f006bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:01.816 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7ef7fe700 1 --2- 172.21.15.81:0/916534146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7f00c1050 0x7fd7f006bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:01.816 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7ef7fe700 1 -- 172.21.15.81:0/916534146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e8009d00 con 0x7fd7f006dd90 2023-10-25T23:36:01.816 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7ef7fe700 1 --2- 172.21.15.81:0/916534146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7f006dd90 0x7fd7f00b7cf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400c760 tx=0x7fd7e400cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:01.816 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7d7fff700 1 -- 172.21.15.81:0/916534146 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e40054e0 con 0x7fd7f006dd90 2023-10-25T23:36:01.817 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7d7fff700 1 -- 172.21.15.81:0/916534146 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd7e4003680 con 0x7fd7f006dd90 2023-10-25T23:36:01.817 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7f6050700 1 -- 172.21.15.81:0/916534146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f0147210 con 0x7fd7f006dd90 2023-10-25T23:36:01.817 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7d7fff700 1 -- 172.21.15.81:0/916534146 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4003a90 con 0x7fd7f006dd90 2023-10-25T23:36:01.817 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.808+0000 7fd7f6050700 1 -- 172.21.15.81:0/916534146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f006cd70 con 0x7fd7f006dd90 2023-10-25T23:36:01.817 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.809+0000 7fd7f6050700 1 -- 172.21.15.81:0/916534146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f00bcab0 con 0x7fd7f006dd90 2023-10-25T23:36:01.818 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.810+0000 7fd7d7fff700 1 -- 172.21.15.81:0/916534146 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd7e4003bf0 con 0x7fd7f006dd90 2023-10-25T23:36:01.818 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.810+0000 7fd7d7fff700 1 --2- 172.21.15.81:0/916534146 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd7dc06af00 0x7fd7dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:01.818 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.810+0000 7fd7d7fff700 1 -- 172.21.15.81:0/916534146 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd7e4088490 con 0x7fd7f006dd90 2023-10-25T23:36:01.818 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.810+0000 7fd7eeffd700 1 --2- 172.21.15.81:0/916534146 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd7dc06af00 0x7fd7dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:01.818 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.811+0000 7fd7eeffd700 1 --2- 172.21.15.81:0/916534146 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd7dc06af00 0x7fd7dc06d3c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00c0fe0 tx=0x7fd7e0009260 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:01.819 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:01.815+0000 7fd7d7fff700 1 -- 172.21.15.81:0/916534146 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd7e4053950 con 0x7fd7f006dd90 2023-10-25T23:36:02.005 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:02.003+0000 7fd7f6050700 1 -- 172.21.15.81:0/916534146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7f004e4c0 con 0x7fd7f006dd90 2023-10-25T23:36:02.005 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:02.003+0000 7fd7d7fff700 1 -- 172.21.15.81:0/916534146 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12802 (secure 0 0 0) 0x7fd7e4056f70 con 0x7fd7f006dd90 2023-10-25T23:36:02.006 INFO:teuthology.misc.health.smithi081.stdout: 2023-10-25T23:36:02.006 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":17,"fsid":"97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf","created":"2023-10-25T23:35:42.986840+0000","modified":"2023-10-25T23:35:59.215088+0000","last_up_change":"2023-10-25T23:35:55.052199+0000","last_in_change":"2023-10-25T23:35:46.443490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T23:35:57.031170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48415836-8f22-4dcd-baa3-1d09c90c9a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6809","nonce":1045657984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6811","nonce":1045657984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6815","nonce":1045657984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6813","nonce":1045657984}]},"public_addr":"172.21.15.81:6809/1045657984","cluster_addr":"172.21.15.81:6811/1045657984","heartbeat_back_addr":"172.21.15.81:6815/1045657984","heartbeat_front_addr":"172.21.15.81:6813/1045657984","state":["exists","up"]},{"osd":1,"uuid":"19a4f6b5-e75c-45ae-aa08-b3467e69eed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6801","nonce":725386907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6803","nonce":725386907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6807","nonce":725386907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6805","nonce":725386907}]},"public_addr":"172.21.15.81:6801/725386907","cluster_addr":"172.21.15.81:6803/725386907","heartbeat_back_addr":"172.21.15.81:6807/725386907","heartbeat_front_addr":"172.21.15.81:6805/725386907","state":["exists","up"]},{"osd":2,"uuid":"60645312-54f5-4a74-ae52-68d17ff2d6e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6825","nonce":1744054610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6827","nonce":1744054610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6831","nonce":1744054610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6829","nonce":1744054610}]},"public_addr":"172.21.15.81:6825/1744054610","cluster_addr":"172.21.15.81:6827/1744054610","heartbeat_back_addr":"172.21.15.81:6831/1744054610","heartbeat_front_addr":"172.21.15.81:6829/1744054610","state":["exists","up"]},{"osd":3,"uuid":"c636a4a2-c1e8-4306-a78b-fe37eebab526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6817","nonce":1391123341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6819","nonce":1391123341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6823","nonce":1391123341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6821","nonce":1391123341}]},"public_addr":"172.21.15.81:6817/1391123341","cluster_addr":"172.21.15.81:6819/1391123341","heartbeat_back_addr":"172.21.15.81:6823/1391123341","heartbeat_front_addr":"172.21.15.81:6821/1391123341","state":["exists","up"]},{"osd":4,"uuid":"3cafc826-e531-4aa7-8b2a-b592f318f138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6817","nonce":1232781703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6819","nonce":1232781703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6823","nonce":1232781703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6821","nonce":1232781703}]},"public_addr":"172.21.15.89:6817/1232781703","cluster_addr":"172.21.15.89:6819/1232781703","heartbeat_back_addr":"172.21.15.89:6823/1232781703","heartbeat_front_addr":"172.21.15.89:6821/1232781703","state":["exists","up"]},{"osd":5,"uuid":"6098deb2-258e-47e1-b283-9a24c9dddf27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6801","nonce":2255820086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6803","nonce":2255820086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6807","nonce":2255820086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6805","nonce":2255820086}]},"public_addr":"172.21.15.89:6801/2255820086","cluster_addr":"172.21.15.89:6803/2255820086","heartbeat_back_addr":"172.21.15.89:6807/2255820086","heartbeat_front_addr":"172.21.15.89:6805/2255820086","state":["exists","up"]},{"osd":6,"uuid":"d79f68de-3c19-4f68-bbd1-59c8484dfaa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6809","nonce":2561967165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6811","nonce":2561967165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6815","nonce":2561967165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6813","nonce":2561967165}]},"public_addr":"172.21.15.89:6809/2561967165","cluster_addr":"172.21.15.89:6811/2561967165","heartbeat_back_addr":"172.21.15.89:6815/2561967165","heartbeat_front_addr":"172.21.15.89:6813/2561967165","state":["exists","up"]},{"osd":7,"uuid":"f1f7002e-4de9-4a08-97a1-fb52a116687f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6825","nonce":2647243500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6827","nonce":2647243500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6831","nonce":2647243500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6829","nonce":2647243500}]},"public_addr":"172.21.15.89:6825/2647243500","cluster_addr":"172.21.15.89:6827/2647243500","heartbeat_back_addr":"172.21.15.89:6831/2647243500","heartbeat_front_addr":"172.21.15.89:6829/2647243500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.613750+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.593515+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.713198+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.725623+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.686409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.596728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.670930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.676762+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T23:36:02.007 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:02.005+0000 7fd7f6050700 1 -- 172.21.15.81:0/916534146 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd7dc06af00 msgr2=0x7fd7dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:02.008 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:02.005+0000 7fd7f6050700 1 --2- 172.21.15.81:0/916534146 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd7dc06af00 0x7fd7dc06d3c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7f00c0fe0 tx=0x7fd7e0009260 comp rx=0 tx=0).stop 2023-10-25T23:36:02.008 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:02.005+0000 7fd7f6050700 1 -- 172.21.15.81:0/916534146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7f006dd90 msgr2=0x7fd7f00b7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:02.008 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:02.005+0000 7fd7f6050700 1 --2- 172.21.15.81:0/916534146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7f006dd90 0x7fd7f00b7cf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400c760 tx=0x7fd7e400cb20 comp rx=0 tx=0).stop 2023-10-25T23:36:02.008 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:02.005+0000 7fd7f6050700 1 -- 172.21.15.81:0/916534146 shutdown_connections 2023-10-25T23:36:02.008 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:02.005+0000 7fd7f6050700 1 --2- 172.21.15.81:0/916534146 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd7dc06af00 0x7fd7dc06d3c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.009 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:02.005+0000 7fd7f6050700 1 --2- 172.21.15.81:0/916534146 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7f00c1050 0x7fd7f006bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.009 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:02.005+0000 7fd7f6050700 1 --2- 172.21.15.81:0/916534146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7f006dd90 0x7fd7f00b7cf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.009 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:02.005+0000 7fd7f6050700 1 --2- 172.21.15.81:0/916534146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7f00bc390 0x7fd7f00ba5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.009 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:02.005+0000 7fd7f6050700 1 -- 172.21.15.81:0/916534146 >> 172.21.15.81:0/916534146 conn(0x7fd7f00c1b30 msgr2=0x7fd7f0149860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:02.009 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:02.005+0000 7fd7f6050700 1 -- 172.21.15.81:0/916534146 shutdown_connections 2023-10-25T23:36:02.009 INFO:teuthology.misc.health.smithi081.stderr:2023-10-25T23:36:02.005+0000 7fd7f6050700 1 -- 172.21.15.81:0/916534146 wait complete. 2023-10-25T23:36:02.018 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-25T23:36:02.019 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-25T23:36:02.019 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-25T23:36:02.019 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-25T23:36:02.022 INFO:tasks.ceph.mds.a:Started 2023-10-25T23:36:02.022 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-25T23:36:02.022 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-25T23:36:02.024 INFO:tasks.ceph.mds.c:Started 2023-10-25T23:36:02.025 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-25T23:36:02.025 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-25T23:36:02.028 INFO:tasks.ceph.mds.b:Started 2023-10-25T23:36:02.028 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-25T23:36:02.029 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-25T23:36:02.031 INFO:tasks.ceph.mds.d:Started 2023-10-25T23:36:02.031 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-25T23:36:02.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T23:36:02.100 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-25T23:36:02.101 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2023-10-25T23:36:02.122 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-10-25T23:36:02.123 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-10-25T23:36:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.158+0000 7f84bc4f4700 1 -- 172.21.15.81:0/3108415074 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84b414ea80 msgr2=0x7f84b4145120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.158+0000 7f84bc4f4700 1 --2- 172.21.15.81:0/3108415074 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84b414ea80 0x7f84b4145120 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f84a40098c0 tx=0x7f84a4009bd0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.159+0000 7f84bc4f4700 1 -- 172.21.15.81:0/3108415074 shutdown_connections 2023-10-25T23:36:02.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.159+0000 7f84bc4f4700 1 --2- 172.21.15.81:0/3108415074 >> v2:172.21.15.89:3300/0 conn(0x7f84b40b4ed0 0x7f84b4155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.159+0000 7f84bc4f4700 1 --2- 172.21.15.81:0/3108415074 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84b414ea80 0x7f84b4145120 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.159+0000 7f84bc4f4700 1 -- 172.21.15.81:0/3108415074 >> 172.21.15.81:0/3108415074 conn(0x7f84b40c0a60 msgr2=0x7f84b40c0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.159+0000 7f84bc4f4700 1 -- 172.21.15.81:0/3108415074 shutdown_connections 2023-10-25T23:36:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.159+0000 7f84bc4f4700 1 -- 172.21.15.81:0/3108415074 wait complete. 2023-10-25T23:36:02.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.160+0000 7f84bc4f4700 1 Processor -- start 2023-10-25T23:36:02.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.160+0000 7f84bc4f4700 1 -- start start 2023-10-25T23:36:02.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.161+0000 7f84bc4f4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84b40b4ed0 0x7f84b4144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:02.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.161+0000 7f84bc4f4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84b4145660 0x7f84b41460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:02.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.161+0000 7f84bc4f4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84b414ea80 0x7f84b414de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.161+0000 7f84bc4f4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b4145c40 con 0x7f84b4145660 2023-10-25T23:36:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.161+0000 7f84bc4f4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b414e3a0 con 0x7f84b414ea80 2023-10-25T23:36:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.161+0000 7f84bc4f4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b413e670 con 0x7f84b40b4ed0 2023-10-25T23:36:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.161+0000 7f84b9a8f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84b4145660 0x7f84b41460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:02.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.161+0000 7f84b9a8f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84b4145660 0x7f84b41460d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35948/0 (socket says 172.21.15.81:35948) 2023-10-25T23:36:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.161+0000 7f84ba290700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84b40b4ed0 0x7f84b4144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.161+0000 7f84b9a8f700 1 -- 172.21.15.81:0/3040800117 learned_addr learned my addr 172.21.15.81:0/3040800117 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.161+0000 7f84baa91700 1 --2- 172.21.15.81:0/3040800117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84b414ea80 0x7f84b414de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.161+0000 7f84b9a8f700 1 -- 172.21.15.81:0/3040800117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84b40b4ed0 msgr2=0x7f84b4144330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:02.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.161+0000 7f84b9a8f700 1 --2- 172.21.15.81:0/3040800117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84b40b4ed0 0x7f84b4144330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.161+0000 7f84b9a8f700 1 -- 172.21.15.81:0/3040800117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84b414ea80 msgr2=0x7f84b414de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.161+0000 7f84b9a8f700 1 --2- 172.21.15.81:0/3040800117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84b414ea80 0x7f84b414de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.161+0000 7f84b9a8f700 1 -- 172.21.15.81:0/3040800117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac009c40 con 0x7f84b4145660 2023-10-25T23:36:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.161+0000 7f84ba290700 1 --2- 172.21.15.81:0/3040800117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84b40b4ed0 0x7f84b4144330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-25T23:36:02.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.161+0000 7f84baa91700 1 --2- 172.21.15.81:0/3040800117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84b414ea80 0x7f84b414de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-25T23:36:02.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.162+0000 7f84b9a8f700 1 --2- 172.21.15.81:0/3040800117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84b4145660 0x7f84b41460d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f84b000c700 tx=0x7f84b000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:02.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.162+0000 7f84aaffd700 1 -- 172.21.15.81:0/3040800117 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b0005230 con 0x7f84b4145660 2023-10-25T23:36:02.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.162+0000 7f84aaffd700 1 -- 172.21.15.81:0/3040800117 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f84b0005480 con 0x7f84b4145660 2023-10-25T23:36:02.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.162+0000 7f84bc4f4700 1 -- 172.21.15.81:0/3040800117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a4009520 con 0x7f84b4145660 2023-10-25T23:36:02.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.162+0000 7f84aaffd700 1 -- 172.21.15.81:0/3040800117 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b0004990 con 0x7f84b4145660 2023-10-25T23:36:02.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.162+0000 7f84bc4f4700 1 -- 172.21.15.81:0/3040800117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b4143290 con 0x7f84b4145660 2023-10-25T23:36:02.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.163+0000 7f84bc4f4700 1 -- 172.21.15.81:0/3040800117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b404e4c0 con 0x7f84b4145660 2023-10-25T23:36:02.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.163+0000 7f84aaffd700 1 -- 172.21.15.81:0/3040800117 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f84b0004af0 con 0x7f84b4145660 2023-10-25T23:36:02.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.163+0000 7f84aaffd700 1 --2- 172.21.15.81:0/3040800117 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f849806aed0 0x7f849806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:02.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.164+0000 7f84aaffd700 1 -- 172.21.15.81:0/3040800117 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f84b0088860 con 0x7f84b4145660 2023-10-25T23:36:02.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.164+0000 7f84ba290700 1 --2- 172.21.15.81:0/3040800117 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f849806aed0 0x7f849806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:02.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.164+0000 7f84ba290700 1 --2- 172.21.15.81:0/3040800117 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f849806aed0 0x7f849806d390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f84a4000c00 tx=0x7f84a401a040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:02.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.168+0000 7f84aaffd700 1 -- 172.21.15.81:0/3040800117 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f84b0053c50 con 0x7f84b4145660 2023-10-25T23:36:02.360 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.359+0000 7f84bc4f4700 1 -- 172.21.15.81:0/3040800117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84b40b5550 con 0x7f84b4145660 2023-10-25T23:36:02.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.360+0000 7f84aaffd700 1 -- 172.21.15.81:0/3040800117 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12802 (secure 0 0 0) 0x7f84b0017090 con 0x7f84b4145660 2023-10-25T23:36:02.362 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:02.362 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"fsid":"97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf","created":"2023-10-25T23:35:42.986840+0000","modified":"2023-10-25T23:35:59.215088+0000","last_up_change":"2023-10-25T23:35:55.052199+0000","last_in_change":"2023-10-25T23:35:46.443490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T23:35:57.031170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48415836-8f22-4dcd-baa3-1d09c90c9a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6809","nonce":1045657984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6811","nonce":1045657984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6815","nonce":1045657984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6813","nonce":1045657984}]},"public_addr":"172.21.15.81:6809/1045657984","cluster_addr":"172.21.15.81:6811/1045657984","heartbeat_back_addr":"172.21.15.81:6815/1045657984","heartbeat_front_addr":"172.21.15.81:6813/1045657984","state":["exists","up"]},{"osd":1,"uuid":"19a4f6b5-e75c-45ae-aa08-b3467e69eed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6801","nonce":725386907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6803","nonce":725386907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6807","nonce":725386907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6805","nonce":725386907}]},"public_addr":"172.21.15.81:6801/725386907","cluster_addr":"172.21.15.81:6803/725386907","heartbeat_back_addr":"172.21.15.81:6807/725386907","heartbeat_front_addr":"172.21.15.81:6805/725386907","state":["exists","up"]},{"osd":2,"uuid":"60645312-54f5-4a74-ae52-68d17ff2d6e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6825","nonce":1744054610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6827","nonce":1744054610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6831","nonce":1744054610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6829","nonce":1744054610}]},"public_addr":"172.21.15.81:6825/1744054610","cluster_addr":"172.21.15.81:6827/1744054610","heartbeat_back_addr":"172.21.15.81:6831/1744054610","heartbeat_front_addr":"172.21.15.81:6829/1744054610","state":["exists","up"]},{"osd":3,"uuid":"c636a4a2-c1e8-4306-a78b-fe37eebab526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6817","nonce":1391123341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6819","nonce":1391123341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6823","nonce":1391123341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6821","nonce":1391123341}]},"public_addr":"172.21.15.81:6817/1391123341","cluster_addr":"172.21.15.81:6819/1391123341","heartbeat_back_addr":"172.21.15.81:6823/1391123341","heartbeat_front_addr":"172.21.15.81:6821/1391123341","state":["exists","up"]},{"osd":4,"uuid":"3cafc826-e531-4aa7-8b2a-b592f318f138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6817","nonce":1232781703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6819","nonce":1232781703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6823","nonce":1232781703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6821","nonce":1232781703}]},"public_addr":"172.21.15.89:6817/1232781703","cluster_addr":"172.21.15.89:6819/1232781703","heartbeat_back_addr":"172.21.15.89:6823/1232781703","heartbeat_front_addr":"172.21.15.89:6821/1232781703","state":["exists","up"]},{"osd":5,"uuid":"6098deb2-258e-47e1-b283-9a24c9dddf27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6801","nonce":2255820086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6803","nonce":2255820086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6807","nonce":2255820086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6805","nonce":2255820086}]},"public_addr":"172.21.15.89:6801/2255820086","cluster_addr":"172.21.15.89:6803/2255820086","heartbeat_back_addr":"172.21.15.89:6807/2255820086","heartbeat_front_addr":"172.21.15.89:6805/2255820086","state":["exists","up"]},{"osd":6,"uuid":"d79f68de-3c19-4f68-bbd1-59c8484dfaa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6809","nonce":2561967165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6811","nonce":2561967165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6815","nonce":2561967165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6813","nonce":2561967165}]},"public_addr":"172.21.15.89:6809/2561967165","cluster_addr":"172.21.15.89:6811/2561967165","heartbeat_back_addr":"172.21.15.89:6815/2561967165","heartbeat_front_addr":"172.21.15.89:6813/2561967165","state":["exists","up"]},{"osd":7,"uuid":"f1f7002e-4de9-4a08-97a1-fb52a116687f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6825","nonce":2647243500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6827","nonce":2647243500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6831","nonce":2647243500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6829","nonce":2647243500}]},"public_addr":"172.21.15.89:6825/2647243500","cluster_addr":"172.21.15.89:6827/2647243500","heartbeat_back_addr":"172.21.15.89:6831/2647243500","heartbeat_front_addr":"172.21.15.89:6829/2647243500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.613750+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.593515+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.713198+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.725623+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.686409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.596728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.670930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.676762+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T23:36:02.363 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.361+0000 7f84bc4f4700 1 -- 172.21.15.81:0/3040800117 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f849806aed0 msgr2=0x7f849806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:02.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.361+0000 7f84bc4f4700 1 --2- 172.21.15.81:0/3040800117 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f849806aed0 0x7f849806d390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f84a4000c00 tx=0x7f84a401a040 comp rx=0 tx=0).stop 2023-10-25T23:36:02.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.361+0000 7f84bc4f4700 1 -- 172.21.15.81:0/3040800117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84b4145660 msgr2=0x7f84b41460d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:02.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.361+0000 7f84bc4f4700 1 --2- 172.21.15.81:0/3040800117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84b4145660 0x7f84b41460d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f84b000c700 tx=0x7f84b000ca10 comp rx=0 tx=0).stop 2023-10-25T23:36:02.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.362+0000 7f84bc4f4700 1 -- 172.21.15.81:0/3040800117 shutdown_connections 2023-10-25T23:36:02.364 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.362+0000 7f84bc4f4700 1 --2- 172.21.15.81:0/3040800117 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f849806aed0 0x7f849806d390 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.362+0000 7f84bc4f4700 1 --2- 172.21.15.81:0/3040800117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84b414ea80 0x7f84b414de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.362+0000 7f84bc4f4700 1 --2- 172.21.15.81:0/3040800117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84b40b4ed0 0x7f84b4144330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.362+0000 7f84bc4f4700 1 --2- 172.21.15.81:0/3040800117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84b4145660 0x7f84b41460d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.362+0000 7f84bc4f4700 1 -- 172.21.15.81:0/3040800117 >> 172.21.15.81:0/3040800117 conn(0x7f84b40c0a60 msgr2=0x7f84b40c00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:02.365 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.362+0000 7f84bc4f4700 1 -- 172.21.15.81:0/3040800117 shutdown_connections 2023-10-25T23:36:02.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.362+0000 7f84bc4f4700 1 -- 172.21.15.81:0/3040800117 wait complete. 2023-10-25T23:36:02.375 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T23:35:57.031170+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T23:36:02.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T23:36:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.498+0000 7f5e150cd700 1 -- 172.21.15.81:0/3688239380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e100bb530 msgr2=0x7f5e100bd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.498+0000 7f5e150cd700 1 --2- 172.21.15.81:0/3688239380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e100bb530 0x7f5e100bd5c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5e00005fd0 tx=0x7f5e00009c70 comp rx=0 tx=0).stop 2023-10-25T23:36:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.498+0000 7f5e150cd700 1 -- 172.21.15.81:0/3688239380 shutdown_connections 2023-10-25T23:36:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.498+0000 7f5e150cd700 1 --2- 172.21.15.81:0/3688239380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e10144f60 0x7f5e1014b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.498+0000 7f5e150cd700 1 --2- 172.21.15.81:0/3688239380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e100bb530 0x7f5e100bd5c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.498+0000 7f5e150cd700 1 -- 172.21.15.81:0/3688239380 >> 172.21.15.81:0/3688239380 conn(0x7f5e1006b320 msgr2=0x7f5e1006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:02.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.498+0000 7f5e150cd700 1 -- 172.21.15.81:0/3688239380 shutdown_connections 2023-10-25T23:36:02.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.498+0000 7f5e150cd700 1 -- 172.21.15.81:0/3688239380 wait complete. 2023-10-25T23:36:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.500+0000 7f5e150cd700 1 Processor -- start 2023-10-25T23:36:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.500+0000 7f5e150cd700 1 -- start start 2023-10-25T23:36:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.501+0000 7f5e150cd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e100bb530 0x7f5e10142470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.501+0000 7f5e150cd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e100bdb00 0x7f5e1013fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.501+0000 7f5e150cd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e10144f60 0x7f5e1013b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.501+0000 7f5e150cd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e101e5fd0 con 0x7f5e10144f60 2023-10-25T23:36:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.501+0000 7f5e150cd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e101429b0 con 0x7f5e100bdb00 2023-10-25T23:36:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.501+0000 7f5e150cd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e100ba340 con 0x7f5e100bb530 2023-10-25T23:36:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.501+0000 7f5e0f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e10144f60 0x7f5e1013b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.501+0000 7f5e0f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e10144f60 0x7f5e1013b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35960/0 (socket says 172.21.15.81:35960) 2023-10-25T23:36:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.501+0000 7f5e0f59e700 1 -- 172.21.15.81:0/74922067 learned_addr learned my addr 172.21.15.81:0/74922067 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.501+0000 7f5e0ed9d700 1 --2- 172.21.15.81:0/74922067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e100bb530 0x7f5e10142470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.501+0000 7f5e0e59c700 1 --2- 172.21.15.81:0/74922067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e100bdb00 0x7f5e1013fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.501+0000 7f5e0f59e700 1 -- 172.21.15.81:0/74922067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e100bb530 msgr2=0x7f5e10142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.501+0000 7f5e0f59e700 1 --2- 172.21.15.81:0/74922067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e100bb530 0x7f5e10142470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.501+0000 7f5e0f59e700 1 -- 172.21.15.81:0/74922067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e100bdb00 msgr2=0x7f5e1013fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.501+0000 7f5e0f59e700 1 --2- 172.21.15.81:0/74922067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e100bdb00 0x7f5e1013fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.501+0000 7f5e0f59e700 1 -- 172.21.15.81:0/74922067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e000095f0 con 0x7f5e10144f60 2023-10-25T23:36:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.501+0000 7f5e0ed9d700 1 --2- 172.21.15.81:0/74922067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e100bb530 0x7f5e10142470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:36:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.501+0000 7f5e0f59e700 1 --2- 172.21.15.81:0/74922067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e10144f60 0x7f5e1013b5d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800cbc0 tx=0x7f5e0800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.502+0000 7f5e077fe700 1 -- 172.21.15.81:0/74922067 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e08003c00 con 0x7f5e10144f60 2023-10-25T23:36:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.502+0000 7f5e077fe700 1 -- 172.21.15.81:0/74922067 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5e08003d60 con 0x7f5e10144f60 2023-10-25T23:36:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.502+0000 7f5e150cd700 1 -- 172.21.15.81:0/74922067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e100ba060 con 0x7f5e10144f60 2023-10-25T23:36:02.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.502+0000 7f5e077fe700 1 -- 172.21.15.81:0/74922067 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0800ab20 con 0x7f5e10144f60 2023-10-25T23:36:02.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.502+0000 7f5e150cd700 1 -- 172.21.15.81:0/74922067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e101e5980 con 0x7f5e10144f60 2023-10-25T23:36:02.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.503+0000 7f5e150cd700 1 -- 172.21.15.81:0/74922067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e101e6140 con 0x7f5e10144f60 2023-10-25T23:36:02.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.503+0000 7f5e077fe700 1 -- 172.21.15.81:0/74922067 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5e0800ac80 con 0x7f5e10144f60 2023-10-25T23:36:02.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.503+0000 7f5e077fe700 1 --2- 172.21.15.81:0/74922067 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f5df006af00 0x7f5df006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:02.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.504+0000 7f5e077fe700 1 -- 172.21.15.81:0/74922067 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5e08089350 con 0x7f5e10144f60 2023-10-25T23:36:02.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.504+0000 7f5e0ed9d700 1 --2- 172.21.15.81:0/74922067 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f5df006af00 0x7f5df006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:02.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.504+0000 7f5e0ed9d700 1 --2- 172.21.15.81:0/74922067 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f5df006af00 0x7f5df006d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5df8009cb0 tx=0x7f5df8009260 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:02.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.508+0000 7f5e077fe700 1 -- 172.21.15.81:0/74922067 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5e080547e0 con 0x7f5e10144f60 2023-10-25T23:36:02.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.698+0000 7f5e150cd700 1 -- 172.21.15.81:0/74922067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5e1006dcc0 con 0x7f5e10144f60 2023-10-25T23:36:02.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.699+0000 7f5e077fe700 1 -- 172.21.15.81:0/74922067 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5e08057e00 con 0x7f5e10144f60 2023-10-25T23:36:02.701 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-25T23:36:02.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.700+0000 7f5e150cd700 1 -- 172.21.15.81:0/74922067 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f5df006af00 msgr2=0x7f5df006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:02.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.700+0000 7f5e150cd700 1 --2- 172.21.15.81:0/74922067 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f5df006af00 0x7f5df006d3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5df8009cb0 tx=0x7f5df8009260 comp rx=0 tx=0).stop 2023-10-25T23:36:02.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.700+0000 7f5e150cd700 1 -- 172.21.15.81:0/74922067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e10144f60 msgr2=0x7f5e1013b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:02.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.700+0000 7f5e150cd700 1 --2- 172.21.15.81:0/74922067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e10144f60 0x7f5e1013b5d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800cbc0 tx=0x7f5e0800ced0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.700+0000 7f5e150cd700 1 -- 172.21.15.81:0/74922067 shutdown_connections 2023-10-25T23:36:02.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.700+0000 7f5e150cd700 1 --2- 172.21.15.81:0/74922067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e10144f60 0x7f5e1013b5d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.700+0000 7f5e150cd700 1 --2- 172.21.15.81:0/74922067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e100bb530 0x7f5e10142470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.700+0000 7f5e150cd700 1 --2- 172.21.15.81:0/74922067 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f5df006af00 0x7f5df006d3c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.700+0000 7f5e150cd700 1 --2- 172.21.15.81:0/74922067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e100bdb00 0x7f5e1013fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.700+0000 7f5e150cd700 1 -- 172.21.15.81:0/74922067 >> 172.21.15.81:0/74922067 conn(0x7f5e1006b320 msgr2=0x7f5e10144500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:02.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.701+0000 7f5e150cd700 1 -- 172.21.15.81:0/74922067 shutdown_connections 2023-10-25T23:36:02.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.701+0000 7f5e150cd700 1 -- 172.21.15.81:0/74922067 wait complete. 2023-10-25T23:36:02.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T23:36:02.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.836+0000 7fe82399d700 1 -- 172.21.15.81:0/2495824354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe808004030 msgr2=0x7fe808004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:02.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.836+0000 7fe82399d700 1 --2- 172.21.15.81:0/2495824354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe808004030 0x7fe808004850 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0bccb0 tx=0x7fe808005880 comp rx=0 tx=0).stop 2023-10-25T23:36:02.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.836+0000 7fe821f3a700 1 -- 172.21.15.81:0/2495824354 reap_dead start 2023-10-25T23:36:02.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.836+0000 7fe82399d700 1 -- 172.21.15.81:0/2495824354 shutdown_connections 2023-10-25T23:36:02.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.836+0000 7fe82399d700 1 -- 172.21.15.81:0/2495824354 >> 172.21.15.81:0/2495824354 conn(0x7fe81c06d8b0 msgr2=0x7fe81c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:02.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.836+0000 7fe82399d700 1 -- 172.21.15.81:0/2495824354 shutdown_connections 2023-10-25T23:36:02.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.836+0000 7fe82399d700 1 -- 172.21.15.81:0/2495824354 wait complete. 2023-10-25T23:36:02.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.837+0000 7fe82399d700 1 Processor -- start 2023-10-25T23:36:02.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.838+0000 7fe82399d700 1 -- start start 2023-10-25T23:36:02.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.838+0000 7fe82399d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe808004030 0x7fe81c0bf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:02.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.838+0000 7fe82399d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe81c0a55d0 0x7fe81c0b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:02.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.838+0000 7fe82399d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe81c0b9310 0x7fe81c0a4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:02.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.838+0000 7fe82399d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0b7a30 con 0x7fe81c0a55d0 2023-10-25T23:36:02.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.838+0000 7fe82399d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0b7790 con 0x7fe81c0b9310 2023-10-25T23:36:02.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.838+0000 7fe82399d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0bfe80 con 0x7fe808004030 2023-10-25T23:36:02.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.838+0000 7fe820f38700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe81c0a55d0 0x7fe81c0b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:02.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.838+0000 7fe820f38700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe81c0a55d0 0x7fe81c0b8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35980/0 (socket says 172.21.15.81:35980) 2023-10-25T23:36:02.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.838+0000 7fe820f38700 1 -- 172.21.15.81:0/944371716 learned_addr learned my addr 172.21.15.81:0/944371716 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:02.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.838+0000 7fe821f3a700 1 --2- 172.21.15.81:0/944371716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe81c0b9310 0x7fe81c0a4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:02.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.838+0000 7fe821739700 1 --2- 172.21.15.81:0/944371716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe808004030 0x7fe81c0bf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:02.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.839+0000 7fe820f38700 1 -- 172.21.15.81:0/944371716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe808004030 msgr2=0x7fe81c0bf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:02.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.839+0000 7fe820f38700 1 --2- 172.21.15.81:0/944371716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe808004030 0x7fe81c0bf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.839+0000 7fe820f38700 1 -- 172.21.15.81:0/944371716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe81c0b9310 msgr2=0x7fe81c0a4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:02.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.839+0000 7fe820f38700 1 --2- 172.21.15.81:0/944371716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe81c0b9310 0x7fe81c0a4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:02.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.839+0000 7fe820f38700 1 -- 172.21.15.81:0/944371716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c0b7d70 con 0x7fe81c0a55d0 2023-10-25T23:36:02.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.839+0000 7fe820f38700 1 --2- 172.21.15.81:0/944371716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe81c0a55d0 0x7fe81c0b8dd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe80c001820 tx=0x7fe80c00ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:02.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.839+0000 7fe811ffb700 1 -- 172.21.15.81:0/944371716 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c006650 con 0x7fe81c0a55d0 2023-10-25T23:36:02.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.839+0000 7fe811ffb700 1 -- 172.21.15.81:0/944371716 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe80c003680 con 0x7fe81c0a55d0 2023-10-25T23:36:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.839+0000 7fe811ffb700 1 -- 172.21.15.81:0/944371716 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c003a90 con 0x7fe81c0a55d0 2023-10-25T23:36:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.839+0000 7fe82399d700 1 -- 172.21.15.81:0/944371716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c0b8050 con 0x7fe81c0a55d0 2023-10-25T23:36:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.839+0000 7fe82399d700 1 -- 172.21.15.81:0/944371716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c0a4a80 con 0x7fe81c0a55d0 2023-10-25T23:36:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.840+0000 7fe82399d700 1 -- 172.21.15.81:0/944371716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81c067490 con 0x7fe81c0a55d0 2023-10-25T23:36:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.840+0000 7fe811ffb700 1 -- 172.21.15.81:0/944371716 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe80c022070 con 0x7fe81c0a55d0 2023-10-25T23:36:02.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.841+0000 7fe811ffb700 1 --2- 172.21.15.81:0/944371716 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe80006af00 0x7fe80006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.841+0000 7fe811ffb700 1 -- 172.21.15.81:0/944371716 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe80c08ab90 con 0x7fe81c0a55d0 2023-10-25T23:36:02.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.841+0000 7fe821739700 1 --2- 172.21.15.81:0/944371716 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe80006af00 0x7fe80006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:02.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.841+0000 7fe821739700 1 --2- 172.21.15.81:0/944371716 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe80006af00 0x7fe80006d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe818005fd0 tx=0x7fe81800b2e0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:02.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:02.845+0000 7fe811ffb700 1 -- 172.21.15.81:0/944371716 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe80c055fa0 con 0x7fe81c0a55d0 2023-10-25T23:36:03.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:03.078+0000 7fe82399d700 1 -- 172.21.15.81:0/944371716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe81c0b7bd0 con 0x7fe81c0a55d0 2023-10-25T23:36:03.080 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:03.079+0000 7fe811ffb700 1 -- 172.21.15.81:0/944371716 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7fe81c0b7bd0 con 0x7fe81c0a55d0 2023-10-25T23:36:03.081 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:03.081 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1640191478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1640191478},{"type":"v1","addr":"172.21.15.81:6835","nonce":1640191478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-25T23:36:03.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:03.081+0000 7fe82399d700 1 -- 172.21.15.81:0/944371716 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe80006af00 msgr2=0x7fe80006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:03.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:03.081+0000 7fe82399d700 1 --2- 172.21.15.81:0/944371716 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe80006af00 0x7fe80006d3c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe818005fd0 tx=0x7fe81800b2e0 comp rx=0 tx=0).stop 2023-10-25T23:36:03.083 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:03.081+0000 7fe82399d700 1 -- 172.21.15.81:0/944371716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe81c0a55d0 msgr2=0x7fe81c0b8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:03.081+0000 7fe82399d700 1 --2- 172.21.15.81:0/944371716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe81c0a55d0 0x7fe81c0b8dd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe80c001820 tx=0x7fe80c00ce40 comp rx=0 tx=0).stop 2023-10-25T23:36:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:03.081+0000 7fe82399d700 1 -- 172.21.15.81:0/944371716 shutdown_connections 2023-10-25T23:36:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:03.081+0000 7fe82399d700 1 --2- 172.21.15.81:0/944371716 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe80006af00 0x7fe80006d3c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:03.081+0000 7fe82399d700 1 --2- 172.21.15.81:0/944371716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe81c0b9310 0x7fe81c0a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:03.081+0000 7fe82399d700 1 --2- 172.21.15.81:0/944371716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe808004030 0x7fe81c0bf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:03.081+0000 7fe82399d700 1 --2- 172.21.15.81:0/944371716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe81c0a55d0 0x7fe81c0b8dd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:03.081+0000 7fe82399d700 1 -- 172.21.15.81:0/944371716 >> 172.21.15.81:0/944371716 conn(0x7fe81c06d8b0 msgr2=0x7fe81c147be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:03.081+0000 7fe82399d700 1 -- 172.21.15.81:0/944371716 shutdown_connections 2023-10-25T23:36:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:03.081+0000 7fe82399d700 1 -- 172.21.15.81:0/944371716 wait complete. 2023-10-25T23:36:03.085 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 2 2023-10-25T23:36:05.095 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T23:36:05.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.232+0000 7fd0af1b7700 1 -- 172.21.15.81:0/1025201437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a80bc390 msgr2=0x7fd0a806e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:05.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.232+0000 7fd0af1b7700 1 --2- 172.21.15.81:0/1025201437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a80bc390 0x7fd0a806e170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80be560 tx=0x7fd094009c70 comp rx=0 tx=0).stop 2023-10-25T23:36:05.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.232+0000 7fd0af1b7700 1 -- 172.21.15.81:0/1025201437 shutdown_connections 2023-10-25T23:36:05.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.232+0000 7fd0af1b7700 1 --2- 172.21.15.81:0/1025201437 >> v2:172.21.15.89:3300/0 conn(0x7fd0a80c1050 0x7fd0a80bd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.232+0000 7fd0af1b7700 1 --2- 172.21.15.81:0/1025201437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a80bc390 0x7fd0a806e170 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.232+0000 7fd0af1b7700 1 -- 172.21.15.81:0/1025201437 >> 172.21.15.81:0/1025201437 conn(0x7fd0a80c1b30 msgr2=0x7fd0a80c1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:05.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.232+0000 7fd0af1b7700 1 -- 172.21.15.81:0/1025201437 shutdown_connections 2023-10-25T23:36:05.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.232+0000 7fd0af1b7700 1 -- 172.21.15.81:0/1025201437 wait complete. 2023-10-25T23:36:05.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.233+0000 7fd0af1b7700 1 Processor -- start 2023-10-25T23:36:05.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.233+0000 7fd0af1b7700 1 -- start start 2023-10-25T23:36:05.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0af1b7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a806dd90 0x7fd0a80b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:05.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0af1b7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a80bc390 0x7fd0a80b9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:05.239 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0af1b7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a80c1050 0x7fd0a81e86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:05.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0af1b7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80b1a40 con 0x7fd0a806dd90 2023-10-25T23:36:05.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0af1b7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80b9490 con 0x7fd0a80c1050 2023-10-25T23:36:05.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0af1b7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80b1470 con 0x7fd0a80bc390 2023-10-25T23:36:05.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0acf53700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a806dd90 0x7fd0a80b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:05.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0acf53700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a806dd90 0x7fd0a80b0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35994/0 (socket says 172.21.15.81:35994) 2023-10-25T23:36:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0acf53700 1 -- 172.21.15.81:0/2928288811 learned_addr learned my addr 172.21.15.81:0/2928288811 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0a7fff700 1 --2- 172.21.15.81:0/2928288811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a80bc390 0x7fd0a80b9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0ad754700 1 --2- 172.21.15.81:0/2928288811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a80c1050 0x7fd0a81e86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0acf53700 1 -- 172.21.15.81:0/2928288811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a80bc390 msgr2=0x7fd0a80b9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0acf53700 1 --2- 172.21.15.81:0/2928288811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a80bc390 0x7fd0a80b9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0acf53700 1 -- 172.21.15.81:0/2928288811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a80c1050 msgr2=0x7fd0a81e86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0acf53700 1 --2- 172.21.15.81:0/2928288811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a80c1050 0x7fd0a81e86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0acf53700 1 -- 172.21.15.81:0/2928288811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0940095f0 con 0x7fd0a806dd90 2023-10-25T23:36:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0a7fff700 1 --2- 172.21.15.81:0/2928288811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a80bc390 0x7fd0a80b9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:36:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0ad754700 1 --2- 172.21.15.81:0/2928288811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a80c1050 0x7fd0a81e86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:36:05.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.234+0000 7fd0acf53700 1 --2- 172.21.15.81:0/2928288811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a806dd90 0x7fd0a80b0f30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00c580 tx=0x7fd09c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:05.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.235+0000 7fd0a57fa700 1 -- 172.21.15.81:0/2928288811 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c0054e0 con 0x7fd0a806dd90 2023-10-25T23:36:05.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.235+0000 7fd0a57fa700 1 -- 172.21.15.81:0/2928288811 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd09c003680 con 0x7fd0a806dd90 2023-10-25T23:36:05.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.235+0000 7fd0af1b7700 1 -- 172.21.15.81:0/2928288811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a80b8ed0 con 0x7fd0a806dd90 2023-10-25T23:36:05.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.235+0000 7fd0a57fa700 1 -- 172.21.15.81:0/2928288811 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c003a90 con 0x7fd0a806dd90 2023-10-25T23:36:05.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.235+0000 7fd0af1b7700 1 -- 172.21.15.81:0/2928288811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a81e8190 con 0x7fd0a806dd90 2023-10-25T23:36:05.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.236+0000 7fd0af1b7700 1 -- 172.21.15.81:0/2928288811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a804e4c0 con 0x7fd0a806dd90 2023-10-25T23:36:05.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.236+0000 7fd0a57fa700 1 -- 172.21.15.81:0/2928288811 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd09c003bf0 con 0x7fd0a806dd90 2023-10-25T23:36:05.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.236+0000 7fd0a57fa700 1 --2- 172.21.15.81:0/2928288811 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd08c06af00 0x7fd08c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:05.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.236+0000 7fd0a57fa700 1 -- 172.21.15.81:0/2928288811 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd09c088880 con 0x7fd0a806dd90 2023-10-25T23:36:05.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.237+0000 7fd0a7fff700 1 --2- 172.21.15.81:0/2928288811 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd08c06af00 0x7fd08c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:05.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.237+0000 7fd0a7fff700 1 --2- 172.21.15.81:0/2928288811 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd08c06af00 0x7fd08c06d3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0a806fda0 tx=0x7fd094011040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:05.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.241+0000 7fd0a57fa700 1 -- 172.21.15.81:0/2928288811 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd09c053c90 con 0x7fd0a806dd90 2023-10-25T23:36:05.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.473+0000 7fd0af1b7700 1 -- 172.21.15.81:0/2928288811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0a8067400 con 0x7fd0a806dd90 2023-10-25T23:36:05.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.473+0000 7fd0a57fa700 1 -- 172.21.15.81:0/2928288811 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7fd09c017e80 con 0x7fd0a806dd90 2023-10-25T23:36:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:05.476 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2649006434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2649006434},{"type":"v1","addr":"172.21.15.89:6836","nonce":2649006434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1805624382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1805624382},{"type":"v1","addr":"172.21.15.89:6837","nonce":1805624382}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/1925858148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1925858148},{"type":"v1","addr":"172.21.15.81:6834","nonce":1925858148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4350,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1640191478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1640191478},{"type":"v1","addr":"172.21.15.81:6835","nonce":1640191478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-25T23:36:05.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.475+0000 7fd0af1b7700 1 -- 172.21.15.81:0/2928288811 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd08c06af00 msgr2=0x7fd08c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:05.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.475+0000 7fd0af1b7700 1 --2- 172.21.15.81:0/2928288811 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd08c06af00 0x7fd08c06d3c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0a806fda0 tx=0x7fd094011040 comp rx=0 tx=0).stop 2023-10-25T23:36:05.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.475+0000 7fd0af1b7700 1 -- 172.21.15.81:0/2928288811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a806dd90 msgr2=0x7fd0a80b0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:05.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.475+0000 7fd0af1b7700 1 --2- 172.21.15.81:0/2928288811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a806dd90 0x7fd0a80b0f30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00c580 tx=0x7fd09c00c940 comp rx=0 tx=0).stop 2023-10-25T23:36:05.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.475+0000 7fd0af1b7700 1 -- 172.21.15.81:0/2928288811 shutdown_connections 2023-10-25T23:36:05.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.475+0000 7fd0af1b7700 1 --2- 172.21.15.81:0/2928288811 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd08c06af00 0x7fd08c06d3c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.475+0000 7fd0af1b7700 1 --2- 172.21.15.81:0/2928288811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0a80c1050 0x7fd0a81e86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.475+0000 7fd0af1b7700 1 --2- 172.21.15.81:0/2928288811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a806dd90 0x7fd0a80b0f30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.475+0000 7fd0af1b7700 1 --2- 172.21.15.81:0/2928288811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0a80bc390 0x7fd0a80b9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.475+0000 7fd0af1b7700 1 -- 172.21.15.81:0/2928288811 >> 172.21.15.81:0/2928288811 conn(0x7fd0a80c1b30 msgr2=0x7fd0a80b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.475+0000 7fd0af1b7700 1 -- 172.21.15.81:0/2928288811 shutdown_connections 2023-10-25T23:36:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.475+0000 7fd0af1b7700 1 -- 172.21.15.81:0/2928288811 wait complete. 2023-10-25T23:36:05.482 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 3 2023-10-25T23:36:05.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T23:36:05.611 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.609+0000 7f78596b8700 1 -- 172.21.15.81:0/3606214313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78541452a0 msgr2=0x7f785414e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.609+0000 7f78596b8700 1 --2- 172.21.15.81:0/3606214313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78541452a0 0x7f785414e6a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7854070a20 tx=0x7f784c00b330 comp rx=0 tx=0).stop 2023-10-25T23:36:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.609+0000 7f78596b8700 1 -- 172.21.15.81:0/3606214313 shutdown_connections 2023-10-25T23:36:05.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.609+0000 7f78596b8700 1 --2- 172.21.15.81:0/3606214313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78541452a0 0x7f785414e6a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.609+0000 7f78596b8700 1 --2- 172.21.15.81:0/3606214313 >> v2:172.21.15.89:3300/0 conn(0x7f78540bcfe0 0x7f78540b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.609+0000 7f78596b8700 1 -- 172.21.15.81:0/3606214313 >> 172.21.15.81:0/3606214313 conn(0x7f78540c0a30 msgr2=0x7f78540c0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:05.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.609+0000 7f78596b8700 1 -- 172.21.15.81:0/3606214313 shutdown_connections 2023-10-25T23:36:05.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.609+0000 7f78596b8700 1 -- 172.21.15.81:0/3606214313 wait complete. 2023-10-25T23:36:05.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.611+0000 7f78596b8700 1 Processor -- start 2023-10-25T23:36:05.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.611+0000 7f78596b8700 1 -- start start 2023-10-25T23:36:05.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.612+0000 7f78596b8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78540bcfe0 0x7f7854141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:05.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.612+0000 7f78596b8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7854144ec0 0x7f78541e6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:05.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.612+0000 7f78596b8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78541452a0 0x7f785406a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:05.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.612+0000 7f78596b8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78541e6570 con 0x7f78540bcfe0 2023-10-25T23:36:05.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.612+0000 7f78596b8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78541479f0 con 0x7f78541452a0 2023-10-25T23:36:05.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.612+0000 7f78596b8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7854147190 con 0x7f7854144ec0 2023-10-25T23:36:05.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.612+0000 7f7852ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78540bcfe0 0x7f7854141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:05.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.612+0000 7f7852ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78540bcfe0 0x7f7854141660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36008/0 (socket says 172.21.15.81:36008) 2023-10-25T23:36:05.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.612+0000 7f7852ffd700 1 -- 172.21.15.81:0/1265873214 learned_addr learned my addr 172.21.15.81:0/1265873214 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:05.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.612+0000 7f78537fe700 1 --2- 172.21.15.81:0/1265873214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78541452a0 0x7f785406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:05.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.612+0000 7f78527fc700 1 --2- 172.21.15.81:0/1265873214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7854144ec0 0x7f78541e6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:05.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.612+0000 7f7852ffd700 1 -- 172.21.15.81:0/1265873214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7854144ec0 msgr2=0x7f78541e6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:05.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.612+0000 7f7852ffd700 1 --2- 172.21.15.81:0/1265873214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7854144ec0 0x7f78541e6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.612+0000 7f7852ffd700 1 -- 172.21.15.81:0/1265873214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78541452a0 msgr2=0x7f785406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.612+0000 7f7852ffd700 1 --2- 172.21.15.81:0/1265873214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78541452a0 0x7f785406a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.612+0000 7f7852ffd700 1 -- 172.21.15.81:0/1265873214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c009c40 con 0x7f78540bcfe0 2023-10-25T23:36:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.612+0000 7f7852ffd700 1 --2- 172.21.15.81:0/1265873214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78540bcfe0 0x7f7854141660 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f784800c500 tx=0x7f784800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:05.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.612+0000 7f783b7fe700 1 -- 172.21.15.81:0/1265873214 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7848011790 con 0x7f78540bcfe0 2023-10-25T23:36:05.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.613+0000 7f783b7fe700 1 -- 172.21.15.81:0/1265873214 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f78480119e0 con 0x7f78540bcfe0 2023-10-25T23:36:05.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.613+0000 7f78596b8700 1 -- 172.21.15.81:0/1265873214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7854147430 con 0x7f78540bcfe0 2023-10-25T23:36:05.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.613+0000 7f783b7fe700 1 -- 172.21.15.81:0/1265873214 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7848011dd0 con 0x7f78540bcfe0 2023-10-25T23:36:05.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.613+0000 7f78596b8700 1 -- 172.21.15.81:0/1265873214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785413cd00 con 0x7f78540bcfe0 2023-10-25T23:36:05.622 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.613+0000 7f78596b8700 1 -- 172.21.15.81:0/1265873214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785404e4c0 con 0x7f78540bcfe0 2023-10-25T23:36:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.614+0000 7f783b7fe700 1 -- 172.21.15.81:0/1265873214 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f784801c460 con 0x7f78540bcfe0 2023-10-25T23:36:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.614+0000 7f783b7fe700 1 --2- 172.21.15.81:0/1265873214 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f784006af00 0x7f784006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.614+0000 7f783b7fe700 1 -- 172.21.15.81:0/1265873214 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f78480892b0 con 0x7f78540bcfe0 2023-10-25T23:36:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.614+0000 7f78527fc700 1 --2- 172.21.15.81:0/1265873214 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f784006af00 0x7f784006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.615+0000 7f78527fc700 1 --2- 172.21.15.81:0/1265873214 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f784006af00 0x7f784006d3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7844005fd0 tx=0x7f7844005d90 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.619+0000 7f783b7fe700 1 -- 172.21.15.81:0/1265873214 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7848054740 con 0x7f78540bcfe0 2023-10-25T23:36:05.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.809+0000 7f78596b8700 1 -- 172.21.15.81:0/1265873214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f785414bea0 con 0x7f78540bcfe0 2023-10-25T23:36:05.811 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.810+0000 7f783b7fe700 1 -- 172.21.15.81:0/1265873214 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12802 (secure 0 0 0) 0x7f7848057d60 con 0x7f78540bcfe0 2023-10-25T23:36:05.812 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:05.812 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"fsid":"97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf","created":"2023-10-25T23:35:42.986840+0000","modified":"2023-10-25T23:35:59.215088+0000","last_up_change":"2023-10-25T23:35:55.052199+0000","last_in_change":"2023-10-25T23:35:46.443490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T23:35:57.031170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48415836-8f22-4dcd-baa3-1d09c90c9a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6809","nonce":1045657984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6811","nonce":1045657984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6815","nonce":1045657984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6813","nonce":1045657984}]},"public_addr":"172.21.15.81:6809/1045657984","cluster_addr":"172.21.15.81:6811/1045657984","heartbeat_back_addr":"172.21.15.81:6815/1045657984","heartbeat_front_addr":"172.21.15.81:6813/1045657984","state":["exists","up"]},{"osd":1,"uuid":"19a4f6b5-e75c-45ae-aa08-b3467e69eed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6801","nonce":725386907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6803","nonce":725386907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6807","nonce":725386907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6805","nonce":725386907}]},"public_addr":"172.21.15.81:6801/725386907","cluster_addr":"172.21.15.81:6803/725386907","heartbeat_back_addr":"172.21.15.81:6807/725386907","heartbeat_front_addr":"172.21.15.81:6805/725386907","state":["exists","up"]},{"osd":2,"uuid":"60645312-54f5-4a74-ae52-68d17ff2d6e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6825","nonce":1744054610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6827","nonce":1744054610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6831","nonce":1744054610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6829","nonce":1744054610}]},"public_addr":"172.21.15.81:6825/1744054610","cluster_addr":"172.21.15.81:6827/1744054610","heartbeat_back_addr":"172.21.15.81:6831/1744054610","heartbeat_front_addr":"172.21.15.81:6829/1744054610","state":["exists","up"]},{"osd":3,"uuid":"c636a4a2-c1e8-4306-a78b-fe37eebab526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6817","nonce":1391123341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6819","nonce":1391123341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6823","nonce":1391123341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6821","nonce":1391123341}]},"public_addr":"172.21.15.81:6817/1391123341","cluster_addr":"172.21.15.81:6819/1391123341","heartbeat_back_addr":"172.21.15.81:6823/1391123341","heartbeat_front_addr":"172.21.15.81:6821/1391123341","state":["exists","up"]},{"osd":4,"uuid":"3cafc826-e531-4aa7-8b2a-b592f318f138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6817","nonce":1232781703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6819","nonce":1232781703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6823","nonce":1232781703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6821","nonce":1232781703}]},"public_addr":"172.21.15.89:6817/1232781703","cluster_addr":"172.21.15.89:6819/1232781703","heartbeat_back_addr":"172.21.15.89:6823/1232781703","heartbeat_front_addr":"172.21.15.89:6821/1232781703","state":["exists","up"]},{"osd":5,"uuid":"6098deb2-258e-47e1-b283-9a24c9dddf27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6801","nonce":2255820086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6803","nonce":2255820086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6807","nonce":2255820086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6805","nonce":2255820086}]},"public_addr":"172.21.15.89:6801/2255820086","cluster_addr":"172.21.15.89:6803/2255820086","heartbeat_back_addr":"172.21.15.89:6807/2255820086","heartbeat_front_addr":"172.21.15.89:6805/2255820086","state":["exists","up"]},{"osd":6,"uuid":"d79f68de-3c19-4f68-bbd1-59c8484dfaa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6809","nonce":2561967165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6811","nonce":2561967165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6815","nonce":2561967165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6813","nonce":2561967165}]},"public_addr":"172.21.15.89:6809/2561967165","cluster_addr":"172.21.15.89:6811/2561967165","heartbeat_back_addr":"172.21.15.89:6815/2561967165","heartbeat_front_addr":"172.21.15.89:6813/2561967165","state":["exists","up"]},{"osd":7,"uuid":"f1f7002e-4de9-4a08-97a1-fb52a116687f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6825","nonce":2647243500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6827","nonce":2647243500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6831","nonce":2647243500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6829","nonce":2647243500}]},"public_addr":"172.21.15.89:6825/2647243500","cluster_addr":"172.21.15.89:6827/2647243500","heartbeat_back_addr":"172.21.15.89:6831/2647243500","heartbeat_front_addr":"172.21.15.89:6829/2647243500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.613750+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.593515+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.713198+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.725623+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.686409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.596728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.670930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.676762+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T23:36:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.812+0000 7f78596b8700 1 -- 172.21.15.81:0/1265873214 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f784006af00 msgr2=0x7f784006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.812+0000 7f78596b8700 1 --2- 172.21.15.81:0/1265873214 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f784006af00 0x7f784006d3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7844005fd0 tx=0x7f7844005d90 comp rx=0 tx=0).stop 2023-10-25T23:36:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.812+0000 7f78596b8700 1 -- 172.21.15.81:0/1265873214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78540bcfe0 msgr2=0x7f7854141660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.812+0000 7f78596b8700 1 --2- 172.21.15.81:0/1265873214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78540bcfe0 0x7f7854141660 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f784800c500 tx=0x7f784800c8c0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.812+0000 7f78596b8700 1 -- 172.21.15.81:0/1265873214 shutdown_connections 2023-10-25T23:36:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.812+0000 7f78596b8700 1 --2- 172.21.15.81:0/1265873214 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f784006af00 0x7f784006d3c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.812+0000 7f78596b8700 1 --2- 172.21.15.81:0/1265873214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78541452a0 0x7f785406a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.812+0000 7f78596b8700 1 --2- 172.21.15.81:0/1265873214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78540bcfe0 0x7f7854141660 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.812+0000 7f78596b8700 1 --2- 172.21.15.81:0/1265873214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7854144ec0 0x7f78541e6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.812+0000 7f78596b8700 1 -- 172.21.15.81:0/1265873214 >> 172.21.15.81:0/1265873214 conn(0x7f78540c0a30 msgr2=0x7f78540c00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.812+0000 7f78596b8700 1 -- 172.21.15.81:0/1265873214 shutdown_connections 2023-10-25T23:36:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.812+0000 7f78596b8700 1 -- 172.21.15.81:0/1265873214 wait complete. 2023-10-25T23:36:05.827 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T23:35:57.031170+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T23:36:05.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T23:36:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.951+0000 7fd7bb014700 1 -- 172.21.15.81:0/2500947699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7b40bdb00 msgr2=0x7fd7b4155900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:05.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.951+0000 7fd7bb014700 1 --2- 172.21.15.81:0/2500947699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7b40bdb00 0x7fd7b4155900 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009fd0 tx=0x7fd7ac00b380 comp rx=0 tx=0).stop 2023-10-25T23:36:05.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.951+0000 7fd7bb014700 1 -- 172.21.15.81:0/2500947699 shutdown_connections 2023-10-25T23:36:05.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.951+0000 7fd7bb014700 1 --2- 172.21.15.81:0/2500947699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7b40bdb00 0x7fd7b4155900 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.951+0000 7fd7bb014700 1 --2- 172.21.15.81:0/2500947699 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7b40bb530 0x7fd7b40bd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.951+0000 7fd7bb014700 1 -- 172.21.15.81:0/2500947699 >> 172.21.15.81:0/2500947699 conn(0x7fd7b406b320 msgr2=0x7fd7b406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.951+0000 7fd7bb014700 1 -- 172.21.15.81:0/2500947699 shutdown_connections 2023-10-25T23:36:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.951+0000 7fd7bb014700 1 -- 172.21.15.81:0/2500947699 wait complete. 2023-10-25T23:36:05.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.952+0000 7fd7bb014700 1 Processor -- start 2023-10-25T23:36:05.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.952+0000 7fd7bb014700 1 -- start start 2023-10-25T23:36:05.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.953+0000 7fd7bb014700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7b40bb530 0x7fd7b41e4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.953+0000 7fd7bb014700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7b40bdb00 0x7fd7b406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.953+0000 7fd7bb014700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b4144f60 0x7fd7b4146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.953+0000 7fd7bb014700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b4145990 con 0x7fd7b40bdb00 2023-10-25T23:36:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.953+0000 7fd7bb014700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b406a9c0 con 0x7fd7b4144f60 2023-10-25T23:36:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.953+0000 7fd7bb014700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b41d5800 con 0x7fd7b40bb530 2023-10-25T23:36:05.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.953+0000 7fd7b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7b40bdb00 0x7fd7b406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:05.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.953+0000 7fd7b3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7b40bdb00 0x7fd7b406a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36024/0 (socket says 172.21.15.81:36024) 2023-10-25T23:36:05.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.953+0000 7fd7b3fff700 1 -- 172.21.15.81:0/3401965073 learned_addr learned my addr 172.21.15.81:0/3401965073 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:05.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.953+0000 7fd7b95b1700 1 --2- 172.21.15.81:0/3401965073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b4144f60 0x7fd7b4146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:05.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.953+0000 7fd7b8db0700 1 --2- 172.21.15.81:0/3401965073 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7b40bb530 0x7fd7b41e4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:05.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.953+0000 7fd7b3fff700 1 -- 172.21.15.81:0/3401965073 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7b40bb530 msgr2=0x7fd7b41e4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:05.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.953+0000 7fd7b3fff700 1 --2- 172.21.15.81:0/3401965073 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7b40bb530 0x7fd7b41e4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.953+0000 7fd7b3fff700 1 -- 172.21.15.81:0/3401965073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b4144f60 msgr2=0x7fd7b4146e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:05.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.953+0000 7fd7b3fff700 1 --2- 172.21.15.81:0/3401965073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b4144f60 0x7fd7b4146e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:05.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.953+0000 7fd7b3fff700 1 -- 172.21.15.81:0/3401965073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac009d00 con 0x7fd7b40bdb00 2023-10-25T23:36:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.954+0000 7fd7b3fff700 1 --2- 172.21.15.81:0/3401965073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7b40bdb00 0x7fd7b406a480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000d980 tx=0x7fd7a000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.954+0000 7fd7b17fa700 1 -- 172.21.15.81:0/3401965073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a000f890 con 0x7fd7b40bdb00 2023-10-25T23:36:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.954+0000 7fd7b17fa700 1 -- 172.21.15.81:0/3401965073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd7a000fae0 con 0x7fd7b40bdb00 2023-10-25T23:36:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.954+0000 7fd7bb014700 1 -- 172.21.15.81:0/3401965073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b41d5ae0 con 0x7fd7b40bdb00 2023-10-25T23:36:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.954+0000 7fd7b17fa700 1 -- 172.21.15.81:0/3401965073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0010460 con 0x7fd7b40bdb00 2023-10-25T23:36:05.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.954+0000 7fd7bb014700 1 -- 172.21.15.81:0/3401965073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b41d60a0 con 0x7fd7b40bdb00 2023-10-25T23:36:05.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.955+0000 7fd7bb014700 1 -- 172.21.15.81:0/3401965073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b41d6410 con 0x7fd7b40bdb00 2023-10-25T23:36:05.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.955+0000 7fd7b17fa700 1 -- 172.21.15.81:0/3401965073 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd7a00105c0 con 0x7fd7b40bdb00 2023-10-25T23:36:05.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.955+0000 7fd7b17fa700 1 --2- 172.21.15.81:0/3401965073 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd79806aed0 0x7fd79806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:05.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.956+0000 7fd7b17fa700 1 -- 172.21.15.81:0/3401965073 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd7a0089430 con 0x7fd7b40bdb00 2023-10-25T23:36:05.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.956+0000 7fd7b8db0700 1 --2- 172.21.15.81:0/3401965073 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd79806aed0 0x7fd79806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:05.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.956+0000 7fd7b8db0700 1 --2- 172.21.15.81:0/3401965073 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd79806aed0 0x7fd79806d390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8007fd0 tx=0x7fd7a8009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:05.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:05.960+0000 7fd7b17fa700 1 -- 172.21.15.81:0/3401965073 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd7a00548c0 con 0x7fd7b40bdb00 2023-10-25T23:36:06.151 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.149+0000 7fd7bb014700 1 -- 172.21.15.81:0/3401965073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7b4146b20 con 0x7fd7b40bdb00 2023-10-25T23:36:06.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.150+0000 7fd7b17fa700 1 -- 172.21.15.81:0/3401965073 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd7b4146b20 con 0x7fd7b40bdb00 2023-10-25T23:36:06.152 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-25T23:36:06.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.151+0000 7fd7bb014700 1 -- 172.21.15.81:0/3401965073 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd79806aed0 msgr2=0x7fd79806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:06.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.151+0000 7fd7bb014700 1 --2- 172.21.15.81:0/3401965073 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd79806aed0 0x7fd79806d390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8007fd0 tx=0x7fd7a8009040 comp rx=0 tx=0).stop 2023-10-25T23:36:06.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.151+0000 7fd7bb014700 1 -- 172.21.15.81:0/3401965073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7b40bdb00 msgr2=0x7fd7b406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:06.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.151+0000 7fd7bb014700 1 --2- 172.21.15.81:0/3401965073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7b40bdb00 0x7fd7b406a480 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7a000d980 tx=0x7fd7a000dc90 comp rx=0 tx=0).stop 2023-10-25T23:36:06.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.152+0000 7fd7bb014700 1 -- 172.21.15.81:0/3401965073 shutdown_connections 2023-10-25T23:36:06.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.152+0000 7fd7bb014700 1 --2- 172.21.15.81:0/3401965073 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd79806aed0 0x7fd79806d390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:06.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.152+0000 7fd7bb014700 1 --2- 172.21.15.81:0/3401965073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7b4144f60 0x7fd7b4146e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:06.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.152+0000 7fd7bb014700 1 --2- 172.21.15.81:0/3401965073 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7b40bb530 0x7fd7b41e4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:06.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.152+0000 7fd7bb014700 1 --2- 172.21.15.81:0/3401965073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7b40bdb00 0x7fd7b406a480 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:06.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.152+0000 7fd7bb014700 1 -- 172.21.15.81:0/3401965073 >> 172.21.15.81:0/3401965073 conn(0x7fd7b406b320 msgr2=0x7fd7b40bf4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:06.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.152+0000 7fd7bb014700 1 -- 172.21.15.81:0/3401965073 shutdown_connections 2023-10-25T23:36:06.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.152+0000 7fd7bb014700 1 -- 172.21.15.81:0/3401965073 wait complete. 2023-10-25T23:36:06.165 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-25T23:36:06.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.286+0000 7fa7437d8700 1 -- 172.21.15.81:0/2955515975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c0bc550 msgr2=0x7fa73c06b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:06.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.286+0000 7fa7437d8700 1 --2- 172.21.15.81:0/2955515975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c0bc550 0x7fa73c06b720 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0098c0 tx=0x7fa72c009bd0 comp rx=0 tx=0).stop 2023-10-25T23:36:06.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.286+0000 7fa7437d8700 1 -- 172.21.15.81:0/2955515975 shutdown_connections 2023-10-25T23:36:06.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.286+0000 7fa7437d8700 1 --2- 172.21.15.81:0/2955515975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c0bc550 0x7fa73c06b720 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:06.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.286+0000 7fa7437d8700 1 -- 172.21.15.81:0/2955515975 >> 172.21.15.81:0/2955515975 conn(0x7fa73c06d8b0 msgr2=0x7fa73c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:06.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.286+0000 7fa7437d8700 1 -- 172.21.15.81:0/2955515975 shutdown_connections 2023-10-25T23:36:06.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.286+0000 7fa7437d8700 1 -- 172.21.15.81:0/2955515975 wait complete. 2023-10-25T23:36:06.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.287+0000 7fa7437d8700 1 Processor -- start 2023-10-25T23:36:06.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.287+0000 7fa7437d8700 1 -- start start 2023-10-25T23:36:06.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.288+0000 7fa7437d8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c0a5ad0 0x7fa73c1e5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:06.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.288+0000 7fa7437d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa73c0bc550 0x7fa73c0a3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:06.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.288+0000 7fa7437d8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa73c1d1fc0 0x7fa73c142040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:06.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.288+0000 7fa7437d8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c1d2790 con 0x7fa73c0a5ad0 2023-10-25T23:36:06.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.288+0000 7fa7437d8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c1d3480 con 0x7fa73c1d1fc0 2023-10-25T23:36:06.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.288+0000 7fa7437d8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c1d24b0 con 0x7fa73c0bc550 2023-10-25T23:36:06.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.288+0000 7fa741574700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c0a5ad0 0x7fa73c1e5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:06.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.288+0000 7fa741574700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c0a5ad0 0x7fa73c1e5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36036/0 (socket says 172.21.15.81:36036) 2023-10-25T23:36:06.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.288+0000 7fa741574700 1 -- 172.21.15.81:0/3119773225 learned_addr learned my addr 172.21.15.81:0/3119773225 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:06.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.288+0000 7fa741574700 1 -- 172.21.15.81:0/3119773225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa73c0bc550 msgr2=0x7fa73c0a3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:06.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.288+0000 7fa741574700 1 --2- 172.21.15.81:0/3119773225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa73c0bc550 0x7fa73c0a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:06.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.288+0000 7fa741574700 1 -- 172.21.15.81:0/3119773225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa73c1d1fc0 msgr2=0x7fa73c142040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:06.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.288+0000 7fa741574700 1 --2- 172.21.15.81:0/3119773225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa73c1d1fc0 0x7fa73c142040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:06.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.288+0000 7fa741574700 1 -- 172.21.15.81:0/3119773225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c009520 con 0x7fa73c0a5ad0 2023-10-25T23:36:06.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.288+0000 7fa741574700 1 --2- 172.21.15.81:0/3119773225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c0a5ad0 0x7fa73c1e5250 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa72c004000 tx=0x7fa72c004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:06.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.288+0000 7fa731ffb700 1 -- 172.21.15.81:0/3119773225 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c00bab0 con 0x7fa73c0a5ad0 2023-10-25T23:36:06.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.288+0000 7fa731ffb700 1 -- 172.21.15.81:0/3119773225 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa72c00bd00 con 0x7fa73c0a5ad0 2023-10-25T23:36:06.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.288+0000 7fa7437d8700 1 -- 172.21.15.81:0/3119773225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c1e5b00 con 0x7fa73c0a5ad0 2023-10-25T23:36:06.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.289+0000 7fa731ffb700 1 -- 172.21.15.81:0/3119773225 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c00f6c0 con 0x7fa73c0a5ad0 2023-10-25T23:36:06.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.289+0000 7fa7437d8700 1 -- 172.21.15.81:0/3119773225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c1d2ba0 con 0x7fa73c0a5ad0 2023-10-25T23:36:06.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.290+0000 7fa7437d8700 1 -- 172.21.15.81:0/3119773225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c067490 con 0x7fa73c0a5ad0 2023-10-25T23:36:06.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.290+0000 7fa731ffb700 1 -- 172.21.15.81:0/3119773225 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa72c00f820 con 0x7fa73c0a5ad0 2023-10-25T23:36:06.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.290+0000 7fa731ffb700 1 --2- 172.21.15.81:0/3119773225 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa72006aed0 0x7fa72006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:06.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.290+0000 7fa731ffb700 1 -- 172.21.15.81:0/3119773225 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa72c08b4c0 con 0x7fa73c0a5ad0 2023-10-25T23:36:06.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.291+0000 7fa740d73700 1 --2- 172.21.15.81:0/3119773225 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa72006aed0 0x7fa72006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:06.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.291+0000 7fa740d73700 1 --2- 172.21.15.81:0/3119773225 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa72006aed0 0x7fa72006d390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa73c14ae20 tx=0x7fa738007a20 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:06.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.295+0000 7fa731ffb700 1 -- 172.21.15.81:0/3119773225 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa72c056950 con 0x7fa73c0a5ad0 2023-10-25T23:36:06.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.485+0000 7fa7437d8700 1 -- 172.21.15.81:0/3119773225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa73c04e4c0 con 0x7fa73c0a5ad0 2023-10-25T23:36:06.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.485+0000 7fa731ffb700 1 -- 172.21.15.81:0/3119773225 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa72c016e80 con 0x7fa73c0a5ad0 2023-10-25T23:36:06.487 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2023-10-25T23:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2023-10-25T23:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2023-10-25T23:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2023-10-25T23:36:06.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2023-10-25T23:36:06.489 INFO:teuthology.orchestra.run.smithi081.stdout:] 2023-10-25T23:36:06.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.487+0000 7fa7437d8700 1 -- 172.21.15.81:0/3119773225 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa72006aed0 msgr2=0x7fa72006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:06.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.487+0000 7fa7437d8700 1 --2- 172.21.15.81:0/3119773225 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa72006aed0 0x7fa72006d390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa73c14ae20 tx=0x7fa738007a20 comp rx=0 tx=0).stop 2023-10-25T23:36:06.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.487+0000 7fa7437d8700 1 -- 172.21.15.81:0/3119773225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c0a5ad0 msgr2=0x7fa73c1e5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:06.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.487+0000 7fa7437d8700 1 --2- 172.21.15.81:0/3119773225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c0a5ad0 0x7fa73c1e5250 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa72c004000 tx=0x7fa72c004310 comp rx=0 tx=0).stop 2023-10-25T23:36:06.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.487+0000 7fa7437d8700 1 -- 172.21.15.81:0/3119773225 shutdown_connections 2023-10-25T23:36:06.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.487+0000 7fa7437d8700 1 --2- 172.21.15.81:0/3119773225 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa72006aed0 0x7fa72006d390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:06.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.487+0000 7fa7437d8700 1 --2- 172.21.15.81:0/3119773225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa73c1d1fc0 0x7fa73c142040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:06.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.487+0000 7fa7437d8700 1 --2- 172.21.15.81:0/3119773225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c0a5ad0 0x7fa73c1e5250 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:06.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.487+0000 7fa7437d8700 1 --2- 172.21.15.81:0/3119773225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa73c0bc550 0x7fa73c0a3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:06.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.487+0000 7fa7437d8700 1 -- 172.21.15.81:0/3119773225 >> 172.21.15.81:0/3119773225 conn(0x7fa73c06d8b0 msgr2=0x7fa73c06dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:06.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.487+0000 7fa7437d8700 1 -- 172.21.15.81:0/3119773225 shutdown_connections 2023-10-25T23:36:06.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.487+0000 7fa7437d8700 1 -- 172.21.15.81:0/3119773225 wait complete. 2023-10-25T23:36:06.501 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-25T23:36:06.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-25T23:36:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.625+0000 7f3b5db89700 1 -- 172.21.15.81:0/162177085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b580b51e0 msgr2=0x7f3b5814ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.625+0000 7f3b5db89700 1 --2- 172.21.15.81:0/162177085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b580b51e0 0x7f3b5814ca00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3b48005fd0 tx=0x7f3b48009c70 comp rx=0 tx=0).stop 2023-10-25T23:36:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.625+0000 7f3b5db89700 1 -- 172.21.15.81:0/162177085 shutdown_connections 2023-10-25T23:36:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.625+0000 7f3b5db89700 1 --2- 172.21.15.81:0/162177085 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b5814cf40 0x7f3b58156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:06.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.625+0000 7f3b5db89700 1 --2- 172.21.15.81:0/162177085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b580b51e0 0x7f3b5814ca00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:06.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.625+0000 7f3b5db89700 1 -- 172.21.15.81:0/162177085 >> 172.21.15.81:0/162177085 conn(0x7f3b580c1b50 msgr2=0x7f3b580c1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:06.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.625+0000 7f3b5db89700 1 -- 172.21.15.81:0/162177085 shutdown_connections 2023-10-25T23:36:06.629 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.626+0000 7f3b5db89700 1 -- 172.21.15.81:0/162177085 wait complete. 2023-10-25T23:36:06.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.627+0000 7f3b5db89700 1 Processor -- start 2023-10-25T23:36:06.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.627+0000 7f3b5db89700 1 -- start start 2023-10-25T23:36:06.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.627+0000 7f3b5db89700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b58070160 0x7f3b580bb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:06.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.627+0000 7f3b5db89700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b580b51e0 0x7f3b581d58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:06.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.627+0000 7f3b5db89700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b5814cf40 0x7f3b58145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:06.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.627+0000 7f3b5db89700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580bb520 con 0x7f3b58070160 2023-10-25T23:36:06.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.627+0000 7f3b5db89700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580bab80 con 0x7f3b5814cf40 2023-10-25T23:36:06.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.627+0000 7f3b5db89700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580bae60 con 0x7f3b580b51e0 2023-10-25T23:36:06.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.627+0000 7f3b577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b58070160 0x7f3b580bb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:06.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.628+0000 7f3b577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b58070160 0x7f3b580bb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36050/0 (socket says 172.21.15.81:36050) 2023-10-25T23:36:06.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.628+0000 7f3b577fe700 1 -- 172.21.15.81:0/1688028847 learned_addr learned my addr 172.21.15.81:0/1688028847 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:06.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.628+0000 7f3b56ffd700 1 --2- 172.21.15.81:0/1688028847 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b580b51e0 0x7f3b581d58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:06.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.628+0000 7f3b57fff700 1 --2- 172.21.15.81:0/1688028847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b5814cf40 0x7f3b58145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:06.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.628+0000 7f3b577fe700 1 -- 172.21.15.81:0/1688028847 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b580b51e0 msgr2=0x7f3b581d58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:06.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.628+0000 7f3b577fe700 1 --2- 172.21.15.81:0/1688028847 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b580b51e0 0x7f3b581d58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:06.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.628+0000 7f3b577fe700 1 -- 172.21.15.81:0/1688028847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b5814cf40 msgr2=0x7f3b58145e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:06.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.628+0000 7f3b577fe700 1 --2- 172.21.15.81:0/1688028847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b5814cf40 0x7f3b58145e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:06.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.628+0000 7f3b577fe700 1 -- 172.21.15.81:0/1688028847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b480095f0 con 0x7f3b58070160 2023-10-25T23:36:06.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.628+0000 7f3b57fff700 1 --2- 172.21.15.81:0/1688028847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b5814cf40 0x7f3b58145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:36:06.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.628+0000 7f3b577fe700 1 --2- 172.21.15.81:0/1688028847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b58070160 0x7f3b580bb940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c00c4d0 tx=0x7f3b4c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:06.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.628+0000 7f3b3ffff700 1 -- 172.21.15.81:0/1688028847 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c011790 con 0x7f3b58070160 2023-10-25T23:36:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.628+0000 7f3b3ffff700 1 -- 172.21.15.81:0/1688028847 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3b4c0119e0 con 0x7f3b58070160 2023-10-25T23:36:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.628+0000 7f3b5db89700 1 -- 172.21.15.81:0/1688028847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b580bb140 con 0x7f3b58070160 2023-10-25T23:36:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.628+0000 7f3b3ffff700 1 -- 172.21.15.81:0/1688028847 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c011df0 con 0x7f3b58070160 2023-10-25T23:36:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.628+0000 7f3b5db89700 1 -- 172.21.15.81:0/1688028847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b581d82a0 con 0x7f3b58070160 2023-10-25T23:36:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.629+0000 7f3b5db89700 1 -- 172.21.15.81:0/1688028847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b58067490 con 0x7f3b58070160 2023-10-25T23:36:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.629+0000 7f3b3ffff700 1 -- 172.21.15.81:0/1688028847 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3b4c01c460 con 0x7f3b58070160 2023-10-25T23:36:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.630+0000 7f3b3ffff700 1 --2- 172.21.15.81:0/1688028847 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f3b4406aed0 0x7f3b4406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.630+0000 7f3b3ffff700 1 -- 172.21.15.81:0/1688028847 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3b4c089350 con 0x7f3b58070160 2023-10-25T23:36:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.630+0000 7f3b56ffd700 1 --2- 172.21.15.81:0/1688028847 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f3b4406aed0 0x7f3b4406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:06.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.630+0000 7f3b56ffd700 1 --2- 172.21.15.81:0/1688028847 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f3b4406aed0 0x7f3b4406d390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3b48000c00 tx=0x7f3b480047c0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:06.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.634+0000 7f3b3ffff700 1 -- 172.21.15.81:0/1688028847 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3b4c0547e0 con 0x7f3b58070160 2023-10-25T23:36:06.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:06.823+0000 7f3b5db89700 1 -- 172.21.15.81:0/1688028847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3b580bb790 con 0x7f3b58070160 2023-10-25T23:36:07.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:36:07.072 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:36:07.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.250+0000 7f3b3ffff700 1 -- 172.21.15.81:0/1688028847 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3b4c057e00 con 0x7f3b58070160 2023-10-25T23:36:07.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.252+0000 7f3b5db89700 1 -- 172.21.15.81:0/1688028847 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f3b4406aed0 msgr2=0x7f3b4406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:07.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.252+0000 7f3b5db89700 1 --2- 172.21.15.81:0/1688028847 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f3b4406aed0 0x7f3b4406d390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3b48000c00 tx=0x7f3b480047c0 comp rx=0 tx=0).stop 2023-10-25T23:36:07.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.252+0000 7f3b5db89700 1 -- 172.21.15.81:0/1688028847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b58070160 msgr2=0x7f3b580bb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:07.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.252+0000 7f3b5db89700 1 --2- 172.21.15.81:0/1688028847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b58070160 0x7f3b580bb940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c00c4d0 tx=0x7f3b4c00c890 comp rx=0 tx=0).stop 2023-10-25T23:36:07.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.252+0000 7f3b5db89700 1 -- 172.21.15.81:0/1688028847 shutdown_connections 2023-10-25T23:36:07.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.252+0000 7f3b5db89700 1 --2- 172.21.15.81:0/1688028847 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f3b4406aed0 0x7f3b4406d390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:07.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.252+0000 7f3b5db89700 1 --2- 172.21.15.81:0/1688028847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b5814cf40 0x7f3b58145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:07.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.252+0000 7f3b5db89700 1 --2- 172.21.15.81:0/1688028847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b58070160 0x7f3b580bb940 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:07.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.252+0000 7f3b5db89700 1 --2- 172.21.15.81:0/1688028847 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b580b51e0 0x7f3b581d58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:07.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.252+0000 7f3b5db89700 1 -- 172.21.15.81:0/1688028847 >> 172.21.15.81:0/1688028847 conn(0x7f3b580c1b50 msgr2=0x7f3b580c1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:07.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.252+0000 7f3b5db89700 1 -- 172.21.15.81:0/1688028847 shutdown_connections 2023-10-25T23:36:07.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.252+0000 7f3b5db89700 1 -- 172.21.15.81:0/1688028847 wait complete. 2023-10-25T23:36:07.258 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2023-10-25T23:36:07.271 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-25T23:36:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.398+0000 7f9b03f64700 1 -- 172.21.15.81:0/3285087801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae8004850 msgr2=0x7f9ae8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.398+0000 7f9b03f64700 1 --2- 172.21.15.81:0/3285087801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae8004850 0x7f9ae8004cd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009c10 tx=0x7f9ae8005880 comp rx=0 tx=0).stop 2023-10-25T23:36:07.400 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.398+0000 7f9b02501700 1 -- 172.21.15.81:0/3285087801 reap_dead start 2023-10-25T23:36:07.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.398+0000 7f9b03f64700 1 -- 172.21.15.81:0/3285087801 shutdown_connections 2023-10-25T23:36:07.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.398+0000 7f9b03f64700 1 -- 172.21.15.81:0/3285087801 >> 172.21.15.81:0/3285087801 conn(0x7f9afc0c1a70 msgr2=0x7f9afc0c1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:07.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.398+0000 7f9b03f64700 1 -- 172.21.15.81:0/3285087801 shutdown_connections 2023-10-25T23:36:07.401 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.398+0000 7f9b03f64700 1 -- 172.21.15.81:0/3285087801 wait complete. 2023-10-25T23:36:07.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.399+0000 7f9b03f64700 1 Processor -- start 2023-10-25T23:36:07.404 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.399+0000 7f9b03f64700 1 -- start start 2023-10-25T23:36:07.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.400+0000 7f9b03f64700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ae8004850 0x7f9afc1d4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:07.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.400+0000 7f9b03f64700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9afc0a1940 0x7f9afc1d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:07.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.400+0000 7f9b03f64700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9afc0a1dc0 0x7f9afc1d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:07.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.400+0000 7f9b03f64700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc1d4330 con 0x7f9afc0a1940 2023-10-25T23:36:07.405 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.400+0000 7f9b03f64700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc0a7810 con 0x7f9ae8004850 2023-10-25T23:36:07.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.400+0000 7f9b03f64700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc1e6160 con 0x7f9afc0a1dc0 2023-10-25T23:36:07.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.400+0000 7f9b014ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9afc0a1940 0x7f9afc1d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:07.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.400+0000 7f9b014ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9afc0a1940 0x7f9afc1d26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36072/0 (socket says 172.21.15.81:36072) 2023-10-25T23:36:07.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.400+0000 7f9b014ff700 1 -- 172.21.15.81:0/1072931923 learned_addr learned my addr 172.21.15.81:0/1072931923 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:07.406 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.400+0000 7f9b02501700 1 --2- 172.21.15.81:0/1072931923 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9afc0a1dc0 0x7f9afc1d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.400+0000 7f9b01d00700 1 --2- 172.21.15.81:0/1072931923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ae8004850 0x7f9afc1d4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.401+0000 7f9b014ff700 1 -- 172.21.15.81:0/1072931923 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9afc0a1dc0 msgr2=0x7f9afc1d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.401+0000 7f9b014ff700 1 --2- 172.21.15.81:0/1072931923 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9afc0a1dc0 0x7f9afc1d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.401+0000 7f9b014ff700 1 -- 172.21.15.81:0/1072931923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ae8004850 msgr2=0x7f9afc1d4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.401+0000 7f9b014ff700 1 --2- 172.21.15.81:0/1072931923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ae8004850 0x7f9afc1d4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:07.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.401+0000 7f9b014ff700 1 -- 172.21.15.81:0/1072931923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc1d3d70 con 0x7f9afc0a1940 2023-10-25T23:36:07.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.401+0000 7f9b01d00700 1 --2- 172.21.15.81:0/1072931923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ae8004850 0x7f9afc1d4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:36:07.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.401+0000 7f9b014ff700 1 --2- 172.21.15.81:0/1072931923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9afc0a1940 0x7f9afc1d26c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009b00 tx=0x7f9af8005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:07.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.401+0000 7f9af27fc700 1 -- 172.21.15.81:0/1072931923 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8004830 con 0x7f9afc0a1940 2023-10-25T23:36:07.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.401+0000 7f9af27fc700 1 -- 172.21.15.81:0/1072931923 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9af80049d0 con 0x7f9afc0a1940 2023-10-25T23:36:07.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.401+0000 7f9b03f64700 1 -- 172.21.15.81:0/1072931923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9afc1d4050 con 0x7f9afc0a1940 2023-10-25T23:36:07.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.401+0000 7f9af27fc700 1 -- 172.21.15.81:0/1072931923 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8004be0 con 0x7f9afc0a1940 2023-10-25T23:36:07.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.401+0000 7f9b03f64700 1 -- 172.21.15.81:0/1072931923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9afc1e6440 con 0x7f9afc0a1940 2023-10-25T23:36:07.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.402+0000 7f9b03f64700 1 -- 172.21.15.81:0/1072931923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9afc0a21a0 con 0x7f9afc0a1940 2023-10-25T23:36:07.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.402+0000 7f9af27fc700 1 -- 172.21.15.81:0/1072931923 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9af8004d40 con 0x7f9afc0a1940 2023-10-25T23:36:07.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.403+0000 7f9af27fc700 1 --2- 172.21.15.81:0/1072931923 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9ae006aed0 0x7f9ae006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:07.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.403+0000 7f9af27fc700 1 -- 172.21.15.81:0/1072931923 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f9af8014070 con 0x7f9afc0a1940 2023-10-25T23:36:07.410 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.403+0000 7f9b01d00700 1 --2- 172.21.15.81:0/1072931923 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9ae006aed0 0x7f9ae006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.403+0000 7f9b01d00700 1 --2- 172.21.15.81:0/1072931923 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9ae006aed0 0x7f9ae006d390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0017e0 tx=0x7f9aec001190 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.407+0000 7f9af27fc700 1 -- 172.21.15.81:0/1072931923 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9af80561a0 con 0x7f9afc0a1940 2023-10-25T23:36:07.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:07.594+0000 7f9b03f64700 1 -- 172.21.15.81:0/1072931923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9afc04e4c0 con 0x7f9afc0a1940 2023-10-25T23:36:08.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.253+0000 7f9af27fc700 1 -- 172.21.15.81:0/1072931923 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9af80597c0 con 0x7f9afc0a1940 2023-10-25T23:36:08.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.256+0000 7f9b03f64700 1 -- 172.21.15.81:0/1072931923 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9ae006aed0 msgr2=0x7f9ae006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:08.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.256+0000 7f9b03f64700 1 --2- 172.21.15.81:0/1072931923 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9ae006aed0 0x7f9ae006d390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0017e0 tx=0x7f9aec001190 comp rx=0 tx=0).stop 2023-10-25T23:36:08.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.256+0000 7f9b03f64700 1 -- 172.21.15.81:0/1072931923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9afc0a1940 msgr2=0x7f9afc1d26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:08.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.256+0000 7f9b03f64700 1 --2- 172.21.15.81:0/1072931923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9afc0a1940 0x7f9afc1d26c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009b00 tx=0x7f9af8005dc0 comp rx=0 tx=0).stop 2023-10-25T23:36:08.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.256+0000 7f9b03f64700 1 -- 172.21.15.81:0/1072931923 shutdown_connections 2023-10-25T23:36:08.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.256+0000 7f9b03f64700 1 --2- 172.21.15.81:0/1072931923 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9afc0a1dc0 0x7f9afc1d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:08.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.256+0000 7f9b03f64700 1 --2- 172.21.15.81:0/1072931923 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9ae006aed0 0x7f9ae006d390 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:08.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.256+0000 7f9b03f64700 1 --2- 172.21.15.81:0/1072931923 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ae8004850 0x7f9afc1d4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:08.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.256+0000 7f9b03f64700 1 --2- 172.21.15.81:0/1072931923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9afc0a1940 0x7f9afc1d26c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:08.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.256+0000 7f9b03f64700 1 -- 172.21.15.81:0/1072931923 >> 172.21.15.81:0/1072931923 conn(0x7f9afc0c1a70 msgr2=0x7f9afc14be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:08.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.256+0000 7f9b03f64700 1 -- 172.21.15.81:0/1072931923 shutdown_connections 2023-10-25T23:36:08.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.256+0000 7f9b03f64700 1 -- 172.21.15.81:0/1072931923 wait complete. 2023-10-25T23:36:08.260 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2023-10-25T23:36:08.280 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-25T23:36:08.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.405+0000 7f328c759700 1 -- 172.21.15.81:0/1749322195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328414ef90 msgr2=0x7f3284071870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:08.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.405+0000 7f328c759700 1 --2- 172.21.15.81:0/1749322195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328414ef90 0x7f3284071870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f328406c240 tx=0x7f3280009c70 comp rx=0 tx=0).stop 2023-10-25T23:36:08.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.405+0000 7f328c759700 1 -- 172.21.15.81:0/1749322195 shutdown_connections 2023-10-25T23:36:08.408 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.405+0000 7f328c759700 1 --2- 172.21.15.81:0/1749322195 >> v2:172.21.15.89:3300/0 conn(0x7f3284153900 0x7f3284155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:08.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.405+0000 7f328c759700 1 --2- 172.21.15.81:0/1749322195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328414ef90 0x7f3284071870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:08.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.405+0000 7f328c759700 1 -- 172.21.15.81:0/1749322195 >> 172.21.15.81:0/1749322195 conn(0x7f32840c0050 msgr2=0x7f32840c0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:08.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.405+0000 7f328c759700 1 -- 172.21.15.81:0/1749322195 shutdown_connections 2023-10-25T23:36:08.409 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.405+0000 7f328c759700 1 -- 172.21.15.81:0/1749322195 wait complete. 2023-10-25T23:36:08.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.406+0000 7f328c759700 1 Processor -- start 2023-10-25T23:36:08.412 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.406+0000 7f328c759700 1 -- start start 2023-10-25T23:36:08.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.407+0000 7f328c759700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3284071490 0x7f32841e10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:08.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.407+0000 7f328c759700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328414ef90 0x7f328413f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:08.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.407+0000 7f328c759700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3284153900 0x7f3284144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:08.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.407+0000 7f328c759700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32841e4720 con 0x7f328414ef90 2023-10-25T23:36:08.413 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.407+0000 7f328c759700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328413fce0 con 0x7f3284071490 2023-10-25T23:36:08.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.407+0000 7f328c759700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32841e1690 con 0x7f3284153900 2023-10-25T23:36:08.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.407+0000 7f3289cf4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328414ef90 0x7f328413f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:08.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.407+0000 7f3289cf4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328414ef90 0x7f328413f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36086/0 (socket says 172.21.15.81:36086) 2023-10-25T23:36:08.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.407+0000 7f3289cf4700 1 -- 172.21.15.81:0/1817350155 learned_addr learned my addr 172.21.15.81:0/1817350155 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:08.414 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.407+0000 7f328a4f5700 1 --2- 172.21.15.81:0/1817350155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3284071490 0x7f32841e10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:08.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.407+0000 7f328acf6700 1 --2- 172.21.15.81:0/1817350155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3284153900 0x7f3284144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:08.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.407+0000 7f3289cf4700 1 -- 172.21.15.81:0/1817350155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3284153900 msgr2=0x7f3284144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:08.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.407+0000 7f3289cf4700 1 --2- 172.21.15.81:0/1817350155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3284153900 0x7f3284144490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:08.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.407+0000 7f3289cf4700 1 -- 172.21.15.81:0/1817350155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3284071490 msgr2=0x7f32841e10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:08.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.407+0000 7f3289cf4700 1 --2- 172.21.15.81:0/1817350155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3284071490 0x7f32841e10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:08.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.408+0000 7f3289cf4700 1 -- 172.21.15.81:0/1817350155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32800095f0 con 0x7f328414ef90 2023-10-25T23:36:08.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.408+0000 7f328acf6700 1 --2- 172.21.15.81:0/1817350155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3284153900 0x7f3284144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:36:08.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.408+0000 7f3289cf4700 1 --2- 172.21.15.81:0/1817350155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328414ef90 0x7f328413f7a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3284067330 tx=0x7f32800045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:08.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.408+0000 7f327affd700 1 -- 172.21.15.81:0/1817350155 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3280003a90 con 0x7f328414ef90 2023-10-25T23:36:08.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.408+0000 7f327affd700 1 -- 172.21.15.81:0/1817350155 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3280003d00 con 0x7f328414ef90 2023-10-25T23:36:08.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.408+0000 7f328c759700 1 -- 172.21.15.81:0/1817350155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32840b57d0 con 0x7f328414ef90 2023-10-25T23:36:08.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.408+0000 7f327affd700 1 -- 172.21.15.81:0/1817350155 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3280004a90 con 0x7f328414ef90 2023-10-25T23:36:08.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.408+0000 7f328c759700 1 -- 172.21.15.81:0/1817350155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32841e1c50 con 0x7f328414ef90 2023-10-25T23:36:08.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.409+0000 7f328c759700 1 -- 172.21.15.81:0/1817350155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32841e4860 con 0x7f328414ef90 2023-10-25T23:36:08.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.409+0000 7f327affd700 1 -- 172.21.15.81:0/1817350155 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f328000f460 con 0x7f328414ef90 2023-10-25T23:36:08.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.410+0000 7f327affd700 1 --2- 172.21.15.81:0/1817350155 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f326806aed0 0x7f326806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:08.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.410+0000 7f327affd700 1 -- 172.21.15.81:0/1817350155 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f328008d4b0 con 0x7f328414ef90 2023-10-25T23:36:08.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.410+0000 7f328a4f5700 1 --2- 172.21.15.81:0/1817350155 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f326806aed0 0x7f326806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:08.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.410+0000 7f328a4f5700 1 --2- 172.21.15.81:0/1817350155 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f326806aed0 0x7f326806d390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3274007fd0 tx=0x7f3274009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:08.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.414+0000 7f327affd700 1 -- 172.21.15.81:0/1817350155 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f32841e4860 con 0x7f328414ef90 2023-10-25T23:36:08.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:08.646+0000 7f328c759700 1 -- 172.21.15.81:0/1817350155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f32841e4860 con 0x7f328414ef90 2023-10-25T23:36:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.278+0000 7f327affd700 1 -- 172.21.15.81:0/1817350155 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f32841e4860 con 0x7f328414ef90 2023-10-25T23:36:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.286+0000 7f328c759700 1 -- 172.21.15.81:0/1817350155 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f326806aed0 msgr2=0x7f326806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.286+0000 7f328c759700 1 --2- 172.21.15.81:0/1817350155 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f326806aed0 0x7f326806d390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3274007fd0 tx=0x7f3274009040 comp rx=0 tx=0).stop 2023-10-25T23:36:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.286+0000 7f328c759700 1 -- 172.21.15.81:0/1817350155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328414ef90 msgr2=0x7f328413f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.286+0000 7f328c759700 1 --2- 172.21.15.81:0/1817350155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328414ef90 0x7f328413f7a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3284067330 tx=0x7f32800045f0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.286+0000 7f328c759700 1 -- 172.21.15.81:0/1817350155 shutdown_connections 2023-10-25T23:36:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.286+0000 7f328c759700 1 --2- 172.21.15.81:0/1817350155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3284153900 0x7f3284144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.286+0000 7f328c759700 1 --2- 172.21.15.81:0/1817350155 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f326806aed0 0x7f326806d390 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.286+0000 7f328c759700 1 --2- 172.21.15.81:0/1817350155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3284071490 0x7f32841e10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.286+0000 7f328c759700 1 --2- 172.21.15.81:0/1817350155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f328414ef90 0x7f328413f7a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.286+0000 7f328c759700 1 -- 172.21.15.81:0/1817350155 >> 172.21.15.81:0/1817350155 conn(0x7f32840c0050 msgr2=0x7f3284141800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.286+0000 7f328c759700 1 -- 172.21.15.81:0/1817350155 shutdown_connections 2023-10-25T23:36:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.286+0000 7f328c759700 1 -- 172.21.15.81:0/1817350155 wait complete. 2023-10-25T23:36:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 2 and data pool 3 2023-10-25T23:36:09.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T23:36:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.429+0000 7fc6cf7b8700 1 -- 172.21.15.81:0/4264542894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6b4004030 msgr2=0x7fc6b4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.429+0000 7fc6cf7b8700 1 --2- 172.21.15.81:0/4264542894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6b4004030 0x7fc6b4004850 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400c310 tx=0x7fc6b4005880 comp rx=0 tx=0).stop 2023-10-25T23:36:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.429+0000 7fc6cdd55700 1 -- 172.21.15.81:0/4264542894 reap_dead start 2023-10-25T23:36:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.429+0000 7fc6cf7b8700 1 -- 172.21.15.81:0/4264542894 shutdown_connections 2023-10-25T23:36:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.429+0000 7fc6cf7b8700 1 -- 172.21.15.81:0/4264542894 >> 172.21.15.81:0/4264542894 conn(0x7fc6c80c0a40 msgr2=0x7fc6c80c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.429+0000 7fc6cf7b8700 1 -- 172.21.15.81:0/4264542894 shutdown_connections 2023-10-25T23:36:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.429+0000 7fc6cf7b8700 1 -- 172.21.15.81:0/4264542894 wait complete. 2023-10-25T23:36:09.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.430+0000 7fc6cf7b8700 1 Processor -- start 2023-10-25T23:36:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.430+0000 7fc6cf7b8700 1 -- start start 2023-10-25T23:36:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6cf7b8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6b4004030 0x7fc6c806e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6cf7b8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c806e790 0x7fc6c81e1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6cf7b8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6c81e21c0 0x7fc6c80b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6cf7b8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c81e5bc0 con 0x7fc6c806e790 2023-10-25T23:36:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6cf7b8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c81e6050 con 0x7fc6b4004030 2023-10-25T23:36:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6cf7b8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8131650 con 0x7fc6c81e21c0 2023-10-25T23:36:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6ccd53700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c806e790 0x7fc6c81e1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6ccd53700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c806e790 0x7fc6c81e1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36120/0 (socket says 172.21.15.81:36120) 2023-10-25T23:36:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6ccd53700 1 -- 172.21.15.81:0/3034368939 learned_addr learned my addr 172.21.15.81:0/3034368939 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:09.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6cd554700 1 --2- 172.21.15.81:0/3034368939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6b4004030 0x7fc6c806e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:09.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6cdd55700 1 --2- 172.21.15.81:0/3034368939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6c81e21c0 0x7fc6c80b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:09.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6ccd53700 1 -- 172.21.15.81:0/3034368939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6c81e21c0 msgr2=0x7fc6c80b6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:09.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6ccd53700 1 --2- 172.21.15.81:0/3034368939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6c81e21c0 0x7fc6c80b6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6ccd53700 1 -- 172.21.15.81:0/3034368939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6b4004030 msgr2=0x7fc6c806e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:09.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6ccd53700 1 --2- 172.21.15.81:0/3034368939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6b4004030 0x7fc6c806e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6ccd53700 1 -- 172.21.15.81:0/3034368939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c8131370 con 0x7fc6c806e790 2023-10-25T23:36:09.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6ccd53700 1 --2- 172.21.15.81:0/3034368939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c806e790 0x7fc6c81e1c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4011000 tx=0x7fc6c400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:09.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6bdffb700 1 -- 172.21.15.81:0/3034368939 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4006650 con 0x7fc6c806e790 2023-10-25T23:36:09.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6bdffb700 1 -- 172.21.15.81:0/3034368939 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc6c4003680 con 0x7fc6c806e790 2023-10-25T23:36:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6bdffb700 1 -- 172.21.15.81:0/3034368939 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4003a90 con 0x7fc6c806e790 2023-10-25T23:36:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.431+0000 7fc6cf7b8700 1 -- 172.21.15.81:0/3034368939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c81e5290 con 0x7fc6c806e790 2023-10-25T23:36:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.432+0000 7fc6cf7b8700 1 -- 172.21.15.81:0/3034368939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c81e5850 con 0x7fc6c806e790 2023-10-25T23:36:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.432+0000 7fc6cf7b8700 1 -- 172.21.15.81:0/3034368939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c804e4c0 con 0x7fc6c806e790 2023-10-25T23:36:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.433+0000 7fc6bdffb700 1 -- 172.21.15.81:0/3034368939 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc6c4022070 con 0x7fc6c806e790 2023-10-25T23:36:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.433+0000 7fc6bdffb700 1 --2- 172.21.15.81:0/3034368939 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc6ac06aed0 0x7fc6ac06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.433+0000 7fc6bdffb700 1 -- 172.21.15.81:0/3034368939 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6c408b640 con 0x7fc6c806e790 2023-10-25T23:36:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.433+0000 7fc6cd554700 1 --2- 172.21.15.81:0/3034368939 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc6ac06aed0 0x7fc6ac06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.434+0000 7fc6cd554700 1 --2- 172.21.15.81:0/3034368939 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc6ac06aed0 0x7fc6ac06d390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8005fd0 tx=0x7fc6b800b2e0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:09.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.438+0000 7fc6bdffb700 1 -- 172.21.15.81:0/3034368939 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc6c4056800 con 0x7fc6c806e790 2023-10-25T23:36:09.627 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.626+0000 7fc6cf7b8700 1 -- 172.21.15.81:0/3034368939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6c81e5d00 con 0x7fc6c806e790 2023-10-25T23:36:09.628 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.627+0000 7fc6bdffb700 1 -- 172.21.15.81:0/3034368939 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7fc6c4059e20 con 0x7fc6c806e790 2023-10-25T23:36:09.629 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:09.629 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf","created":"2023-10-25T23:35:42.986840+0000","modified":"2023-10-25T23:36:08.648111+0000","last_up_change":"2023-10-25T23:35:55.052199+0000","last_in_change":"2023-10-25T23:35:46.443490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T23:35:57.031170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T23:36:06.841771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T23:36:07.613269+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48415836-8f22-4dcd-baa3-1d09c90c9a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6809","nonce":1045657984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6811","nonce":1045657984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6815","nonce":1045657984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6813","nonce":1045657984}]},"public_addr":"172.21.15.81:6809/1045657984","cluster_addr":"172.21.15.81:6811/1045657984","heartbeat_back_addr":"172.21.15.81:6815/1045657984","heartbeat_front_addr":"172.21.15.81:6813/1045657984","state":["exists","up"]},{"osd":1,"uuid":"19a4f6b5-e75c-45ae-aa08-b3467e69eed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6801","nonce":725386907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6803","nonce":725386907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6807","nonce":725386907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6805","nonce":725386907}]},"public_addr":"172.21.15.81:6801/725386907","cluster_addr":"172.21.15.81:6803/725386907","heartbeat_back_addr":"172.21.15.81:6807/725386907","heartbeat_front_addr":"172.21.15.81:6805/725386907","state":["exists","up"]},{"osd":2,"uuid":"60645312-54f5-4a74-ae52-68d17ff2d6e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6825","nonce":1744054610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6827","nonce":1744054610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6831","nonce":1744054610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6829","nonce":1744054610}]},"public_addr":"172.21.15.81:6825/1744054610","cluster_addr":"172.21.15.81:6827/1744054610","heartbeat_back_addr":"172.21.15.81:6831/1744054610","heartbeat_front_addr":"172.21.15.81:6829/1744054610","state":["exists","up"]},{"osd":3,"uuid":"c636a4a2-c1e8-4306-a78b-fe37eebab526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6817","nonce":1391123341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6819","nonce":1391123341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6823","nonce":1391123341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6821","nonce":1391123341}]},"public_addr":"172.21.15.81:6817/1391123341","cluster_addr":"172.21.15.81:6819/1391123341","heartbeat_back_addr":"172.21.15.81:6823/1391123341","heartbeat_front_addr":"172.21.15.81:6821/1391123341","state":["exists","up"]},{"osd":4,"uuid":"3cafc826-e531-4aa7-8b2a-b592f318f138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6817","nonce":1232781703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6819","nonce":1232781703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6823","nonce":1232781703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6821","nonce":1232781703}]},"public_addr":"172.21.15.89:6817/1232781703","cluster_addr":"172.21.15.89:6819/1232781703","heartbeat_back_addr":"172.21.15.89:6823/1232781703","heartbeat_front_addr":"172.21.15.89:6821/1232781703","state":["exists","up"]},{"osd":5,"uuid":"6098deb2-258e-47e1-b283-9a24c9dddf27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6801","nonce":2255820086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6803","nonce":2255820086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6807","nonce":2255820086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6805","nonce":2255820086}]},"public_addr":"172.21.15.89:6801/2255820086","cluster_addr":"172.21.15.89:6803/2255820086","heartbeat_back_addr":"172.21.15.89:6807/2255820086","heartbeat_front_addr":"172.21.15.89:6805/2255820086","state":["exists","up"]},{"osd":6,"uuid":"d79f68de-3c19-4f68-bbd1-59c8484dfaa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6809","nonce":2561967165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6811","nonce":2561967165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6815","nonce":2561967165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6813","nonce":2561967165}]},"public_addr":"172.21.15.89:6809/2561967165","cluster_addr":"172.21.15.89:6811/2561967165","heartbeat_back_addr":"172.21.15.89:6815/2561967165","heartbeat_front_addr":"172.21.15.89:6813/2561967165","state":["exists","up"]},{"osd":7,"uuid":"f1f7002e-4de9-4a08-97a1-fb52a116687f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6825","nonce":2647243500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6827","nonce":2647243500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6831","nonce":2647243500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6829","nonce":2647243500}]},"public_addr":"172.21.15.89:6825/2647243500","cluster_addr":"172.21.15.89:6827/2647243500","heartbeat_back_addr":"172.21.15.89:6831/2647243500","heartbeat_front_addr":"172.21.15.89:6829/2647243500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.613750+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.593515+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.713198+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.725623+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.686409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.596728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.670930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.676762+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T23:36:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.629+0000 7fc6cf7b8700 1 -- 172.21.15.81:0/3034368939 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc6ac06aed0 msgr2=0x7fc6ac06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.629+0000 7fc6cf7b8700 1 --2- 172.21.15.81:0/3034368939 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc6ac06aed0 0x7fc6ac06d390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8005fd0 tx=0x7fc6b800b2e0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.629+0000 7fc6cf7b8700 1 -- 172.21.15.81:0/3034368939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c806e790 msgr2=0x7fc6c81e1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.629+0000 7fc6cf7b8700 1 --2- 172.21.15.81:0/3034368939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c806e790 0x7fc6c81e1c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4011000 tx=0x7fc6c400ccb0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.629+0000 7fc6cf7b8700 1 -- 172.21.15.81:0/3034368939 shutdown_connections 2023-10-25T23:36:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.629+0000 7fc6cf7b8700 1 --2- 172.21.15.81:0/3034368939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6c81e21c0 0x7fc6c80b6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.629+0000 7fc6cf7b8700 1 --2- 172.21.15.81:0/3034368939 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc6ac06aed0 0x7fc6ac06d390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.629+0000 7fc6cf7b8700 1 --2- 172.21.15.81:0/3034368939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6b4004030 0x7fc6c806e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.629+0000 7fc6cf7b8700 1 --2- 172.21.15.81:0/3034368939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6c806e790 0x7fc6c81e1c80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.629+0000 7fc6cf7b8700 1 -- 172.21.15.81:0/3034368939 >> 172.21.15.81:0/3034368939 conn(0x7fc6c80c0a40 msgr2=0x7fc6c80be940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.629+0000 7fc6cf7b8700 1 -- 172.21.15.81:0/3034368939 shutdown_connections 2023-10-25T23:36:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.629+0000 7fc6cf7b8700 1 -- 172.21.15.81:0/3034368939 wait complete. 2023-10-25T23:36:09.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T23:36:09.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.762+0000 7f64cb060700 1 -- 172.21.15.81:0/4073247039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64c414bfd0 msgr2=0x7f64c4158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:09.764 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.762+0000 7f64cb060700 1 --2- 172.21.15.81:0/4073247039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64c414bfd0 0x7f64c4158f80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f64bc009fd0 tx=0x7f64bc00b380 comp rx=0 tx=0).stop 2023-10-25T23:36:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.762+0000 7f64cb060700 1 -- 172.21.15.81:0/4073247039 shutdown_connections 2023-10-25T23:36:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.762+0000 7f64cb060700 1 --2- 172.21.15.81:0/4073247039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64c414bfd0 0x7f64c4158f80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.762+0000 7f64cb060700 1 --2- 172.21.15.81:0/4073247039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64c406b8c0 0x7f64c414ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.762+0000 7f64cb060700 1 -- 172.21.15.81:0/4073247039 >> 172.21.15.81:0/4073247039 conn(0x7f64c40c0800 msgr2=0x7f64c40c0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.762+0000 7f64cb060700 1 -- 172.21.15.81:0/4073247039 shutdown_connections 2023-10-25T23:36:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.762+0000 7f64cb060700 1 -- 172.21.15.81:0/4073247039 wait complete. 2023-10-25T23:36:09.768 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.763+0000 7f64cb060700 1 Processor -- start 2023-10-25T23:36:09.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.763+0000 7f64cb060700 1 -- start start 2023-10-25T23:36:09.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.764+0000 7f64cb060700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64c406b4e0 0x7f64c40bdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:09.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.764+0000 7f64cb060700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64c406b8c0 0x7f64c40bc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:09.769 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.764+0000 7f64cb060700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64c414bfd0 0x7f64c41d65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:09.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.764+0000 7f64cb060700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c41e5c50 con 0x7f64c406b4e0 2023-10-25T23:36:09.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.764+0000 7f64cb060700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40bd680 con 0x7f64c414bfd0 2023-10-25T23:36:09.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.764+0000 7f64cb060700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c41e5970 con 0x7f64c406b8c0 2023-10-25T23:36:09.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.764+0000 7f64c8dfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64c406b4e0 0x7f64c40bdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:09.770 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.764+0000 7f64c8dfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64c406b4e0 0x7f64c40bdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36132/0 (socket says 172.21.15.81:36132) 2023-10-25T23:36:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.764+0000 7f64c8dfc700 1 -- 172.21.15.81:0/2135291998 learned_addr learned my addr 172.21.15.81:0/2135291998 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.764+0000 7f64c3fff700 1 --2- 172.21.15.81:0/2135291998 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64c406b8c0 0x7f64c40bc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.764+0000 7f64c95fd700 1 --2- 172.21.15.81:0/2135291998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64c414bfd0 0x7f64c41d65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.764+0000 7f64c8dfc700 1 -- 172.21.15.81:0/2135291998 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64c406b8c0 msgr2=0x7f64c40bc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.764+0000 7f64c8dfc700 1 --2- 172.21.15.81:0/2135291998 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64c406b8c0 0x7f64c40bc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.764+0000 7f64c8dfc700 1 -- 172.21.15.81:0/2135291998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64c414bfd0 msgr2=0x7f64c41d65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.764+0000 7f64c8dfc700 1 --2- 172.21.15.81:0/2135291998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64c414bfd0 0x7f64c41d65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.764+0000 7f64c8dfc700 1 -- 172.21.15.81:0/2135291998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc009d00 con 0x7f64c406b4e0 2023-10-25T23:36:09.772 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.764+0000 7f64c8dfc700 1 --2- 172.21.15.81:0/2135291998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64c406b4e0 0x7f64c40bdb10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f64b800c4e0 tx=0x7f64b800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:09.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.765+0000 7f64c17fa700 1 -- 172.21.15.81:0/2135291998 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b80052d0 con 0x7f64c406b4e0 2023-10-25T23:36:09.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.765+0000 7f64c17fa700 1 -- 172.21.15.81:0/2135291998 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f64b8005520 con 0x7f64c406b4e0 2023-10-25T23:36:09.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.765+0000 7f64cb060700 1 -- 172.21.15.81:0/2135291998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c40bb220 con 0x7f64c406b4e0 2023-10-25T23:36:09.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.765+0000 7f64c17fa700 1 -- 172.21.15.81:0/2135291998 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b80038e0 con 0x7f64c406b4e0 2023-10-25T23:36:09.773 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.765+0000 7f64cb060700 1 -- 172.21.15.81:0/2135291998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c41d5bd0 con 0x7f64c406b4e0 2023-10-25T23:36:09.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.766+0000 7f64cb060700 1 -- 172.21.15.81:0/2135291998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c40bb080 con 0x7f64c406b4e0 2023-10-25T23:36:09.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.766+0000 7f64c17fa700 1 -- 172.21.15.81:0/2135291998 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f64b8003a40 con 0x7f64c406b4e0 2023-10-25T23:36:09.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.766+0000 7f64c17fa700 1 --2- 172.21.15.81:0/2135291998 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f64a806aed0 0x7f64a806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:09.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.767+0000 7f64c17fa700 1 -- 172.21.15.81:0/2135291998 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64b8088ba0 con 0x7f64c406b4e0 2023-10-25T23:36:09.774 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.767+0000 7f64c3fff700 1 --2- 172.21.15.81:0/2135291998 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f64a806aed0 0x7f64a806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:09.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.767+0000 7f64c3fff700 1 --2- 172.21.15.81:0/2135291998 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f64a806aed0 0x7f64a806d390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f64c41d8c90 tx=0x7f64b000b410 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:09.775 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.771+0000 7f64c17fa700 1 -- 172.21.15.81:0/2135291998 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f64c40bb080 con 0x7f64c406b4e0 2023-10-25T23:36:09.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.961+0000 7f64cb060700 1 -- 172.21.15.81:0/2135291998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64c40bb080 con 0x7f64c406b4e0 2023-10-25T23:36:09.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.962+0000 7f64c17fa700 1 -- 172.21.15.81:0/2135291998 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16470 (secure 0 0 0) 0x7f64c40bb080 con 0x7f64c406b4e0 2023-10-25T23:36:09.965 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:09.965 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf","created":"2023-10-25T23:35:42.986840+0000","modified":"2023-10-25T23:36:08.648111+0000","last_up_change":"2023-10-25T23:35:55.052199+0000","last_in_change":"2023-10-25T23:35:46.443490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T23:35:57.031170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T23:36:06.841771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T23:36:07.613269+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48415836-8f22-4dcd-baa3-1d09c90c9a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6809","nonce":1045657984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6811","nonce":1045657984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6815","nonce":1045657984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6813","nonce":1045657984}]},"public_addr":"172.21.15.81:6809/1045657984","cluster_addr":"172.21.15.81:6811/1045657984","heartbeat_back_addr":"172.21.15.81:6815/1045657984","heartbeat_front_addr":"172.21.15.81:6813/1045657984","state":["exists","up"]},{"osd":1,"uuid":"19a4f6b5-e75c-45ae-aa08-b3467e69eed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6801","nonce":725386907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6803","nonce":725386907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6807","nonce":725386907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6805","nonce":725386907}]},"public_addr":"172.21.15.81:6801/725386907","cluster_addr":"172.21.15.81:6803/725386907","heartbeat_back_addr":"172.21.15.81:6807/725386907","heartbeat_front_addr":"172.21.15.81:6805/725386907","state":["exists","up"]},{"osd":2,"uuid":"60645312-54f5-4a74-ae52-68d17ff2d6e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6825","nonce":1744054610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6827","nonce":1744054610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6831","nonce":1744054610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6829","nonce":1744054610}]},"public_addr":"172.21.15.81:6825/1744054610","cluster_addr":"172.21.15.81:6827/1744054610","heartbeat_back_addr":"172.21.15.81:6831/1744054610","heartbeat_front_addr":"172.21.15.81:6829/1744054610","state":["exists","up"]},{"osd":3,"uuid":"c636a4a2-c1e8-4306-a78b-fe37eebab526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6817","nonce":1391123341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6819","nonce":1391123341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6823","nonce":1391123341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6821","nonce":1391123341}]},"public_addr":"172.21.15.81:6817/1391123341","cluster_addr":"172.21.15.81:6819/1391123341","heartbeat_back_addr":"172.21.15.81:6823/1391123341","heartbeat_front_addr":"172.21.15.81:6821/1391123341","state":["exists","up"]},{"osd":4,"uuid":"3cafc826-e531-4aa7-8b2a-b592f318f138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6817","nonce":1232781703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6819","nonce":1232781703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6823","nonce":1232781703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6821","nonce":1232781703}]},"public_addr":"172.21.15.89:6817/1232781703","cluster_addr":"172.21.15.89:6819/1232781703","heartbeat_back_addr":"172.21.15.89:6823/1232781703","heartbeat_front_addr":"172.21.15.89:6821/1232781703","state":["exists","up"]},{"osd":5,"uuid":"6098deb2-258e-47e1-b283-9a24c9dddf27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6801","nonce":2255820086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6803","nonce":2255820086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6807","nonce":2255820086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6805","nonce":2255820086}]},"public_addr":"172.21.15.89:6801/2255820086","cluster_addr":"172.21.15.89:6803/2255820086","heartbeat_back_addr":"172.21.15.89:6807/2255820086","heartbeat_front_addr":"172.21.15.89:6805/2255820086","state":["exists","up"]},{"osd":6,"uuid":"d79f68de-3c19-4f68-bbd1-59c8484dfaa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6809","nonce":2561967165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6811","nonce":2561967165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6815","nonce":2561967165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6813","nonce":2561967165}]},"public_addr":"172.21.15.89:6809/2561967165","cluster_addr":"172.21.15.89:6811/2561967165","heartbeat_back_addr":"172.21.15.89:6815/2561967165","heartbeat_front_addr":"172.21.15.89:6813/2561967165","state":["exists","up"]},{"osd":7,"uuid":"f1f7002e-4de9-4a08-97a1-fb52a116687f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6825","nonce":2647243500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6827","nonce":2647243500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6831","nonce":2647243500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6829","nonce":2647243500}]},"public_addr":"172.21.15.89:6825/2647243500","cluster_addr":"172.21.15.89:6827/2647243500","heartbeat_back_addr":"172.21.15.89:6831/2647243500","heartbeat_front_addr":"172.21.15.89:6829/2647243500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.613750+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.593515+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.713198+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.725623+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.686409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.596728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.670930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.676762+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T23:36:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.965+0000 7f64cb060700 1 -- 172.21.15.81:0/2135291998 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f64a806aed0 msgr2=0x7f64a806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.965+0000 7f64cb060700 1 --2- 172.21.15.81:0/2135291998 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f64a806aed0 0x7f64a806d390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f64c41d8c90 tx=0x7f64b000b410 comp rx=0 tx=0).stop 2023-10-25T23:36:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.965+0000 7f64cb060700 1 -- 172.21.15.81:0/2135291998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64c406b4e0 msgr2=0x7f64c40bdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.965+0000 7f64cb060700 1 --2- 172.21.15.81:0/2135291998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64c406b4e0 0x7f64c40bdb10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f64b800c4e0 tx=0x7f64b800c7f0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.965+0000 7f64cb060700 1 -- 172.21.15.81:0/2135291998 shutdown_connections 2023-10-25T23:36:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.965+0000 7f64cb060700 1 --2- 172.21.15.81:0/2135291998 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f64a806aed0 0x7f64a806d390 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.965+0000 7f64cb060700 1 --2- 172.21.15.81:0/2135291998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64c414bfd0 0x7f64c41d65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.965+0000 7f64cb060700 1 --2- 172.21.15.81:0/2135291998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64c406b4e0 0x7f64c40bdb10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.965+0000 7f64cb060700 1 --2- 172.21.15.81:0/2135291998 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64c406b8c0 0x7f64c40bc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.965+0000 7f64cb060700 1 -- 172.21.15.81:0/2135291998 >> 172.21.15.81:0/2135291998 conn(0x7f64c40c0800 msgr2=0x7f64c4065fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.965+0000 7f64cb060700 1 -- 172.21.15.81:0/2135291998 shutdown_connections 2023-10-25T23:36:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:09.965+0000 7f64cb060700 1 -- 172.21.15.81:0/2135291998 wait complete. 2023-10-25T23:36:09.979 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-25T23:36:10.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.102+0000 7f9bd6b17700 1 -- 172.21.15.81:0/4043793099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd00bb530 msgr2=0x7f9bd00bd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:10.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.102+0000 7f9bd6b17700 1 --2- 172.21.15.81:0/4043793099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd00bb530 0x7f9bd00bd5c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9bd014b4b0 tx=0x7f9bbc009c70 comp rx=0 tx=0).stop 2023-10-25T23:36:10.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.102+0000 7f9bd6b17700 1 -- 172.21.15.81:0/4043793099 shutdown_connections 2023-10-25T23:36:10.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.102+0000 7f9bd6b17700 1 --2- 172.21.15.81:0/4043793099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd00bb530 0x7f9bd00bd5c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:10.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.102+0000 7f9bd6b17700 1 -- 172.21.15.81:0/4043793099 >> 172.21.15.81:0/4043793099 conn(0x7f9bd006b320 msgr2=0x7f9bd006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:10.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.102+0000 7f9bd6b17700 1 -- 172.21.15.81:0/4043793099 shutdown_connections 2023-10-25T23:36:10.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.102+0000 7f9bd6b17700 1 -- 172.21.15.81:0/4043793099 wait complete. 2023-10-25T23:36:10.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.103+0000 7f9bd6b17700 1 Processor -- start 2023-10-25T23:36:10.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.103+0000 7f9bd6b17700 1 -- start start 2023-10-25T23:36:10.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bd6b17700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bd00bb530 0x7f9bd006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:10.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bd6b17700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd00bdb00 0x7f9bd01d7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:10.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bd6b17700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9bd0144f60 0x7f9bd0143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:10.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bd6b17700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd0142940 con 0x7f9bd00bdb00 2023-10-25T23:36:10.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bd6b17700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd013c500 con 0x7f9bd00bb530 2023-10-25T23:36:10.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bd6b17700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd0142d60 con 0x7f9bd0144f60 2023-10-25T23:36:10.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bcffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd00bdb00 0x7f9bd01d7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:10.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bcffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd00bdb00 0x7f9bd01d7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36148/0 (socket says 172.21.15.81:36148) 2023-10-25T23:36:10.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bcffff700 1 -- 172.21.15.81:0/906931309 learned_addr learned my addr 172.21.15.81:0/906931309 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:10.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bd50b4700 1 --2- 172.21.15.81:0/906931309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9bd0144f60 0x7f9bd0143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:10.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bd48b3700 1 --2- 172.21.15.81:0/906931309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bd00bb530 0x7f9bd006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:10.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bcffff700 1 -- 172.21.15.81:0/906931309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9bd0144f60 msgr2=0x7f9bd0143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:10.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bcffff700 1 --2- 172.21.15.81:0/906931309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9bd0144f60 0x7f9bd0143150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:10.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bcffff700 1 -- 172.21.15.81:0/906931309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bd00bb530 msgr2=0x7f9bd006a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:10.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bcffff700 1 --2- 172.21.15.81:0/906931309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bd00bb530 0x7f9bd006a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:10.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bcffff700 1 -- 172.21.15.81:0/906931309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc0095f0 con 0x7f9bd00bdb00 2023-10-25T23:36:10.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bcffff700 1 --2- 172.21.15.81:0/906931309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd00bdb00 0x7f9bd01d7b90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc004000 tx=0x7f9bbc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:10.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bcd7fa700 1 -- 172.21.15.81:0/906931309 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc01c070 con 0x7f9bd00bdb00 2023-10-25T23:36:10.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bcd7fa700 1 -- 172.21.15.81:0/906931309 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9bbc003890 con 0x7f9bd00bdb00 2023-10-25T23:36:10.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bd6b17700 1 -- 172.21.15.81:0/906931309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd01e2dd0 con 0x7f9bd00bdb00 2023-10-25T23:36:10.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bcd7fa700 1 -- 172.21.15.81:0/906931309 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc003c80 con 0x7f9bd00bdb00 2023-10-25T23:36:10.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.104+0000 7f9bd6b17700 1 -- 172.21.15.81:0/906931309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd0142280 con 0x7f9bd00bdb00 2023-10-25T23:36:10.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.105+0000 7f9bd6b17700 1 -- 172.21.15.81:0/906931309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd0142a80 con 0x7f9bd00bdb00 2023-10-25T23:36:10.112 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.106+0000 7f9bcd7fa700 1 -- 172.21.15.81:0/906931309 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9bbc00f460 con 0x7f9bd00bdb00 2023-10-25T23:36:10.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.106+0000 7f9bcd7fa700 1 --2- 172.21.15.81:0/906931309 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9bb406af00 0x7f9bb406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:10.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.106+0000 7f9bcd7fa700 1 -- 172.21.15.81:0/906931309 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bbc08aa40 con 0x7f9bd00bdb00 2023-10-25T23:36:10.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.106+0000 7f9bd48b3700 1 --2- 172.21.15.81:0/906931309 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9bb406af00 0x7f9bb406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:10.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.107+0000 7f9bd48b3700 1 --2- 172.21.15.81:0/906931309 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9bb406af00 0x7f9bb406d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4000f60 tx=0x7f9bc4009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:10.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.110+0000 7f9bcd7fa700 1 -- 172.21.15.81:0/906931309 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9bd0142a80 con 0x7f9bd00bdb00 2023-10-25T23:36:10.348 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:10.347+0000 7f9bd6b17700 1 -- 172.21.15.81:0/906931309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9bd0142a80 con 0x7f9bd00bdb00 2023-10-25T23:36:11.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.294+0000 7f9bcd7fa700 1 -- 172.21.15.81:0/906931309 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9bd0142a80 con 0x7f9bd00bdb00 2023-10-25T23:36:11.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.297+0000 7f9bd6b17700 1 -- 172.21.15.81:0/906931309 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9bb406af00 msgr2=0x7f9bb406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:11.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.297+0000 7f9bd6b17700 1 --2- 172.21.15.81:0/906931309 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9bb406af00 0x7f9bb406d3c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4000f60 tx=0x7f9bc4009040 comp rx=0 tx=0).stop 2023-10-25T23:36:11.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.297+0000 7f9bd6b17700 1 -- 172.21.15.81:0/906931309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd00bdb00 msgr2=0x7f9bd01d7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:11.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.297+0000 7f9bd6b17700 1 --2- 172.21.15.81:0/906931309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd00bdb00 0x7f9bd01d7b90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc004000 tx=0x7f9bbc0042f0 comp rx=0 tx=0).stop 2023-10-25T23:36:11.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.297+0000 7f9bd6b17700 1 -- 172.21.15.81:0/906931309 shutdown_connections 2023-10-25T23:36:11.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.297+0000 7f9bd6b17700 1 --2- 172.21.15.81:0/906931309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9bd0144f60 0x7f9bd0143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:11.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.297+0000 7f9bd6b17700 1 --2- 172.21.15.81:0/906931309 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9bb406af00 0x7f9bb406d3c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:11.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.297+0000 7f9bd6b17700 1 --2- 172.21.15.81:0/906931309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9bd00bb530 0x7f9bd006a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:11.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.297+0000 7f9bd6b17700 1 --2- 172.21.15.81:0/906931309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bd00bdb00 0x7f9bd01d7b90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:11.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.297+0000 7f9bd6b17700 1 -- 172.21.15.81:0/906931309 >> 172.21.15.81:0/906931309 conn(0x7f9bd006b320 msgr2=0x7f9bd0144690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:11.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.297+0000 7f9bd6b17700 1 -- 172.21.15.81:0/906931309 shutdown_connections 2023-10-25T23:36:11.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.297+0000 7f9bd6b17700 1 -- 172.21.15.81:0/906931309 wait complete. 2023-10-25T23:36:11.314 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-25T23:36:11.315 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-25T23:36:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.447+0000 7f6efd90e700 1 -- 172.21.15.81:0/902431512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee0005210 msgr2=0x7f6ee000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.447+0000 7f6efd90e700 1 --2- 172.21.15.81:0/902431512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee0005210 0x7f6ee000ba10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0001e10 tx=0x7f6ee0005880 comp rx=0 tx=0).stop 2023-10-25T23:36:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.447+0000 7f6efd90e700 1 -- 172.21.15.81:0/902431512 shutdown_connections 2023-10-25T23:36:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.447+0000 7f6efd90e700 1 --2- 172.21.15.81:0/902431512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee0005210 0x7f6ee000ba10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.447+0000 7f6efd90e700 1 -- 172.21.15.81:0/902431512 >> 172.21.15.81:0/902431512 conn(0x7f6ef80be490 msgr2=0x7f6ef80be8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:11.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.447+0000 7f6efd90e700 1 -- 172.21.15.81:0/902431512 shutdown_connections 2023-10-25T23:36:11.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.447+0000 7f6efd90e700 1 -- 172.21.15.81:0/902431512 wait complete. 2023-10-25T23:36:11.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.449+0000 7f6efd90e700 1 Processor -- start 2023-10-25T23:36:11.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.449+0000 7f6efd90e700 1 -- start start 2023-10-25T23:36:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6efd90e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ee0005210 0x7f6ef814edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6efd90e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ef814f330 0x7f6ef80a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6efd90e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ef80a4000 0x7f6ef814d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6efd90e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef8150010 con 0x7f6ef80a4000 2023-10-25T23:36:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6efd90e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef81e2db0 con 0x7f6ef814f330 2023-10-25T23:36:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6efd90e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef814f7b0 con 0x7f6ee0005210 2023-10-25T23:36:11.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6ef77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ef80a4000 0x7f6ef814d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:11.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6ef77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ef80a4000 0x7f6ef814d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36170/0 (socket says 172.21.15.81:36170) 2023-10-25T23:36:11.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6ef77fe700 1 -- 172.21.15.81:0/203697030 learned_addr learned my addr 172.21.15.81:0/203697030 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:11.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6ef6ffd700 1 --2- 172.21.15.81:0/203697030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ee0005210 0x7f6ef814edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:11.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6ef67fc700 1 --2- 172.21.15.81:0/203697030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ef814f330 0x7f6ef80a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:11.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6ef77fe700 1 -- 172.21.15.81:0/203697030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ee0005210 msgr2=0x7f6ef814edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:11.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6ef77fe700 1 --2- 172.21.15.81:0/203697030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ee0005210 0x7f6ef814edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:11.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6ef77fe700 1 -- 172.21.15.81:0/203697030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ef814f330 msgr2=0x7f6ef80a3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:11.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6ef77fe700 1 --2- 172.21.15.81:0/203697030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ef814f330 0x7f6ef80a3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:11.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6ef77fe700 1 -- 172.21.15.81:0/203697030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef81462b0 con 0x7f6ef80a4000 2023-10-25T23:36:11.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6ef67fc700 1 --2- 172.21.15.81:0/203697030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ef814f330 0x7f6ef80a3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:36:11.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6ef77fe700 1 --2- 172.21.15.81:0/203697030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ef80a4000 0x7f6ef814d970 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6ef81469e0 tx=0x7f6ef0001340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:11.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6edffff700 1 -- 172.21.15.81:0/203697030 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0004ea0 con 0x7f6ef80a4000 2023-10-25T23:36:11.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6edffff700 1 -- 172.21.15.81:0/203697030 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6ef00061c0 con 0x7f6ef80a4000 2023-10-25T23:36:11.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6edffff700 1 -- 172.21.15.81:0/203697030 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef00065b0 con 0x7f6ef80a4000 2023-10-25T23:36:11.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.450+0000 7f6efd90e700 1 -- 172.21.15.81:0/203697030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef80a4480 con 0x7f6ef80a4000 2023-10-25T23:36:11.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.451+0000 7f6efd90e700 1 -- 172.21.15.81:0/203697030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef8146500 con 0x7f6ef80a4000 2023-10-25T23:36:11.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.451+0000 7f6efd90e700 1 -- 172.21.15.81:0/203697030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef8146690 con 0x7f6ef80a4000 2023-10-25T23:36:11.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.452+0000 7f6edffff700 1 -- 172.21.15.81:0/203697030 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6ef0017070 con 0x7f6ef80a4000 2023-10-25T23:36:11.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.452+0000 7f6edffff700 1 --2- 172.21.15.81:0/203697030 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6ee406aed0 0x7f6ee406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:11.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.452+0000 7f6edffff700 1 -- 172.21.15.81:0/203697030 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ef008ab20 con 0x7f6ef80a4000 2023-10-25T23:36:11.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.452+0000 7f6ef6ffd700 1 --2- 172.21.15.81:0/203697030 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6ee406aed0 0x7f6ee406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:11.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.453+0000 7f6ef6ffd700 1 --2- 172.21.15.81:0/203697030 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6ee406aed0 0x7f6ee406d390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009b00 tx=0x7f6eec009260 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:11.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.457+0000 7f6edffff700 1 -- 172.21.15.81:0/203697030 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ef0055c60 con 0x7f6ef80a4000 2023-10-25T23:36:11.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:11.694+0000 7f6efd90e700 1 -- 172.21.15.81:0/203697030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6ef804e4c0 con 0x7f6ef80a4000 2023-10-25T23:36:12.111 INFO:tasks.ceph.mds.c.smithi081.stderr:2023-10-25T23:36:12.109+0000 7fd17d7eb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-25T23:36:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.295+0000 7f6edffff700 1 -- 172.21.15.81:0/203697030 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6ef0015020 con 0x7f6ef80a4000 2023-10-25T23:36:12.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.298+0000 7f6efd90e700 1 -- 172.21.15.81:0/203697030 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6ee406aed0 msgr2=0x7f6ee406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:12.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.298+0000 7f6efd90e700 1 --2- 172.21.15.81:0/203697030 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6ee406aed0 0x7f6ee406d390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009b00 tx=0x7f6eec009260 comp rx=0 tx=0).stop 2023-10-25T23:36:12.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.298+0000 7f6efd90e700 1 -- 172.21.15.81:0/203697030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ef80a4000 msgr2=0x7f6ef814d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.298+0000 7f6efd90e700 1 --2- 172.21.15.81:0/203697030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ef80a4000 0x7f6ef814d970 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6ef81469e0 tx=0x7f6ef0001340 comp rx=0 tx=0).stop 2023-10-25T23:36:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.298+0000 7f6efd90e700 1 -- 172.21.15.81:0/203697030 shutdown_connections 2023-10-25T23:36:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.298+0000 7f6efd90e700 1 --2- 172.21.15.81:0/203697030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ef80a4000 0x7f6ef814d970 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.298+0000 7f6efd90e700 1 --2- 172.21.15.81:0/203697030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ee0005210 0x7f6ef814edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.298+0000 7f6efd90e700 1 --2- 172.21.15.81:0/203697030 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6ee406aed0 0x7f6ee406d390 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:12.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.298+0000 7f6efd90e700 1 --2- 172.21.15.81:0/203697030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ef814f330 0x7f6ef80a3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:12.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.298+0000 7f6efd90e700 1 -- 172.21.15.81:0/203697030 >> 172.21.15.81:0/203697030 conn(0x7f6ef80be490 msgr2=0x7f6ef814ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:12.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.298+0000 7f6efd90e700 1 -- 172.21.15.81:0/203697030 shutdown_connections 2023-10-25T23:36:12.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.298+0000 7f6efd90e700 1 -- 172.21.15.81:0/203697030 wait complete. 2023-10-25T23:36:12.312 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-25T23:36:12.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T23:36:12.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.437+0000 7ff842bbf700 1 -- 172.21.15.81:0/2800416207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff83c0a5580 msgr2=0x7ff83c06b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:12.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.437+0000 7ff842bbf700 1 --2- 172.21.15.81:0/2800416207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff83c0a5580 0x7ff83c06b720 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff8280098c0 tx=0x7ff828009bd0 comp rx=0 tx=0).stop 2023-10-25T23:36:12.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.437+0000 7ff842bbf700 1 -- 172.21.15.81:0/2800416207 shutdown_connections 2023-10-25T23:36:12.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.437+0000 7ff842bbf700 1 --2- 172.21.15.81:0/2800416207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff83c0a5580 0x7ff83c06b720 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:12.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.437+0000 7ff842bbf700 1 -- 172.21.15.81:0/2800416207 >> 172.21.15.81:0/2800416207 conn(0x7ff83c06d8b0 msgr2=0x7ff83c06dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:12.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.437+0000 7ff842bbf700 1 -- 172.21.15.81:0/2800416207 shutdown_connections 2023-10-25T23:36:12.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.437+0000 7ff842bbf700 1 -- 172.21.15.81:0/2800416207 wait complete. 2023-10-25T23:36:12.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.438+0000 7ff842bbf700 1 Processor -- start 2023-10-25T23:36:12.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.438+0000 7ff842bbf700 1 -- start start 2023-10-25T23:36:12.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.439+0000 7ff842bbf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff83c0a5ad0 0x7ff83c1d3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:12.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.439+0000 7ff842bbf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff83c0bc550 0x7ff83c0a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.439+0000 7ff842bbf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c0a2f90 0x7ff83c1453c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.439+0000 7ff842bbf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c0a37d0 con 0x7ff83c0bc550 2023-10-25T23:36:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.439+0000 7ff842bbf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c1d6500 con 0x7ff83c0a2f90 2023-10-25T23:36:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.439+0000 7ff842bbf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c1d6950 con 0x7ff83c0a5ad0 2023-10-25T23:36:12.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.439+0000 7ff83bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff83c0bc550 0x7ff83c0a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.439+0000 7ff83bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff83c0bc550 0x7ff83c0a3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36182/0 (socket says 172.21.15.81:36182) 2023-10-25T23:36:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.439+0000 7ff83bfff700 1 -- 172.21.15.81:0/1748856237 learned_addr learned my addr 172.21.15.81:0/1748856237 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.439+0000 7ff84115c700 1 --2- 172.21.15.81:0/1748856237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c0a2f90 0x7ff83c1453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.439+0000 7ff84095b700 1 --2- 172.21.15.81:0/1748856237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff83c0a5ad0 0x7ff83c1d3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:12.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.440+0000 7ff83bfff700 1 -- 172.21.15.81:0/1748856237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff83c0a5ad0 msgr2=0x7ff83c1d3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.440+0000 7ff83bfff700 1 --2- 172.21.15.81:0/1748856237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff83c0a5ad0 0x7ff83c1d3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.440+0000 7ff83bfff700 1 -- 172.21.15.81:0/1748856237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c0a2f90 msgr2=0x7ff83c1453c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.440+0000 7ff83bfff700 1 --2- 172.21.15.81:0/1748856237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c0a2f90 0x7ff83c1453c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.440+0000 7ff83bfff700 1 -- 172.21.15.81:0/1748856237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff828009520 con 0x7ff83c0bc550 2023-10-25T23:36:12.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.440+0000 7ff84095b700 1 --2- 172.21.15.81:0/1748856237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff83c0a5ad0 0x7ff83c1d3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:36:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.440+0000 7ff84115c700 1 --2- 172.21.15.81:0/1748856237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c0a2f90 0x7ff83c1453c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:36:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.440+0000 7ff83bfff700 1 --2- 172.21.15.81:0/1748856237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff83c0bc550 0x7ff83c0a3ef0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff83c070330 tx=0x7ff828003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.440+0000 7ff8397fa700 1 -- 172.21.15.81:0/1748856237 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82801c070 con 0x7ff83c0bc550 2023-10-25T23:36:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.440+0000 7ff8397fa700 1 -- 172.21.15.81:0/1748856237 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff82800b930 con 0x7ff83c0bc550 2023-10-25T23:36:12.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.440+0000 7ff842bbf700 1 -- 172.21.15.81:0/1748856237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83c1d4290 con 0x7ff83c0bc550 2023-10-25T23:36:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.440+0000 7ff8397fa700 1 -- 172.21.15.81:0/1748856237 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82800bd40 con 0x7ff83c0bc550 2023-10-25T23:36:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.440+0000 7ff842bbf700 1 -- 172.21.15.81:0/1748856237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83c0a34f0 con 0x7ff83c0bc550 2023-10-25T23:36:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.441+0000 7ff842bbf700 1 -- 172.21.15.81:0/1748856237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83c067490 con 0x7ff83c0bc550 2023-10-25T23:36:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.441+0000 7ff8397fa700 1 -- 172.21.15.81:0/1748856237 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff828004830 con 0x7ff83c0bc550 2023-10-25T23:36:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.442+0000 7ff8397fa700 1 --2- 172.21.15.81:0/1748856237 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff82006aed0 0x7ff82006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:12.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.442+0000 7ff8397fa700 1 -- 172.21.15.81:0/1748856237 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff82808af80 con 0x7ff83c0bc550 2023-10-25T23:36:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.442+0000 7ff84095b700 1 --2- 172.21.15.81:0/1748856237 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff82006aed0 0x7ff82006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.442+0000 7ff84095b700 1 --2- 172.21.15.81:0/1748856237 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff82006aed0 0x7ff82006d390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff830009930 tx=0x7ff830008040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:12.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.446+0000 7ff8397fa700 1 -- 172.21.15.81:0/1748856237 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff8280bdca0 con 0x7ff83c0bc550 2023-10-25T23:36:12.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.678+0000 7ff842bbf700 1 -- 172.21.15.81:0/1748856237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff83c1d6670 con 0x7ff83c0bc550 2023-10-25T23:36:12.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.678+0000 7ff8397fa700 1 -- 172.21.15.81:0/1748856237 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7ff83c1d6670 con 0x7ff83c0bc550 2023-10-25T23:36:12.681 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:12.681 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2649006434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2649006434},{"type":"v1","addr":"172.21.15.89:6836","nonce":2649006434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1805624382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1805624382},{"type":"v1","addr":"172.21.15.89:6837","nonce":1805624382}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/1925858148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1925858148},{"type":"v1","addr":"172.21.15.81:6834","nonce":1925858148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T23:36:08.648444+0000","modified":"2023-10-25T23:36:11.695560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4350":{"gid":4350,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1640191478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1640191478},{"type":"v1","addr":"172.21.15.81:6835","nonce":1640191478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-25T23:36:12.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.680+0000 7ff842bbf700 1 -- 172.21.15.81:0/1748856237 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff82006aed0 msgr2=0x7ff82006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:12.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.680+0000 7ff842bbf700 1 --2- 172.21.15.81:0/1748856237 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff82006aed0 0x7ff82006d390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff830009930 tx=0x7ff830008040 comp rx=0 tx=0).stop 2023-10-25T23:36:12.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.680+0000 7ff842bbf700 1 -- 172.21.15.81:0/1748856237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff83c0bc550 msgr2=0x7ff83c0a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:12.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.680+0000 7ff842bbf700 1 --2- 172.21.15.81:0/1748856237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff83c0bc550 0x7ff83c0a3ef0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff83c070330 tx=0x7ff828003eb0 comp rx=0 tx=0).stop 2023-10-25T23:36:12.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.680+0000 7ff842bbf700 1 -- 172.21.15.81:0/1748856237 shutdown_connections 2023-10-25T23:36:12.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.680+0000 7ff842bbf700 1 --2- 172.21.15.81:0/1748856237 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff82006aed0 0x7ff82006d390 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:12.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.680+0000 7ff842bbf700 1 --2- 172.21.15.81:0/1748856237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff83c0a2f90 0x7ff83c1453c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:12.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.680+0000 7ff842bbf700 1 --2- 172.21.15.81:0/1748856237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff83c0a5ad0 0x7ff83c1d3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:12.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.680+0000 7ff842bbf700 1 --2- 172.21.15.81:0/1748856237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff83c0bc550 0x7ff83c0a3ef0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:12.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.680+0000 7ff842bbf700 1 -- 172.21.15.81:0/1748856237 >> 172.21.15.81:0/1748856237 conn(0x7ff83c06d8b0 msgr2=0x7ff83c1d7360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:12.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.680+0000 7ff842bbf700 1 -- 172.21.15.81:0/1748856237 shutdown_connections 2023-10-25T23:36:12.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.680+0000 7ff842bbf700 1 -- 172.21.15.81:0/1748856237 wait complete. 2023-10-25T23:36:12.686 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2023-10-25T23:36:12.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T23:36:12.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.817+0000 7ff40a042700 1 -- 172.21.15.81:0/1186658676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec004d90 msgr2=0x7ff3ec005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.817+0000 7ff40a042700 1 --2- 172.21.15.81:0/1186658676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec004d90 0x7ff3ec005210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff40406d230 tx=0x7ff3ec005880 comp rx=0 tx=0).stop 2023-10-25T23:36:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.817+0000 7ff403fff700 1 -- 172.21.15.81:0/1186658676 reap_dead start 2023-10-25T23:36:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.818+0000 7ff40a042700 1 -- 172.21.15.81:0/1186658676 shutdown_connections 2023-10-25T23:36:12.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.818+0000 7ff40a042700 1 -- 172.21.15.81:0/1186658676 >> 172.21.15.81:0/1186658676 conn(0x7ff4040c0a40 msgr2=0x7ff4040c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:12.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.818+0000 7ff40a042700 1 -- 172.21.15.81:0/1186658676 shutdown_connections 2023-10-25T23:36:12.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.818+0000 7ff40a042700 1 -- 172.21.15.81:0/1186658676 wait complete. 2023-10-25T23:36:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.819+0000 7ff40a042700 1 Processor -- start 2023-10-25T23:36:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.819+0000 7ff40a042700 1 -- start start 2023-10-25T23:36:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.819+0000 7ff40a042700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec004d90 0x7ff4041e0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.819+0000 7ff40a042700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40412b860 0x7ff4041e4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.819+0000 7ff40a042700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff40412ee80 0x7ff40414a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.819+0000 7ff40a042700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4041e3880 con 0x7ff3ec004d90 2023-10-25T23:36:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.819+0000 7ff40a042700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4041e3e40 con 0x7ff40412b860 2023-10-25T23:36:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.819+0000 7ff40a042700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4041e47a0 con 0x7ff40412ee80 2023-10-25T23:36:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.820+0000 7ff4037fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec004d90 0x7ff4041e0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.820+0000 7ff4037fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec004d90 0x7ff4041e0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36202/0 (socket says 172.21.15.81:36202) 2023-10-25T23:36:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.820+0000 7ff4037fe700 1 -- 172.21.15.81:0/1365879132 learned_addr learned my addr 172.21.15.81:0/1365879132 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.820+0000 7ff402ffd700 1 --2- 172.21.15.81:0/1365879132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40412b860 0x7ff4041e4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.820+0000 7ff403fff700 1 --2- 172.21.15.81:0/1365879132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff40412ee80 0x7ff40414a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.820+0000 7ff4037fe700 1 -- 172.21.15.81:0/1365879132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff40412ee80 msgr2=0x7ff40414a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.820+0000 7ff4037fe700 1 --2- 172.21.15.81:0/1365879132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff40412ee80 0x7ff40414a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.820+0000 7ff4037fe700 1 -- 172.21.15.81:0/1365879132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40412b860 msgr2=0x7ff4041e4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.820+0000 7ff4037fe700 1 --2- 172.21.15.81:0/1365879132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40412b860 0x7ff4041e4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.820+0000 7ff4037fe700 1 -- 172.21.15.81:0/1365879132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40412e640 con 0x7ff3ec004d90 2023-10-25T23:36:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.820+0000 7ff4037fe700 1 --2- 172.21.15.81:0/1365879132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec004d90 0x7ff4041e0310 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800e850 tx=0x7ff3f800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.820+0000 7ff3ebfff700 1 -- 172.21.15.81:0/1365879132 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8013050 con 0x7ff3ec004d90 2023-10-25T23:36:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.820+0000 7ff3ebfff700 1 -- 172.21.15.81:0/1365879132 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff3f8014040 con 0x7ff3ec004d90 2023-10-25T23:36:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.820+0000 7ff3ebfff700 1 -- 172.21.15.81:0/1365879132 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8006230 con 0x7ff3ec004d90 2023-10-25T23:36:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.820+0000 7ff40a042700 1 -- 172.21.15.81:0/1365879132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40412e080 con 0x7ff3ec004d90 2023-10-25T23:36:12.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.820+0000 7ff40a042700 1 -- 172.21.15.81:0/1365879132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4041e3a60 con 0x7ff3ec004d90 2023-10-25T23:36:12.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.821+0000 7ff40a042700 1 -- 172.21.15.81:0/1365879132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4041e3f80 con 0x7ff3ec004d90 2023-10-25T23:36:12.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.821+0000 7ff3ebfff700 1 -- 172.21.15.81:0/1365879132 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff3f8001750 con 0x7ff3ec004d90 2023-10-25T23:36:12.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.822+0000 7ff3ebfff700 1 --2- 172.21.15.81:0/1365879132 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff3f006af00 0x7ff3f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:12.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.822+0000 7ff3ebfff700 1 -- 172.21.15.81:0/1365879132 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3f808d0a0 con 0x7ff3ec004d90 2023-10-25T23:36:12.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.822+0000 7ff402ffd700 1 --2- 172.21.15.81:0/1365879132 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff3f006af00 0x7ff3f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:12.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.822+0000 7ff402ffd700 1 --2- 172.21.15.81:0/1365879132 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff3f006af00 0x7ff3f006d3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff40414c560 tx=0x7ff3f4009260 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:12.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:12.826+0000 7ff3ebfff700 1 -- 172.21.15.81:0/1365879132 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff4041e3f80 con 0x7ff3ec004d90 2023-10-25T23:36:13.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.016+0000 7ff40a042700 1 -- 172.21.15.81:0/1365879132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4041e3f80 con 0x7ff3ec004d90 2023-10-25T23:36:13.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.017+0000 7ff3ebfff700 1 -- 172.21.15.81:0/1365879132 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7ff4041e3f80 con 0x7ff3ec004d90 2023-10-25T23:36:13.019 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:13.019 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf","created":"2023-10-25T23:35:42.986840+0000","modified":"2023-10-25T23:36:10.277991+0000","last_up_change":"2023-10-25T23:35:55.052199+0000","last_in_change":"2023-10-25T23:35:46.443490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T23:35:57.031170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T23:36:06.841771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T23:36:07.613269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48415836-8f22-4dcd-baa3-1d09c90c9a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6809","nonce":1045657984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6811","nonce":1045657984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6815","nonce":1045657984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6813","nonce":1045657984}]},"public_addr":"172.21.15.81:6809/1045657984","cluster_addr":"172.21.15.81:6811/1045657984","heartbeat_back_addr":"172.21.15.81:6815/1045657984","heartbeat_front_addr":"172.21.15.81:6813/1045657984","state":["exists","up"]},{"osd":1,"uuid":"19a4f6b5-e75c-45ae-aa08-b3467e69eed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6801","nonce":725386907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6803","nonce":725386907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6807","nonce":725386907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6805","nonce":725386907}]},"public_addr":"172.21.15.81:6801/725386907","cluster_addr":"172.21.15.81:6803/725386907","heartbeat_back_addr":"172.21.15.81:6807/725386907","heartbeat_front_addr":"172.21.15.81:6805/725386907","state":["exists","up"]},{"osd":2,"uuid":"60645312-54f5-4a74-ae52-68d17ff2d6e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6825","nonce":1744054610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6827","nonce":1744054610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6831","nonce":1744054610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6829","nonce":1744054610}]},"public_addr":"172.21.15.81:6825/1744054610","cluster_addr":"172.21.15.81:6827/1744054610","heartbeat_back_addr":"172.21.15.81:6831/1744054610","heartbeat_front_addr":"172.21.15.81:6829/1744054610","state":["exists","up"]},{"osd":3,"uuid":"c636a4a2-c1e8-4306-a78b-fe37eebab526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6817","nonce":1391123341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6819","nonce":1391123341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6823","nonce":1391123341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6821","nonce":1391123341}]},"public_addr":"172.21.15.81:6817/1391123341","cluster_addr":"172.21.15.81:6819/1391123341","heartbeat_back_addr":"172.21.15.81:6823/1391123341","heartbeat_front_addr":"172.21.15.81:6821/1391123341","state":["exists","up"]},{"osd":4,"uuid":"3cafc826-e531-4aa7-8b2a-b592f318f138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6817","nonce":1232781703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6819","nonce":1232781703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6823","nonce":1232781703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6821","nonce":1232781703}]},"public_addr":"172.21.15.89:6817/1232781703","cluster_addr":"172.21.15.89:6819/1232781703","heartbeat_back_addr":"172.21.15.89:6823/1232781703","heartbeat_front_addr":"172.21.15.89:6821/1232781703","state":["exists","up"]},{"osd":5,"uuid":"6098deb2-258e-47e1-b283-9a24c9dddf27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6801","nonce":2255820086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6803","nonce":2255820086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6807","nonce":2255820086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6805","nonce":2255820086}]},"public_addr":"172.21.15.89:6801/2255820086","cluster_addr":"172.21.15.89:6803/2255820086","heartbeat_back_addr":"172.21.15.89:6807/2255820086","heartbeat_front_addr":"172.21.15.89:6805/2255820086","state":["exists","up"]},{"osd":6,"uuid":"d79f68de-3c19-4f68-bbd1-59c8484dfaa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6809","nonce":2561967165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6811","nonce":2561967165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6815","nonce":2561967165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6813","nonce":2561967165}]},"public_addr":"172.21.15.89:6809/2561967165","cluster_addr":"172.21.15.89:6811/2561967165","heartbeat_back_addr":"172.21.15.89:6815/2561967165","heartbeat_front_addr":"172.21.15.89:6813/2561967165","state":["exists","up"]},{"osd":7,"uuid":"f1f7002e-4de9-4a08-97a1-fb52a116687f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6825","nonce":2647243500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6827","nonce":2647243500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6831","nonce":2647243500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6829","nonce":2647243500}]},"public_addr":"172.21.15.89:6825/2647243500","cluster_addr":"172.21.15.89:6827/2647243500","heartbeat_back_addr":"172.21.15.89:6831/2647243500","heartbeat_front_addr":"172.21.15.89:6829/2647243500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.613750+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.593515+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.713198+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.725623+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.686409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.596728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.670930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.676762+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T23:36:13.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.019+0000 7ff40a042700 1 -- 172.21.15.81:0/1365879132 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff3f006af00 msgr2=0x7ff3f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:13.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.019+0000 7ff40a042700 1 --2- 172.21.15.81:0/1365879132 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff3f006af00 0x7ff3f006d3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff40414c560 tx=0x7ff3f4009260 comp rx=0 tx=0).stop 2023-10-25T23:36:13.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.019+0000 7ff40a042700 1 -- 172.21.15.81:0/1365879132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec004d90 msgr2=0x7ff4041e0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:13.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.019+0000 7ff40a042700 1 --2- 172.21.15.81:0/1365879132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec004d90 0x7ff4041e0310 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800e850 tx=0x7ff3f800ec10 comp rx=0 tx=0).stop 2023-10-25T23:36:13.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.019+0000 7ff40a042700 1 -- 172.21.15.81:0/1365879132 shutdown_connections 2023-10-25T23:36:13.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.019+0000 7ff40a042700 1 --2- 172.21.15.81:0/1365879132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff40412ee80 0x7ff40414a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.019+0000 7ff40a042700 1 --2- 172.21.15.81:0/1365879132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3ec004d90 0x7ff4041e0310 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.019+0000 7ff40a042700 1 --2- 172.21.15.81:0/1365879132 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff3f006af00 0x7ff3f006d3c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.019+0000 7ff40a042700 1 --2- 172.21.15.81:0/1365879132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40412b860 0x7ff4041e4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.019+0000 7ff40a042700 1 -- 172.21.15.81:0/1365879132 >> 172.21.15.81:0/1365879132 conn(0x7ff4040c0a40 msgr2=0x7ff4041332c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:13.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.019+0000 7ff40a042700 1 -- 172.21.15.81:0/1365879132 shutdown_connections 2023-10-25T23:36:13.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.019+0000 7ff40a042700 1 -- 172.21.15.81:0/1365879132 wait complete. 2023-10-25T23:36:13.033 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-25T23:36:13.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T23:36:13.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.153+0000 7f236ff3c700 1 -- 172.21.15.81:0/1813106977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23681454f0 msgr2=0x7f236814ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.153+0000 7f236ff3c700 1 --2- 172.21.15.81:0/1813106977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23681454f0 0x7f236814ec20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2358005fd0 tx=0x7f2358009c70 comp rx=0 tx=0).stop 2023-10-25T23:36:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.153+0000 7f236ff3c700 1 -- 172.21.15.81:0/1813106977 shutdown_connections 2023-10-25T23:36:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.153+0000 7f236ff3c700 1 --2- 172.21.15.81:0/1813106977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23681454f0 0x7f236814ec20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.153+0000 7f236ff3c700 1 -- 172.21.15.81:0/1813106977 >> 172.21.15.81:0/1813106977 conn(0x7f23680c0a40 msgr2=0x7f23680c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:13.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.153+0000 7f236ff3c700 1 -- 172.21.15.81:0/1813106977 shutdown_connections 2023-10-25T23:36:13.157 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.153+0000 7f236ff3c700 1 -- 172.21.15.81:0/1813106977 wait complete. 2023-10-25T23:36:13.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.154+0000 7f236ff3c700 1 Processor -- start 2023-10-25T23:36:13.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.154+0000 7f236ff3c700 1 -- start start 2023-10-25T23:36:13.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.155+0000 7f236ff3c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f236806cd80 0x7f236814ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:13.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.155+0000 7f236ff3c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23681454f0 0x7f23680ba480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:13.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.155+0000 7f236ff3c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f236814b930 0x7f236812e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:13.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.155+0000 7f236ff3c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236814bd80 con 0x7f236806cd80 2023-10-25T23:36:13.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.155+0000 7f236ff3c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2368147790 con 0x7f23681454f0 2023-10-25T23:36:13.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.155+0000 7f236ff3c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236814b3d0 con 0x7f236814b930 2023-10-25T23:36:13.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.155+0000 7f236dcd8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f236806cd80 0x7f236814ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:13.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.155+0000 7f236dcd8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f236806cd80 0x7f236814ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36212/0 (socket says 172.21.15.81:36212) 2023-10-25T23:36:13.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.155+0000 7f236dcd8700 1 -- 172.21.15.81:0/469201897 learned_addr learned my addr 172.21.15.81:0/469201897 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.155+0000 7f236d4d7700 1 --2- 172.21.15.81:0/469201897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23681454f0 0x7f23680ba480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.155+0000 7f236e4d9700 1 --2- 172.21.15.81:0/469201897 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f236814b930 0x7f236812e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.155+0000 7f236dcd8700 1 -- 172.21.15.81:0/469201897 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f236814b930 msgr2=0x7f236812e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.155+0000 7f236dcd8700 1 --2- 172.21.15.81:0/469201897 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f236814b930 0x7f236812e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.155+0000 7f236dcd8700 1 -- 172.21.15.81:0/469201897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23681454f0 msgr2=0x7f23680ba480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.155+0000 7f236dcd8700 1 --2- 172.21.15.81:0/469201897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23681454f0 0x7f23680ba480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.155+0000 7f236dcd8700 1 -- 172.21.15.81:0/469201897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23580095f0 con 0x7f236806cd80 2023-10-25T23:36:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.155+0000 7f236e4d9700 1 --2- 172.21.15.81:0/469201897 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f236814b930 0x7f236812e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:36:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.155+0000 7f236d4d7700 1 --2- 172.21.15.81:0/469201897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23681454f0 0x7f23680ba480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:36:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.156+0000 7f236dcd8700 1 --2- 172.21.15.81:0/469201897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f236806cd80 0x7f236814ae90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f235800b540 tx=0x7f2358004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.156+0000 7f235e7fc700 1 -- 172.21.15.81:0/469201897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235801f070 con 0x7f236806cd80 2023-10-25T23:36:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.156+0000 7f235e7fc700 1 -- 172.21.15.81:0/469201897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2358003890 con 0x7f236806cd80 2023-10-25T23:36:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.156+0000 7f236ff3c700 1 -- 172.21.15.81:0/469201897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23681e4fc0 con 0x7f236806cd80 2023-10-25T23:36:13.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.156+0000 7f235e7fc700 1 -- 172.21.15.81:0/469201897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358003c80 con 0x7f236806cd80 2023-10-25T23:36:13.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.156+0000 7f236ff3c700 1 -- 172.21.15.81:0/469201897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2368130e60 con 0x7f236806cd80 2023-10-25T23:36:13.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.157+0000 7f236ff3c700 1 -- 172.21.15.81:0/469201897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2368148ce0 con 0x7f236806cd80 2023-10-25T23:36:13.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.157+0000 7f235e7fc700 1 -- 172.21.15.81:0/469201897 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2358019600 con 0x7f236806cd80 2023-10-25T23:36:13.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.158+0000 7f235e7fc700 1 --2- 172.21.15.81:0/469201897 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f234c06aed0 0x7f234c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:13.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.158+0000 7f235e7fc700 1 -- 172.21.15.81:0/469201897 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f235808d1f0 con 0x7f236806cd80 2023-10-25T23:36:13.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.158+0000 7f236d4d7700 1 --2- 172.21.15.81:0/469201897 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f234c06aed0 0x7f234c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:13.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.158+0000 7f236d4d7700 1 --2- 172.21.15.81:0/469201897 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f234c06aed0 0x7f234c06d390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2364007fd0 tx=0x7f2364009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:13.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.162+0000 7f235e7fc700 1 -- 172.21.15.81:0/469201897 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2368148ce0 con 0x7f236806cd80 2023-10-25T23:36:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.348+0000 7f236ff3c700 1 -- 172.21.15.81:0/469201897 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2368148ce0 con 0x7f234c06aed0 2023-10-25T23:36:13.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.357+0000 7f235e7fc700 1 -- 172.21.15.81:0/469201897 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264658 (secure 0 0 0) 0x7f2368148ce0 con 0x7f234c06aed0 2023-10-25T23:36:13.368 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:13.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.360+0000 7f236ff3c700 1 -- 172.21.15.81:0/469201897 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f234c06aed0 msgr2=0x7f234c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:13.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.360+0000 7f236ff3c700 1 --2- 172.21.15.81:0/469201897 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f234c06aed0 0x7f234c06d390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2364007fd0 tx=0x7f2364009040 comp rx=0 tx=0).stop 2023-10-25T23:36:13.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.360+0000 7f236ff3c700 1 -- 172.21.15.81:0/469201897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f236806cd80 msgr2=0x7f236814ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:13.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.360+0000 7f236ff3c700 1 --2- 172.21.15.81:0/469201897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f236806cd80 0x7f236814ae90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f235800b540 tx=0x7f2358004310 comp rx=0 tx=0).stop 2023-10-25T23:36:13.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.360+0000 7f236ff3c700 1 -- 172.21.15.81:0/469201897 shutdown_connections 2023-10-25T23:36:13.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.360+0000 7f236ff3c700 1 --2- 172.21.15.81:0/469201897 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f236814b930 0x7f236812e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.360+0000 7f236ff3c700 1 --2- 172.21.15.81:0/469201897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f236806cd80 0x7f236814ae90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.360+0000 7f236ff3c700 1 --2- 172.21.15.81:0/469201897 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f234c06aed0 0x7f234c06d390 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.360+0000 7f236ff3c700 1 --2- 172.21.15.81:0/469201897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23681454f0 0x7f23680ba480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.360+0000 7f236ff3c700 1 -- 172.21.15.81:0/469201897 >> 172.21.15.81:0/469201897 conn(0x7f23680c0a40 msgr2=0x7f2368144a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:13.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.360+0000 7f236ff3c700 1 -- 172.21.15.81:0/469201897 shutdown_connections 2023-10-25T23:36:13.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.360+0000 7f236ff3c700 1 -- 172.21.15.81:0/469201897 wait complete. 2023-10-25T23:36:13.376 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-25T23:36:13.377 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-25T23:36:12.990097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219068,"kb_used_data":2872,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755652,"statfs":{"total":773094113280,"available":772869787648,"internally_reserved":0,"allocated":2940928,"data_stored":1764908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.734895"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477723+0000","last_change":"2023-10-25T23:36:09.292535+0000","last_active":"2023-10-25T23:36:10.477723+0000","last_peered":"2023-10-25T23:36:10.477723+0000","last_clean":"2023-10-25T23:36:10.477723+0000","last_became_active":"2023-10-25T23:36:09.292007+0000","last_became_peered":"2023-10-25T23:36:09.292007+0000","last_unstale":"2023-10-25T23:36:10.477723+0000","last_undegraded":"2023-10-25T23:36:10.477723+0000","last_fullsized":"2023-10-25T23:36:10.477723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:54:42.179401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.293501+0000","last_change":"2023-10-25T23:36:09.282198+0000","last_active":"2023-10-25T23:36:09.293501+0000","last_peered":"2023-10-25T23:36:09.293501+0000","last_clean":"2023-10-25T23:36:09.293501+0000","last_became_active":"2023-10-25T23:36:09.281890+0000","last_became_peered":"2023-10-25T23:36:09.281890+0000","last_unstale":"2023-10-25T23:36:09.293501+0000","last_undegraded":"2023-10-25T23:36:09.293501+0000","last_fullsized":"2023-10-25T23:36:09.293501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:11:38.668268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.299544+0000","last_change":"2023-10-25T23:36:09.284367+0000","last_active":"2023-10-25T23:36:09.299544+0000","last_peered":"2023-10-25T23:36:09.299544+0000","last_clean":"2023-10-25T23:36:09.299544+0000","last_became_active":"2023-10-25T23:36:09.284066+0000","last_became_peered":"2023-10-25T23:36:09.284066+0000","last_unstale":"2023-10-25T23:36:09.299544+0000","last_undegraded":"2023-10-25T23:36:09.299544+0000","last_fullsized":"2023-10-25T23:36:09.299544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:27.001592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887928+0000","last_change":"2023-10-25T23:36:09.300380+0000","last_active":"2023-10-25T23:36:10.887928+0000","last_peered":"2023-10-25T23:36:10.887928+0000","last_clean":"2023-10-25T23:36:10.887928+0000","last_became_active":"2023-10-25T23:36:09.299585+0000","last_became_peered":"2023-10-25T23:36:09.299585+0000","last_unstale":"2023-10-25T23:36:10.887928+0000","last_undegraded":"2023-10-25T23:36:10.887928+0000","last_fullsized":"2023-10-25T23:36:10.887928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:54.492612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477102+0000","last_change":"2023-10-25T23:36:09.287693+0000","last_active":"2023-10-25T23:36:10.477102+0000","last_peered":"2023-10-25T23:36:10.477102+0000","last_clean":"2023-10-25T23:36:10.477102+0000","last_became_active":"2023-10-25T23:36:09.287403+0000","last_became_peered":"2023-10-25T23:36:09.287403+0000","last_unstale":"2023-10-25T23:36:10.477102+0000","last_undegraded":"2023-10-25T23:36:10.477102+0000","last_fullsized":"2023-10-25T23:36:10.477102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:58:48.401709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887662+0000","last_change":"2023-10-25T23:36:09.301596+0000","last_active":"2023-10-25T23:36:10.887662+0000","last_peered":"2023-10-25T23:36:10.887662+0000","last_clean":"2023-10-25T23:36:10.887662+0000","last_became_active":"2023-10-25T23:36:09.301305+0000","last_became_peered":"2023-10-25T23:36:09.301305+0000","last_unstale":"2023-10-25T23:36:10.887662+0000","last_undegraded":"2023-10-25T23:36:10.887662+0000","last_fullsized":"2023-10-25T23:36:10.887662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:24:52.973821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477210+0000","last_change":"2023-10-25T23:36:09.293643+0000","last_active":"2023-10-25T23:36:10.477210+0000","last_peered":"2023-10-25T23:36:10.477210+0000","last_clean":"2023-10-25T23:36:10.477210+0000","last_became_active":"2023-10-25T23:36:09.293173+0000","last_became_peered":"2023-10-25T23:36:09.293173+0000","last_unstale":"2023-10-25T23:36:10.477210+0000","last_undegraded":"2023-10-25T23:36:10.477210+0000","last_fullsized":"2023-10-25T23:36:10.477210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:54.492612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298104+0000","last_change":"2023-10-25T23:36:09.295727+0000","last_active":"2023-10-25T23:36:09.298104+0000","last_peered":"2023-10-25T23:36:09.298104+0000","last_clean":"2023-10-25T23:36:09.298104+0000","last_became_active":"2023-10-25T23:36:09.295518+0000","last_became_peered":"2023-10-25T23:36:09.295518+0000","last_unstale":"2023-10-25T23:36:09.298104+0000","last_undegraded":"2023-10-25T23:36:09.298104+0000","last_fullsized":"2023-10-25T23:36:09.298104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:27.001592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477732+0000","last_change":"2023-10-25T23:36:09.297377+0000","last_active":"2023-10-25T23:36:10.477732+0000","last_peered":"2023-10-25T23:36:10.477732+0000","last_clean":"2023-10-25T23:36:10.477732+0000","last_became_active":"2023-10-25T23:36:09.297036+0000","last_became_peered":"2023-10-25T23:36:09.297036+0000","last_unstale":"2023-10-25T23:36:10.477732+0000","last_undegraded":"2023-10-25T23:36:10.477732+0000","last_fullsized":"2023-10-25T23:36:10.477732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:18:29.087327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285803+0000","last_change":"2023-10-25T23:36:09.298222+0000","last_active":"2023-10-25T23:36:10.285803+0000","last_peered":"2023-10-25T23:36:10.285803+0000","last_clean":"2023-10-25T23:36:10.285803+0000","last_became_active":"2023-10-25T23:36:09.297713+0000","last_became_peered":"2023-10-25T23:36:09.297713+0000","last_unstale":"2023-10-25T23:36:10.285803+0000","last_undegraded":"2023-10-25T23:36:10.285803+0000","last_fullsized":"2023-10-25T23:36:10.285803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:09:27.102927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285557+0000","last_change":"2023-10-25T23:36:09.297392+0000","last_active":"2023-10-25T23:36:10.285557+0000","last_peered":"2023-10-25T23:36:10.285557+0000","last_clean":"2023-10-25T23:36:10.285557+0000","last_became_active":"2023-10-25T23:36:09.297133+0000","last_became_peered":"2023-10-25T23:36:09.297133+0000","last_unstale":"2023-10-25T23:36:10.285557+0000","last_undegraded":"2023-10-25T23:36:10.285557+0000","last_fullsized":"2023-10-25T23:36:10.285557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:28.346439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.287003+0000","last_change":"2023-10-25T23:36:09.291669+0000","last_active":"2023-10-25T23:36:10.287003+0000","last_peered":"2023-10-25T23:36:10.287003+0000","last_clean":"2023-10-25T23:36:10.287003+0000","last_became_active":"2023-10-25T23:36:09.291351+0000","last_became_peered":"2023-10-25T23:36:09.291351+0000","last_unstale":"2023-10-25T23:36:10.287003+0000","last_undegraded":"2023-10-25T23:36:10.287003+0000","last_fullsized":"2023-10-25T23:36:10.287003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:01.440988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298199+0000","last_change":"2023-10-25T23:36:09.290180+0000","last_active":"2023-10-25T23:36:09.298199+0000","last_peered":"2023-10-25T23:36:09.298199+0000","last_clean":"2023-10-25T23:36:09.298199+0000","last_became_active":"2023-10-25T23:36:09.289895+0000","last_became_peered":"2023-10-25T23:36:09.289895+0000","last_unstale":"2023-10-25T23:36:09.298199+0000","last_undegraded":"2023-10-25T23:36:09.298199+0000","last_fullsized":"2023-10-25T23:36:09.298199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:28:35.026841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.290456+0000","last_change":"2023-10-25T23:36:09.283494+0000","last_active":"2023-10-25T23:36:09.290456+0000","last_peered":"2023-10-25T23:36:09.290456+0000","last_clean":"2023-10-25T23:36:09.290456+0000","last_became_active":"2023-10-25T23:36:09.283250+0000","last_became_peered":"2023-10-25T23:36:09.283250+0000","last_unstale":"2023-10-25T23:36:09.290456+0000","last_undegraded":"2023-10-25T23:36:09.290456+0000","last_fullsized":"2023-10-25T23:36:09.290456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:41:31.211304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.295253+0000","last_change":"2023-10-25T23:36:09.286460+0000","last_active":"2023-10-25T23:36:09.295253+0000","last_peered":"2023-10-25T23:36:09.295253+0000","last_clean":"2023-10-25T23:36:09.295253+0000","last_became_active":"2023-10-25T23:36:09.286191+0000","last_became_peered":"2023-10-25T23:36:09.286191+0000","last_unstale":"2023-10-25T23:36:09.295253+0000","last_undegraded":"2023-10-25T23:36:09.295253+0000","last_fullsized":"2023-10-25T23:36:09.295253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:32.136680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887574+0000","last_change":"2023-10-25T23:36:09.301475+0000","last_active":"2023-10-25T23:36:10.887574+0000","last_peered":"2023-10-25T23:36:10.887574+0000","last_clean":"2023-10-25T23:36:10.887574+0000","last_became_active":"2023-10-25T23:36:09.301040+0000","last_became_peered":"2023-10-25T23:36:09.301040+0000","last_unstale":"2023-10-25T23:36:10.887574+0000","last_undegraded":"2023-10-25T23:36:10.887574+0000","last_fullsized":"2023-10-25T23:36:10.887574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:06.986689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888186+0000","last_change":"2023-10-25T23:36:09.298189+0000","last_active":"2023-10-25T23:36:10.888186+0000","last_peered":"2023-10-25T23:36:10.888186+0000","last_clean":"2023-10-25T23:36:10.888186+0000","last_became_active":"2023-10-25T23:36:09.297892+0000","last_became_peered":"2023-10-25T23:36:09.297892+0000","last_unstale":"2023-10-25T23:36:10.888186+0000","last_undegraded":"2023-10-25T23:36:10.888186+0000","last_fullsized":"2023-10-25T23:36:10.888186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:54:42.179401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285710+0000","last_change":"2023-10-25T23:36:09.282631+0000","last_active":"2023-10-25T23:36:10.285710+0000","last_peered":"2023-10-25T23:36:10.285710+0000","last_clean":"2023-10-25T23:36:10.285710+0000","last_became_active":"2023-10-25T23:36:09.282282+0000","last_became_peered":"2023-10-25T23:36:09.282282+0000","last_unstale":"2023-10-25T23:36:10.285710+0000","last_undegraded":"2023-10-25T23:36:10.285710+0000","last_fullsized":"2023-10-25T23:36:10.285710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:27.001592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477144+0000","last_change":"2023-10-25T23:36:09.289744+0000","last_active":"2023-10-25T23:36:10.477144+0000","last_peered":"2023-10-25T23:36:10.477144+0000","last_clean":"2023-10-25T23:36:10.477144+0000","last_became_active":"2023-10-25T23:36:09.289457+0000","last_became_peered":"2023-10-25T23:36:09.289457+0000","last_unstale":"2023-10-25T23:36:10.477144+0000","last_undegraded":"2023-10-25T23:36:10.477144+0000","last_fullsized":"2023-10-25T23:36:10.477144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:25:22.432043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.302900+0000","last_change":"2023-10-25T23:36:08.271164+0000","last_active":"2023-10-25T23:36:09.302900+0000","last_peered":"2023-10-25T23:36:09.302900+0000","last_clean":"2023-10-25T23:36:09.302900+0000","last_became_active":"2023-10-25T23:36:08.270911+0000","last_became_peered":"2023-10-25T23:36:08.270911+0000","last_unstale":"2023-10-25T23:36:09.302900+0000","last_undegraded":"2023-10-25T23:36:09.302900+0000","last_fullsized":"2023-10-25T23:36:09.302900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.297866+0000","last_change":"2023-10-25T23:36:09.290526+0000","last_active":"2023-10-25T23:36:09.297866+0000","last_peered":"2023-10-25T23:36:09.297866+0000","last_clean":"2023-10-25T23:36:09.297866+0000","last_became_active":"2023-10-25T23:36:09.290260+0000","last_became_peered":"2023-10-25T23:36:09.290260+0000","last_unstale":"2023-10-25T23:36:09.297866+0000","last_undegraded":"2023-10-25T23:36:09.297866+0000","last_fullsized":"2023-10-25T23:36:09.297866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:32.136680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.299956+0000","last_change":"2023-10-25T23:36:08.269993+0000","last_active":"2023-10-25T23:36:09.299956+0000","last_peered":"2023-10-25T23:36:09.299956+0000","last_clean":"2023-10-25T23:36:09.299956+0000","last_became_active":"2023-10-25T23:36:08.269443+0000","last_became_peered":"2023-10-25T23:36:08.269443+0000","last_unstale":"2023-10-25T23:36:09.299956+0000","last_undegraded":"2023-10-25T23:36:09.299956+0000","last_fullsized":"2023-10-25T23:36:09.299956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.302118+0000","last_change":"2023-10-25T23:36:09.300013+0000","last_active":"2023-10-25T23:36:09.302118+0000","last_peered":"2023-10-25T23:36:09.302118+0000","last_clean":"2023-10-25T23:36:09.302118+0000","last_became_active":"2023-10-25T23:36:09.299738+0000","last_became_peered":"2023-10-25T23:36:09.299738+0000","last_unstale":"2023-10-25T23:36:09.302118+0000","last_undegraded":"2023-10-25T23:36:09.302118+0000","last_fullsized":"2023-10-25T23:36:09.302118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:41.029497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477442+0000","last_change":"2023-10-25T23:36:08.273879+0000","last_active":"2023-10-25T23:36:10.477442+0000","last_peered":"2023-10-25T23:36:10.477442+0000","last_clean":"2023-10-25T23:36:10.477442+0000","last_became_active":"2023-10-25T23:36:08.273574+0000","last_became_peered":"2023-10-25T23:36:08.273574+0000","last_unstale":"2023-10-25T23:36:10.477442+0000","last_undegraded":"2023-10-25T23:36:10.477442+0000","last_fullsized":"2023-10-25T23:36:10.477442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:27.340205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887909+0000","last_change":"2023-10-25T23:36:09.300549+0000","last_active":"2023-10-25T23:36:10.887909+0000","last_peered":"2023-10-25T23:36:10.887909+0000","last_clean":"2023-10-25T23:36:10.887909+0000","last_became_active":"2023-10-25T23:36:09.299916+0000","last_became_peered":"2023-10-25T23:36:09.299916+0000","last_unstale":"2023-10-25T23:36:10.887909+0000","last_undegraded":"2023-10-25T23:36:10.887909+0000","last_fullsized":"2023-10-25T23:36:10.887909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:25:22.432043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477055+0000","last_change":"2023-10-25T23:36:08.271714+0000","last_active":"2023-10-25T23:36:10.477055+0000","last_peered":"2023-10-25T23:36:10.477055+0000","last_clean":"2023-10-25T23:36:10.477055+0000","last_became_active":"2023-10-25T23:36:08.271442+0000","last_became_peered":"2023-10-25T23:36:08.271442+0000","last_unstale":"2023-10-25T23:36:10.477055+0000","last_undegraded":"2023-10-25T23:36:10.477055+0000","last_fullsized":"2023-10-25T23:36:10.477055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888055+0000","last_change":"2023-10-25T23:36:09.299476+0000","last_active":"2023-10-25T23:36:10.888055+0000","last_peered":"2023-10-25T23:36:10.888055+0000","last_clean":"2023-10-25T23:36:10.888055+0000","last_became_active":"2023-10-25T23:36:09.299130+0000","last_became_peered":"2023-10-25T23:36:09.299130+0000","last_unstale":"2023-10-25T23:36:10.888055+0000","last_undegraded":"2023-10-25T23:36:10.888055+0000","last_fullsized":"2023-10-25T23:36:10.888055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:53:09.911467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298119+0000","last_change":"2023-10-25T23:36:08.271119+0000","last_active":"2023-10-25T23:36:09.298119+0000","last_peered":"2023-10-25T23:36:09.298119+0000","last_clean":"2023-10-25T23:36:09.298119+0000","last_became_active":"2023-10-25T23:36:08.270138+0000","last_became_peered":"2023-10-25T23:36:08.270138+0000","last_unstale":"2023-10-25T23:36:09.298119+0000","last_undegraded":"2023-10-25T23:36:09.298119+0000","last_fullsized":"2023-10-25T23:36:09.298119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286865+0000","last_change":"2023-10-25T23:36:09.287742+0000","last_active":"2023-10-25T23:36:10.286865+0000","last_peered":"2023-10-25T23:36:10.286865+0000","last_clean":"2023-10-25T23:36:10.286865+0000","last_became_active":"2023-10-25T23:36:09.287455+0000","last_became_peered":"2023-10-25T23:36:09.287455+0000","last_unstale":"2023-10-25T23:36:10.286865+0000","last_undegraded":"2023-10-25T23:36:10.286865+0000","last_fullsized":"2023-10-25T23:36:10.286865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:41.029497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285393+0000","last_change":"2023-10-25T23:36:08.272686+0000","last_active":"2023-10-25T23:36:10.285393+0000","last_peered":"2023-10-25T23:36:10.285393+0000","last_clean":"2023-10-25T23:36:10.285393+0000","last_became_active":"2023-10-25T23:36:08.271974+0000","last_became_peered":"2023-10-25T23:36:08.271974+0000","last_unstale":"2023-10-25T23:36:10.285393+0000","last_undegraded":"2023-10-25T23:36:10.285393+0000","last_fullsized":"2023-10-25T23:36:10.285393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.300410+0000","last_change":"2023-10-25T23:36:09.294574+0000","last_active":"2023-10-25T23:36:09.300410+0000","last_peered":"2023-10-25T23:36:09.300410+0000","last_clean":"2023-10-25T23:36:09.300410+0000","last_became_active":"2023-10-25T23:36:09.294176+0000","last_became_peered":"2023-10-25T23:36:09.294176+0000","last_unstale":"2023-10-25T23:36:09.300410+0000","last_undegraded":"2023-10-25T23:36:09.300410+0000","last_fullsized":"2023-10-25T23:36:09.300410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:36.336468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.283027+0000","last_change":"2023-10-25T23:36:08.273513+0000","last_active":"2023-10-25T23:36:09.283027+0000","last_peered":"2023-10-25T23:36:09.283027+0000","last_clean":"2023-10-25T23:36:09.283027+0000","last_became_active":"2023-10-25T23:36:08.273035+0000","last_became_peered":"2023-10-25T23:36:08.273035+0000","last_unstale":"2023-10-25T23:36:09.283027+0000","last_undegraded":"2023-10-25T23:36:09.283027+0000","last_fullsized":"2023-10-25T23:36:09.283027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:21:29.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298126+0000","last_change":"2023-10-25T23:36:09.292852+0000","last_active":"2023-10-25T23:36:09.298126+0000","last_peered":"2023-10-25T23:36:09.298126+0000","last_clean":"2023-10-25T23:36:09.298126+0000","last_became_active":"2023-10-25T23:36:09.292546+0000","last_became_peered":"2023-10-25T23:36:09.292546+0000","last_unstale":"2023-10-25T23:36:09.298126+0000","last_undegraded":"2023-10-25T23:36:09.298126+0000","last_fullsized":"2023-10-25T23:36:09.298126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:41.029497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887617+0000","last_change":"2023-10-25T23:36:08.277462+0000","last_active":"2023-10-25T23:36:10.887617+0000","last_peered":"2023-10-25T23:36:10.887617+0000","last_clean":"2023-10-25T23:36:10.887617+0000","last_became_active":"2023-10-25T23:36:08.277138+0000","last_became_peered":"2023-10-25T23:36:08.277138+0000","last_unstale":"2023-10-25T23:36:10.887617+0000","last_undegraded":"2023-10-25T23:36:10.887617+0000","last_fullsized":"2023-10-25T23:36:10.887617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:48:32.291671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.295276+0000","last_change":"2023-10-25T23:36:09.290725+0000","last_active":"2023-10-25T23:36:09.295276+0000","last_peered":"2023-10-25T23:36:09.295276+0000","last_clean":"2023-10-25T23:36:09.295276+0000","last_became_active":"2023-10-25T23:36:09.290456+0000","last_became_peered":"2023-10-25T23:36:09.290456+0000","last_unstale":"2023-10-25T23:36:09.295276+0000","last_undegraded":"2023-10-25T23:36:09.295276+0000","last_fullsized":"2023-10-25T23:36:09.295276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:27.001592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285660+0000","last_change":"2023-10-25T23:36:08.272869+0000","last_active":"2023-10-25T23:36:10.285660+0000","last_peered":"2023-10-25T23:36:10.285660+0000","last_clean":"2023-10-25T23:36:10.285660+0000","last_became_active":"2023-10-25T23:36:08.272120+0000","last_became_peered":"2023-10-25T23:36:08.272120+0000","last_unstale":"2023-10-25T23:36:10.285660+0000","last_undegraded":"2023-10-25T23:36:10.285660+0000","last_fullsized":"2023-10-25T23:36:10.285660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888137+0000","last_change":"2023-10-25T23:36:09.293442+0000","last_active":"2023-10-25T23:36:10.888137+0000","last_peered":"2023-10-25T23:36:10.888137+0000","last_clean":"2023-10-25T23:36:10.888137+0000","last_became_active":"2023-10-25T23:36:09.293132+0000","last_became_peered":"2023-10-25T23:36:09.293132+0000","last_unstale":"2023-10-25T23:36:10.888137+0000","last_undegraded":"2023-10-25T23:36:10.888137+0000","last_fullsized":"2023-10-25T23:36:10.888137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:11:17.452696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888026+0000","last_change":"2023-10-25T23:36:08.272920+0000","last_active":"2023-10-25T23:36:10.888026+0000","last_peered":"2023-10-25T23:36:10.888026+0000","last_clean":"2023-10-25T23:36:10.888026+0000","last_became_active":"2023-10-25T23:36:08.272596+0000","last_became_peered":"2023-10-25T23:36:08.272596+0000","last_unstale":"2023-10-25T23:36:10.888026+0000","last_undegraded":"2023-10-25T23:36:10.888026+0000","last_fullsized":"2023-10-25T23:36:10.888026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.302141+0000","last_change":"2023-10-25T23:36:09.300238+0000","last_active":"2023-10-25T23:36:09.302141+0000","last_peered":"2023-10-25T23:36:09.302141+0000","last_clean":"2023-10-25T23:36:09.302141+0000","last_became_active":"2023-10-25T23:36:09.299938+0000","last_became_peered":"2023-10-25T23:36:09.299938+0000","last_unstale":"2023-10-25T23:36:09.302141+0000","last_undegraded":"2023-10-25T23:36:09.302141+0000","last_fullsized":"2023-10-25T23:36:09.302141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:28:35.026841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.297064+0000","last_change":"2023-10-25T23:36:08.279751+0000","last_active":"2023-10-25T23:36:09.297064+0000","last_peered":"2023-10-25T23:36:09.297064+0000","last_clean":"2023-10-25T23:36:09.297064+0000","last_became_active":"2023-10-25T23:36:08.279509+0000","last_became_peered":"2023-10-25T23:36:08.279509+0000","last_unstale":"2023-10-25T23:36:09.297064+0000","last_undegraded":"2023-10-25T23:36:09.297064+0000","last_fullsized":"2023-10-25T23:36:09.297064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286903+0000","last_change":"2023-10-25T23:36:09.285566+0000","last_active":"2023-10-25T23:36:10.286903+0000","last_peered":"2023-10-25T23:36:10.286903+0000","last_clean":"2023-10-25T23:36:10.286903+0000","last_became_active":"2023-10-25T23:36:09.285196+0000","last_became_peered":"2023-10-25T23:36:09.285196+0000","last_unstale":"2023-10-25T23:36:10.286903+0000","last_undegraded":"2023-10-25T23:36:10.286903+0000","last_fullsized":"2023-10-25T23:36:10.286903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:27.001592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285737+0000","last_change":"2023-10-25T23:36:08.272911+0000","last_active":"2023-10-25T23:36:10.285737+0000","last_peered":"2023-10-25T23:36:10.285737+0000","last_clean":"2023-10-25T23:36:10.285737+0000","last_became_active":"2023-10-25T23:36:08.272248+0000","last_became_peered":"2023-10-25T23:36:08.272248+0000","last_unstale":"2023-10-25T23:36:10.285737+0000","last_undegraded":"2023-10-25T23:36:10.285737+0000","last_fullsized":"2023-10-25T23:36:10.285737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477155+0000","last_change":"2023-10-25T23:36:09.292562+0000","last_active":"2023-10-25T23:36:10.477155+0000","last_peered":"2023-10-25T23:36:10.477155+0000","last_clean":"2023-10-25T23:36:10.477155+0000","last_became_active":"2023-10-25T23:36:09.292300+0000","last_became_peered":"2023-10-25T23:36:09.292300+0000","last_unstale":"2023-10-25T23:36:10.477155+0000","last_undegraded":"2023-10-25T23:36:10.477155+0000","last_fullsized":"2023-10-25T23:36:10.477155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:46:03.954978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.300664+0000","last_change":"2023-10-25T23:36:08.274407+0000","last_active":"2023-10-25T23:36:09.300664+0000","last_peered":"2023-10-25T23:36:09.300664+0000","last_clean":"2023-10-25T23:36:09.300664+0000","last_became_active":"2023-10-25T23:36:08.274162+0000","last_became_peered":"2023-10-25T23:36:08.274162+0000","last_unstale":"2023-10-25T23:36:09.300664+0000","last_undegraded":"2023-10-25T23:36:09.300664+0000","last_fullsized":"2023-10-25T23:36:09.300664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.299703+0000","last_change":"2023-10-25T23:36:09.284635+0000","last_active":"2023-10-25T23:36:09.299703+0000","last_peered":"2023-10-25T23:36:09.299703+0000","last_clean":"2023-10-25T23:36:09.299703+0000","last_became_active":"2023-10-25T23:36:09.284386+0000","last_became_peered":"2023-10-25T23:36:09.284386+0000","last_unstale":"2023-10-25T23:36:09.299703+0000","last_undegraded":"2023-10-25T23:36:09.299703+0000","last_fullsized":"2023-10-25T23:36:09.299703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:40.519153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887950+0000","last_change":"2023-10-25T23:36:08.271565+0000","last_active":"2023-10-25T23:36:10.887950+0000","last_peered":"2023-10-25T23:36:10.887950+0000","last_clean":"2023-10-25T23:36:10.887950+0000","last_became_active":"2023-10-25T23:36:08.271188+0000","last_became_peered":"2023-10-25T23:36:08.271188+0000","last_unstale":"2023-10-25T23:36:10.887950+0000","last_undegraded":"2023-10-25T23:36:10.887950+0000","last_fullsized":"2023-10-25T23:36:10.887950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:51:48.005011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477103+0000","last_change":"2023-10-25T23:36:09.294928+0000","last_active":"2023-10-25T23:36:10.477103+0000","last_peered":"2023-10-25T23:36:10.477103+0000","last_clean":"2023-10-25T23:36:10.477103+0000","last_became_active":"2023-10-25T23:36:09.294200+0000","last_became_peered":"2023-10-25T23:36:09.294200+0000","last_unstale":"2023-10-25T23:36:10.477103+0000","last_undegraded":"2023-10-25T23:36:10.477103+0000","last_fullsized":"2023-10-25T23:36:10.477103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:29:19.996286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285380+0000","last_change":"2023-10-25T23:36:08.273427+0000","last_active":"2023-10-25T23:36:10.285380+0000","last_peered":"2023-10-25T23:36:10.285380+0000","last_clean":"2023-10-25T23:36:10.285380+0000","last_became_active":"2023-10-25T23:36:08.272301+0000","last_became_peered":"2023-10-25T23:36:08.272301+0000","last_unstale":"2023-10-25T23:36:10.285380+0000","last_undegraded":"2023-10-25T23:36:10.285380+0000","last_fullsized":"2023-10-25T23:36:10.285380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285377+0000","last_change":"2023-10-25T23:36:09.291952+0000","last_active":"2023-10-25T23:36:10.285377+0000","last_peered":"2023-10-25T23:36:10.285377+0000","last_clean":"2023-10-25T23:36:10.285377+0000","last_became_active":"2023-10-25T23:36:09.291305+0000","last_became_peered":"2023-10-25T23:36:09.291305+0000","last_unstale":"2023-10-25T23:36:10.285377+0000","last_undegraded":"2023-10-25T23:36:10.285377+0000","last_fullsized":"2023-10-25T23:36:10.285377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:38:19.348985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285555+0000","last_change":"2023-10-25T23:36:08.277621+0000","last_active":"2023-10-25T23:36:10.285555+0000","last_peered":"2023-10-25T23:36:10.285555+0000","last_clean":"2023-10-25T23:36:10.285555+0000","last_became_active":"2023-10-25T23:36:08.277327+0000","last_became_peered":"2023-10-25T23:36:08.277327+0000","last_unstale":"2023-10-25T23:36:10.285555+0000","last_undegraded":"2023-10-25T23:36:10.285555+0000","last_fullsized":"2023-10-25T23:36:10.285555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:04.918703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.476928+0000","last_change":"2023-10-25T23:36:09.295493+0000","last_active":"2023-10-25T23:36:10.476928+0000","last_peered":"2023-10-25T23:36:10.476928+0000","last_clean":"2023-10-25T23:36:10.476928+0000","last_became_active":"2023-10-25T23:36:09.295231+0000","last_became_peered":"2023-10-25T23:36:09.295231+0000","last_unstale":"2023-10-25T23:36:10.476928+0000","last_undegraded":"2023-10-25T23:36:10.476928+0000","last_fullsized":"2023-10-25T23:36:10.476928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:28:06.035601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286981+0000","last_change":"2023-10-25T23:36:08.263573+0000","last_active":"2023-10-25T23:36:10.286981+0000","last_peered":"2023-10-25T23:36:10.286981+0000","last_clean":"2023-10-25T23:36:10.286981+0000","last_became_active":"2023-10-25T23:36:08.263264+0000","last_became_peered":"2023-10-25T23:36:08.263264+0000","last_unstale":"2023-10-25T23:36:10.286981+0000","last_undegraded":"2023-10-25T23:36:10.286981+0000","last_fullsized":"2023-10-25T23:36:10.286981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477258+0000","last_change":"2023-10-25T23:36:09.294572+0000","last_active":"2023-10-25T23:36:10.477258+0000","last_peered":"2023-10-25T23:36:10.477258+0000","last_clean":"2023-10-25T23:36:10.477258+0000","last_became_active":"2023-10-25T23:36:09.294298+0000","last_became_peered":"2023-10-25T23:36:09.294298+0000","last_unstale":"2023-10-25T23:36:10.477258+0000","last_undegraded":"2023-10-25T23:36:10.477258+0000","last_fullsized":"2023-10-25T23:36:10.477258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:53:09.911467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.273530+0000","last_change":"2023-10-25T23:36:08.277383+0000","last_active":"2023-10-25T23:36:09.273530+0000","last_peered":"2023-10-25T23:36:09.273530+0000","last_clean":"2023-10-25T23:36:09.273530+0000","last_became_active":"2023-10-25T23:36:08.277087+0000","last_became_peered":"2023-10-25T23:36:08.277087+0000","last_unstale":"2023-10-25T23:36:09.273530+0000","last_undegraded":"2023-10-25T23:36:09.273530+0000","last_fullsized":"2023-10-25T23:36:09.273530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888072+0000","last_change":"2023-10-25T23:36:09.299356+0000","last_active":"2023-10-25T23:36:10.888072+0000","last_peered":"2023-10-25T23:36:10.888072+0000","last_clean":"2023-10-25T23:36:10.888072+0000","last_became_active":"2023-10-25T23:36:09.298782+0000","last_became_peered":"2023-10-25T23:36:09.298782+0000","last_unstale":"2023-10-25T23:36:10.888072+0000","last_undegraded":"2023-10-25T23:36:10.888072+0000","last_fullsized":"2023-10-25T23:36:10.888072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:26:02.311707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887844+0000","last_change":"2023-10-25T23:36:08.279568+0000","last_active":"2023-10-25T23:36:10.887844+0000","last_peered":"2023-10-25T23:36:10.887844+0000","last_clean":"2023-10-25T23:36:10.887844+0000","last_became_active":"2023-10-25T23:36:08.279302+0000","last_became_peered":"2023-10-25T23:36:08.279302+0000","last_unstale":"2023-10-25T23:36:10.887844+0000","last_undegraded":"2023-10-25T23:36:10.887844+0000","last_fullsized":"2023-10-25T23:36:10.887844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:27.340205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286808+0000","last_change":"2023-10-25T23:36:09.293019+0000","last_active":"2023-10-25T23:36:10.286808+0000","last_peered":"2023-10-25T23:36:10.286808+0000","last_clean":"2023-10-25T23:36:10.286808+0000","last_became_active":"2023-10-25T23:36:09.292670+0000","last_became_peered":"2023-10-25T23:36:09.292670+0000","last_unstale":"2023-10-25T23:36:10.286808+0000","last_undegraded":"2023-10-25T23:36:10.286808+0000","last_fullsized":"2023-10-25T23:36:10.286808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:05.924938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.295684+0000","last_change":"2023-10-25T23:36:09.284019+0000","last_active":"2023-10-25T23:36:09.295684+0000","last_peered":"2023-10-25T23:36:09.295684+0000","last_clean":"2023-10-25T23:36:09.295684+0000","last_became_active":"2023-10-25T23:36:09.283766+0000","last_became_peered":"2023-10-25T23:36:09.283766+0000","last_unstale":"2023-10-25T23:36:09.295684+0000","last_undegraded":"2023-10-25T23:36:09.295684+0000","last_fullsized":"2023-10-25T23:36:09.295684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:01:23.728788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285551+0000","last_change":"2023-10-25T23:36:08.264050+0000","last_active":"2023-10-25T23:36:10.285551+0000","last_peered":"2023-10-25T23:36:10.285551+0000","last_clean":"2023-10-25T23:36:10.285551+0000","last_became_active":"2023-10-25T23:36:08.263842+0000","last_became_peered":"2023-10-25T23:36:08.263842+0000","last_unstale":"2023-10-25T23:36:10.285551+0000","last_undegraded":"2023-10-25T23:36:10.285551+0000","last_fullsized":"2023-10-25T23:36:10.285551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:31.130445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298109+0000","last_change":"2023-10-25T23:36:09.295865+0000","last_active":"2023-10-25T23:36:09.298109+0000","last_peered":"2023-10-25T23:36:09.298109+0000","last_clean":"2023-10-25T23:36:09.298109+0000","last_became_active":"2023-10-25T23:36:09.295595+0000","last_became_peered":"2023-10-25T23:36:09.295595+0000","last_unstale":"2023-10-25T23:36:09.298109+0000","last_undegraded":"2023-10-25T23:36:09.298109+0000","last_fullsized":"2023-10-25T23:36:09.298109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:40.519153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887944+0000","last_change":"2023-10-25T23:36:08.272009+0000","last_active":"2023-10-25T23:36:10.887944+0000","last_peered":"2023-10-25T23:36:10.887944+0000","last_clean":"2023-10-25T23:36:10.887944+0000","last_became_active":"2023-10-25T23:36:08.271640+0000","last_became_peered":"2023-10-25T23:36:08.271640+0000","last_unstale":"2023-10-25T23:36:10.887944+0000","last_undegraded":"2023-10-25T23:36:10.887944+0000","last_fullsized":"2023-10-25T23:36:10.887944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:40.023263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.281002+0000","last_change":"2023-10-25T23:35:58.277542+0000","last_active":"2023-10-25T23:36:09.281002+0000","last_peered":"2023-10-25T23:36:09.281002+0000","last_clean":"2023-10-25T23:36:09.281002+0000","last_became_active":"2023-10-25T23:35:58.276606+0000","last_became_peered":"2023-10-25T23:35:58.276606+0000","last_unstale":"2023-10-25T23:36:09.281002+0000","last_undegraded":"2023-10-25T23:36:09.281002+0000","last_fullsized":"2023-10-25T23:36:09.281002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:35:57.197265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:35:57.197265+0000","last_clean_scrub_stamp":"2023-10-25T23:35:57.197265+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:53:55.116662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.300287+0000","last_change":"2023-10-25T23:36:09.291404+0000","last_active":"2023-10-25T23:36:09.300287+0000","last_peered":"2023-10-25T23:36:09.300287+0000","last_clean":"2023-10-25T23:36:09.300287+0000","last_became_active":"2023-10-25T23:36:09.291072+0000","last_became_peered":"2023-10-25T23:36:09.291072+0000","last_unstale":"2023-10-25T23:36:09.300287+0000","last_undegraded":"2023-10-25T23:36:09.300287+0000","last_fullsized":"2023-10-25T23:36:09.300287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:36:48.130904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.476857+0000","last_change":"2023-10-25T23:36:08.277937+0000","last_active":"2023-10-25T23:36:10.476857+0000","last_peered":"2023-10-25T23:36:10.476857+0000","last_clean":"2023-10-25T23:36:10.476857+0000","last_became_active":"2023-10-25T23:36:08.277663+0000","last_became_peered":"2023-10-25T23:36:08.277663+0000","last_unstale":"2023-10-25T23:36:10.476857+0000","last_undegraded":"2023-10-25T23:36:10.476857+0000","last_fullsized":"2023-10-25T23:36:10.476857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:04.918703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477388+0000","last_change":"2023-10-25T23:36:08.270783+0000","last_active":"2023-10-25T23:36:10.477388+0000","last_peered":"2023-10-25T23:36:10.477388+0000","last_clean":"2023-10-25T23:36:10.477388+0000","last_became_active":"2023-10-25T23:36:08.269896+0000","last_became_peered":"2023-10-25T23:36:08.269896+0000","last_unstale":"2023-10-25T23:36:10.477388+0000","last_undegraded":"2023-10-25T23:36:10.477388+0000","last_fullsized":"2023-10-25T23:36:10.477388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.283893+0000","last_change":"2023-10-25T23:36:09.279236+0000","last_active":"2023-10-25T23:36:09.283893+0000","last_peered":"2023-10-25T23:36:09.283893+0000","last_clean":"2023-10-25T23:36:09.283893+0000","last_became_active":"2023-10-25T23:36:09.278967+0000","last_became_peered":"2023-10-25T23:36:09.278967+0000","last_unstale":"2023-10-25T23:36:09.283893+0000","last_undegraded":"2023-10-25T23:36:09.283893+0000","last_fullsized":"2023-10-25T23:36:09.283893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:05.924938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.274054+0000","last_change":"2023-10-25T23:36:08.279363+0000","last_active":"2023-10-25T23:36:09.274054+0000","last_peered":"2023-10-25T23:36:09.274054+0000","last_clean":"2023-10-25T23:36:09.274054+0000","last_became_active":"2023-10-25T23:36:08.279082+0000","last_became_peered":"2023-10-25T23:36:08.279082+0000","last_unstale":"2023-10-25T23:36:09.274054+0000","last_undegraded":"2023-10-25T23:36:09.274054+0000","last_fullsized":"2023-10-25T23:36:09.274054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298000+0000","last_change":"2023-10-25T23:36:09.290430+0000","last_active":"2023-10-25T23:36:09.298000+0000","last_peered":"2023-10-25T23:36:09.298000+0000","last_clean":"2023-10-25T23:36:09.298000+0000","last_became_active":"2023-10-25T23:36:09.289751+0000","last_became_peered":"2023-10-25T23:36:09.289751+0000","last_unstale":"2023-10-25T23:36:09.298000+0000","last_undegraded":"2023-10-25T23:36:09.298000+0000","last_fullsized":"2023-10-25T23:36:09.298000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:46.184346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285500+0000","last_change":"2023-10-25T23:36:08.274349+0000","last_active":"2023-10-25T23:36:10.285500+0000","last_peered":"2023-10-25T23:36:10.285500+0000","last_clean":"2023-10-25T23:36:10.285500+0000","last_became_active":"2023-10-25T23:36:08.273029+0000","last_became_peered":"2023-10-25T23:36:08.273029+0000","last_unstale":"2023-10-25T23:36:10.285500+0000","last_undegraded":"2023-10-25T23:36:10.285500+0000","last_fullsized":"2023-10-25T23:36:10.285500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.299735+0000","last_change":"2023-10-25T23:36:09.287779+0000","last_active":"2023-10-25T23:36:09.299735+0000","last_peered":"2023-10-25T23:36:09.299735+0000","last_clean":"2023-10-25T23:36:09.299735+0000","last_became_active":"2023-10-25T23:36:09.287532+0000","last_became_peered":"2023-10-25T23:36:09.287532+0000","last_unstale":"2023-10-25T23:36:09.299735+0000","last_undegraded":"2023-10-25T23:36:09.299735+0000","last_fullsized":"2023-10-25T23:36:09.299735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:32.136680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.476756+0000","last_change":"2023-10-25T23:36:08.266963+0000","last_active":"2023-10-25T23:36:10.476756+0000","last_peered":"2023-10-25T23:36:10.476756+0000","last_clean":"2023-10-25T23:36:10.476756+0000","last_became_active":"2023-10-25T23:36:08.266648+0000","last_became_peered":"2023-10-25T23:36:08.266648+0000","last_unstale":"2023-10-25T23:36:10.476756+0000","last_undegraded":"2023-10-25T23:36:10.476756+0000","last_fullsized":"2023-10-25T23:36:10.476756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:31.130445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286767+0000","last_change":"2023-10-25T23:36:09.285305+0000","last_active":"2023-10-25T23:36:10.286767+0000","last_peered":"2023-10-25T23:36:10.286767+0000","last_clean":"2023-10-25T23:36:10.286767+0000","last_became_active":"2023-10-25T23:36:09.284666+0000","last_became_peered":"2023-10-25T23:36:09.284666+0000","last_unstale":"2023-10-25T23:36:10.286767+0000","last_undegraded":"2023-10-25T23:36:10.286767+0000","last_fullsized":"2023-10-25T23:36:10.286767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:32.136680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.273237+0000","last_change":"2023-10-25T23:36:08.278162+0000","last_active":"2023-10-25T23:36:09.273237+0000","last_peered":"2023-10-25T23:36:09.273237+0000","last_clean":"2023-10-25T23:36:09.273237+0000","last_became_active":"2023-10-25T23:36:08.277873+0000","last_became_peered":"2023-10-25T23:36:08.277873+0000","last_unstale":"2023-10-25T23:36:09.273237+0000","last_undegraded":"2023-10-25T23:36:09.273237+0000","last_fullsized":"2023-10-25T23:36:09.273237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.297898+0000","last_change":"2023-10-25T23:36:09.289615+0000","last_active":"2023-10-25T23:36:09.297898+0000","last_peered":"2023-10-25T23:36:09.297898+0000","last_clean":"2023-10-25T23:36:09.297898+0000","last_became_active":"2023-10-25T23:36:09.289320+0000","last_became_peered":"2023-10-25T23:36:09.289320+0000","last_unstale":"2023-10-25T23:36:09.297898+0000","last_undegraded":"2023-10-25T23:36:09.297898+0000","last_fullsized":"2023-10-25T23:36:09.297898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:01:23.728788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.273563+0000","last_change":"2023-10-25T23:36:08.278921+0000","last_active":"2023-10-25T23:36:09.273563+0000","last_peered":"2023-10-25T23:36:09.273563+0000","last_clean":"2023-10-25T23:36:09.273563+0000","last_became_active":"2023-10-25T23:36:08.278656+0000","last_became_peered":"2023-10-25T23:36:08.278656+0000","last_unstale":"2023-10-25T23:36:09.273563+0000","last_undegraded":"2023-10-25T23:36:09.273563+0000","last_fullsized":"2023-10-25T23:36:09.273563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298219+0000","last_change":"2023-10-25T23:36:09.293076+0000","last_active":"2023-10-25T23:36:09.298219+0000","last_peered":"2023-10-25T23:36:09.298219+0000","last_clean":"2023-10-25T23:36:09.298219+0000","last_became_active":"2023-10-25T23:36:09.292345+0000","last_became_peered":"2023-10-25T23:36:09.292345+0000","last_unstale":"2023-10-25T23:36:09.298219+0000","last_undegraded":"2023-10-25T23:36:09.298219+0000","last_fullsized":"2023-10-25T23:36:09.298219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:41:31.211304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477225+0000","last_change":"2023-10-25T23:36:08.270589+0000","last_active":"2023-10-25T23:36:10.477225+0000","last_peered":"2023-10-25T23:36:10.477225+0000","last_clean":"2023-10-25T23:36:10.477225+0000","last_became_active":"2023-10-25T23:36:08.268753+0000","last_became_peered":"2023-10-25T23:36:08.268753+0000","last_unstale":"2023-10-25T23:36:10.477225+0000","last_undegraded":"2023-10-25T23:36:10.477225+0000","last_fullsized":"2023-10-25T23:36:10.477225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285622+0000","last_change":"2023-10-25T23:36:09.290423+0000","last_active":"2023-10-25T23:36:10.285622+0000","last_peered":"2023-10-25T23:36:10.285622+0000","last_clean":"2023-10-25T23:36:10.285622+0000","last_became_active":"2023-10-25T23:36:09.290151+0000","last_became_peered":"2023-10-25T23:36:09.290151+0000","last_unstale":"2023-10-25T23:36:10.285622+0000","last_undegraded":"2023-10-25T23:36:10.285622+0000","last_fullsized":"2023-10-25T23:36:10.285622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:51:49.011246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285753+0000","last_change":"2023-10-25T23:36:08.272161+0000","last_active":"2023-10-25T23:36:10.285753+0000","last_peered":"2023-10-25T23:36:10.285753+0000","last_clean":"2023-10-25T23:36:10.285753+0000","last_became_active":"2023-10-25T23:36:08.271846+0000","last_became_peered":"2023-10-25T23:36:08.271846+0000","last_unstale":"2023-10-25T23:36:10.285753+0000","last_undegraded":"2023-10-25T23:36:10.285753+0000","last_fullsized":"2023-10-25T23:36:10.285753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:39.512919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477335+0000","last_change":"2023-10-25T23:36:09.295948+0000","last_active":"2023-10-25T23:36:10.477335+0000","last_peered":"2023-10-25T23:36:10.477335+0000","last_clean":"2023-10-25T23:36:10.477335+0000","last_became_active":"2023-10-25T23:36:09.295635+0000","last_became_peered":"2023-10-25T23:36:09.295635+0000","last_unstale":"2023-10-25T23:36:10.477335+0000","last_undegraded":"2023-10-25T23:36:10.477335+0000","last_fullsized":"2023-10-25T23:36:10.477335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:26:02.311707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298927+0000","last_change":"2023-10-25T23:36:08.277618+0000","last_active":"2023-10-25T23:36:09.298927+0000","last_peered":"2023-10-25T23:36:09.298927+0000","last_clean":"2023-10-25T23:36:09.298927+0000","last_became_active":"2023-10-25T23:36:08.277344+0000","last_became_peered":"2023-10-25T23:36:08.277344+0000","last_unstale":"2023-10-25T23:36:09.298927+0000","last_undegraded":"2023-10-25T23:36:09.298927+0000","last_fullsized":"2023-10-25T23:36:09.298927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:21:29.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887766+0000","last_change":"2023-10-25T23:36:09.300169+0000","last_active":"2023-10-25T23:36:10.887766+0000","last_peered":"2023-10-25T23:36:10.887766+0000","last_clean":"2023-10-25T23:36:10.887766+0000","last_became_active":"2023-10-25T23:36:09.299234+0000","last_became_peered":"2023-10-25T23:36:09.299234+0000","last_unstale":"2023-10-25T23:36:10.887766+0000","last_undegraded":"2023-10-25T23:36:10.887766+0000","last_fullsized":"2023-10-25T23:36:10.887766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:29:19.996286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285721+0000","last_change":"2023-10-25T23:36:08.269389+0000","last_active":"2023-10-25T23:36:10.285721+0000","last_peered":"2023-10-25T23:36:10.285721+0000","last_clean":"2023-10-25T23:36:10.285721+0000","last_became_active":"2023-10-25T23:36:08.269065+0000","last_became_peered":"2023-10-25T23:36:08.269065+0000","last_unstale":"2023-10-25T23:36:10.285721+0000","last_undegraded":"2023-10-25T23:36:10.285721+0000","last_fullsized":"2023-10-25T23:36:10.285721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477633+0000","last_change":"2023-10-25T23:36:09.294804+0000","last_active":"2023-10-25T23:36:10.477633+0000","last_peered":"2023-10-25T23:36:10.477633+0000","last_clean":"2023-10-25T23:36:10.477633+0000","last_became_active":"2023-10-25T23:36:09.294494+0000","last_became_peered":"2023-10-25T23:36:09.294494+0000","last_unstale":"2023-10-25T23:36:10.477633+0000","last_undegraded":"2023-10-25T23:36:10.477633+0000","last_fullsized":"2023-10-25T23:36:10.477633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:11:17.452696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285801+0000","last_change":"2023-10-25T23:36:09.292116+0000","last_active":"2023-10-25T23:36:10.285801+0000","last_peered":"2023-10-25T23:36:10.285801+0000","last_clean":"2023-10-25T23:36:10.285801+0000","last_became_active":"2023-10-25T23:36:09.291665+0000","last_became_peered":"2023-10-25T23:36:09.291665+0000","last_unstale":"2023-10-25T23:36:10.285801+0000","last_undegraded":"2023-10-25T23:36:10.285801+0000","last_fullsized":"2023-10-25T23:36:10.285801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:48:33.297905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285669+0000","last_change":"2023-10-25T23:36:09.296271+0000","last_active":"2023-10-25T23:36:10.285669+0000","last_peered":"2023-10-25T23:36:10.285669+0000","last_clean":"2023-10-25T23:36:10.285669+0000","last_became_active":"2023-10-25T23:36:09.295817+0000","last_became_peered":"2023-10-25T23:36:09.295817+0000","last_unstale":"2023-10-25T23:36:10.285669+0000","last_undegraded":"2023-10-25T23:36:10.285669+0000","last_fullsized":"2023-10-25T23:36:10.285669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:41.029497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887836+0000","last_change":"2023-10-25T23:36:09.299282+0000","last_active":"2023-10-25T23:36:10.887836+0000","last_peered":"2023-10-25T23:36:10.887836+0000","last_clean":"2023-10-25T23:36:10.887836+0000","last_became_active":"2023-10-25T23:36:09.299024+0000","last_became_peered":"2023-10-25T23:36:09.299024+0000","last_unstale":"2023-10-25T23:36:10.887836+0000","last_undegraded":"2023-10-25T23:36:10.887836+0000","last_fullsized":"2023-10-25T23:36:10.887836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:46:03.954978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.300372+0000","last_change":"2023-10-25T23:36:09.292598+0000","last_active":"2023-10-25T23:36:09.300372+0000","last_peered":"2023-10-25T23:36:09.300372+0000","last_clean":"2023-10-25T23:36:09.300372+0000","last_became_active":"2023-10-25T23:36:09.292344+0000","last_became_peered":"2023-10-25T23:36:09.292344+0000","last_unstale":"2023-10-25T23:36:09.300372+0000","last_undegraded":"2023-10-25T23:36:09.300372+0000","last_fullsized":"2023-10-25T23:36:09.300372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:01:23.728788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298408+0000","last_change":"2023-10-25T23:36:09.297451+0000","last_active":"2023-10-25T23:36:09.298408+0000","last_peered":"2023-10-25T23:36:09.298408+0000","last_clean":"2023-10-25T23:36:09.298408+0000","last_became_active":"2023-10-25T23:36:09.297202+0000","last_became_peered":"2023-10-25T23:36:09.297202+0000","last_unstale":"2023-10-25T23:36:09.298408+0000","last_undegraded":"2023-10-25T23:36:09.298408+0000","last_fullsized":"2023-10-25T23:36:09.298408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:36.336468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.295322+0000","last_change":"2023-10-25T23:36:09.293431+0000","last_active":"2023-10-25T23:36:09.295322+0000","last_peered":"2023-10-25T23:36:09.295322+0000","last_clean":"2023-10-25T23:36:09.295322+0000","last_became_active":"2023-10-25T23:36:09.293157+0000","last_became_peered":"2023-10-25T23:36:09.293157+0000","last_unstale":"2023-10-25T23:36:09.295322+0000","last_undegraded":"2023-10-25T23:36:09.295322+0000","last_fullsized":"2023-10-25T23:36:09.295322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:41.029497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285934+0000","last_change":"2023-10-25T23:36:09.288432+0000","last_active":"2023-10-25T23:36:10.285934+0000","last_peered":"2023-10-25T23:36:10.285934+0000","last_clean":"2023-10-25T23:36:10.285934+0000","last_became_active":"2023-10-25T23:36:09.288127+0000","last_became_peered":"2023-10-25T23:36:09.288127+0000","last_unstale":"2023-10-25T23:36:10.285934+0000","last_undegraded":"2023-10-25T23:36:10.285934+0000","last_fullsized":"2023-10-25T23:36:10.285934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:06.986689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298019+0000","last_change":"2023-10-25T23:36:09.290608+0000","last_active":"2023-10-25T23:36:09.298019+0000","last_peered":"2023-10-25T23:36:09.298019+0000","last_clean":"2023-10-25T23:36:09.298019+0000","last_became_active":"2023-10-25T23:36:09.290160+0000","last_became_peered":"2023-10-25T23:36:09.290160+0000","last_unstale":"2023-10-25T23:36:09.298019+0000","last_undegraded":"2023-10-25T23:36:09.298019+0000","last_fullsized":"2023-10-25T23:36:09.298019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:01.440988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887814+0000","last_change":"2023-10-25T23:36:09.298886+0000","last_active":"2023-10-25T23:36:10.887814+0000","last_peered":"2023-10-25T23:36:10.887814+0000","last_clean":"2023-10-25T23:36:10.887814+0000","last_became_active":"2023-10-25T23:36:09.298637+0000","last_became_peered":"2023-10-25T23:36:09.298637+0000","last_unstale":"2023-10-25T23:36:10.887814+0000","last_undegraded":"2023-10-25T23:36:10.887814+0000","last_fullsized":"2023-10-25T23:36:10.887814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:58:48.401709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298019+0000","last_change":"2023-10-25T23:36:09.290809+0000","last_active":"2023-10-25T23:36:09.298019+0000","last_peered":"2023-10-25T23:36:09.298019+0000","last_clean":"2023-10-25T23:36:09.298019+0000","last_became_active":"2023-10-25T23:36:09.290546+0000","last_became_peered":"2023-10-25T23:36:09.290546+0000","last_unstale":"2023-10-25T23:36:09.298019+0000","last_undegraded":"2023-10-25T23:36:09.298019+0000","last_fullsized":"2023-10-25T23:36:09.298019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:05.924938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887720+0000","last_change":"2023-10-25T23:36:09.296735+0000","last_active":"2023-10-25T23:36:10.887720+0000","last_peered":"2023-10-25T23:36:10.887720+0000","last_clean":"2023-10-25T23:36:10.887720+0000","last_became_active":"2023-10-25T23:36:09.296280+0000","last_became_peered":"2023-10-25T23:36:09.296280+0000","last_unstale":"2023-10-25T23:36:10.887720+0000","last_undegraded":"2023-10-25T23:36:10.887720+0000","last_fullsized":"2023-10-25T23:36:10.887720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:28:06.035601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.299782+0000","last_change":"2023-10-25T23:36:09.285887+0000","last_active":"2023-10-25T23:36:09.299782+0000","last_peered":"2023-10-25T23:36:09.299782+0000","last_clean":"2023-10-25T23:36:09.299782+0000","last_became_active":"2023-10-25T23:36:09.285610+0000","last_became_peered":"2023-10-25T23:36:09.285610+0000","last_unstale":"2023-10-25T23:36:09.299782+0000","last_undegraded":"2023-10-25T23:36:09.299782+0000","last_fullsized":"2023-10-25T23:36:09.299782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:05.924938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285693+0000","last_change":"2023-10-25T23:36:09.291838+0000","last_active":"2023-10-25T23:36:10.285693+0000","last_peered":"2023-10-25T23:36:10.285693+0000","last_clean":"2023-10-25T23:36:10.285693+0000","last_became_active":"2023-10-25T23:36:09.291566+0000","last_became_peered":"2023-10-25T23:36:09.291566+0000","last_unstale":"2023-10-25T23:36:10.285693+0000","last_undegraded":"2023-10-25T23:36:10.285693+0000","last_fullsized":"2023-10-25T23:36:10.285693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:26:04.639901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":69429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":660275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":70881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":69359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-25T23:36:13.384 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T23:36:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.537+0000 7fea9bc19700 1 -- 172.21.15.81:0/988426803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9414cef0 msgr2=0x7fea94149b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.537+0000 7fea9bc19700 1 --2- 172.21.15.81:0/988426803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9414cef0 0x7fea94149b40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009fd0 tx=0x7fea8c00b380 comp rx=0 tx=0).stop 2023-10-25T23:36:13.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.537+0000 7fea9bc19700 1 -- 172.21.15.81:0/988426803 shutdown_connections 2023-10-25T23:36:13.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.537+0000 7fea9bc19700 1 --2- 172.21.15.81:0/988426803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9414cef0 0x7fea94149b40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.537+0000 7fea9bc19700 1 --2- 172.21.15.81:0/988426803 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea9406b490 0x7fea94149600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.537+0000 7fea9bc19700 1 -- 172.21.15.81:0/988426803 >> 172.21.15.81:0/988426803 conn(0x7fea9406d8b0 msgr2=0x7fea9406dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:13.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.537+0000 7fea9bc19700 1 -- 172.21.15.81:0/988426803 shutdown_connections 2023-10-25T23:36:13.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.537+0000 7fea9bc19700 1 -- 172.21.15.81:0/988426803 wait complete. 2023-10-25T23:36:13.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.538+0000 7fea9bc19700 1 Processor -- start 2023-10-25T23:36:13.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.538+0000 7fea9bc19700 1 -- start start 2023-10-25T23:36:13.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.539+0000 7fea9bc19700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea9406b490 0x7fea9413bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:13.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.539+0000 7fea9bc19700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea940bc870 0x7fea941e24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:13.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.539+0000 7fea9bc19700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea9414cef0 0x7fea941e2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:13.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.539+0000 7fea9bc19700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea94141a60 con 0x7fea940bc870 2023-10-25T23:36:13.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.539+0000 7fea9bc19700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea94141130 con 0x7fea9406b490 2023-10-25T23:36:13.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.539+0000 7fea9bc19700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea940be200 con 0x7fea9414cef0 2023-10-25T23:36:13.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.539+0000 7fea991b4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea940bc870 0x7fea941e24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:13.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.539+0000 7fea991b4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea940bc870 0x7fea941e24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36228/0 (socket says 172.21.15.81:36228) 2023-10-25T23:36:13.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.539+0000 7fea991b4700 1 -- 172.21.15.81:0/362914056 learned_addr learned my addr 172.21.15.81:0/362914056 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:13.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.539+0000 7fea999b5700 1 --2- 172.21.15.81:0/362914056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea9406b490 0x7fea9413bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:13.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.539+0000 7fea9a1b6700 1 --2- 172.21.15.81:0/362914056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea9414cef0 0x7fea941e2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:13.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.540+0000 7fea991b4700 1 -- 172.21.15.81:0/362914056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea9414cef0 msgr2=0x7fea941e2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:13.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.540+0000 7fea991b4700 1 --2- 172.21.15.81:0/362914056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea9414cef0 0x7fea941e2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.540+0000 7fea991b4700 1 -- 172.21.15.81:0/362914056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea9406b490 msgr2=0x7fea9413bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:13.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.540+0000 7fea991b4700 1 --2- 172.21.15.81:0/362914056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea9406b490 0x7fea9413bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.540+0000 7fea991b4700 1 -- 172.21.15.81:0/362914056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c009d00 con 0x7fea940bc870 2023-10-25T23:36:13.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.540+0000 7fea9a1b6700 1 --2- 172.21.15.81:0/362914056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea9414cef0 0x7fea941e2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:36:13.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.540+0000 7fea991b4700 1 --2- 172.21.15.81:0/362914056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea940bc870 0x7fea941e24e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fea8400c550 tx=0x7fea8400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:13.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.540+0000 7fea8a7fc700 1 -- 172.21.15.81:0/362914056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea840054e0 con 0x7fea940bc870 2023-10-25T23:36:13.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.540+0000 7fea8a7fc700 1 -- 172.21.15.81:0/362914056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fea84003680 con 0x7fea940bc870 2023-10-25T23:36:13.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.540+0000 7fea9bc19700 1 -- 172.21.15.81:0/362914056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea941413a0 con 0x7fea940bc870 2023-10-25T23:36:13.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.540+0000 7fea8a7fc700 1 -- 172.21.15.81:0/362914056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea84003a90 con 0x7fea940bc870 2023-10-25T23:36:13.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.540+0000 7fea9bc19700 1 -- 172.21.15.81:0/362914056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9413c520 con 0x7fea940bc870 2023-10-25T23:36:13.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.541+0000 7fea9bc19700 1 -- 172.21.15.81:0/362914056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea94067490 con 0x7fea940bc870 2023-10-25T23:36:13.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.541+0000 7fea8a7fc700 1 -- 172.21.15.81:0/362914056 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fea84003bf0 con 0x7fea940bc870 2023-10-25T23:36:13.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.541+0000 7fea8a7fc700 1 --2- 172.21.15.81:0/362914056 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fea7806aed0 0x7fea7806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:13.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.542+0000 7fea8a7fc700 1 -- 172.21.15.81:0/362914056 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea84088d10 con 0x7fea940bc870 2023-10-25T23:36:13.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.542+0000 7fea999b5700 1 --2- 172.21.15.81:0/362914056 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fea7806aed0 0x7fea7806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:13.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.542+0000 7fea999b5700 1 --2- 172.21.15.81:0/362914056 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fea7806aed0 0x7fea7806d390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fea90005ea0 tx=0x7fea90005e30 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:13.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.547+0000 7fea8a7fc700 1 -- 172.21.15.81:0/362914056 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fea84053db0 con 0x7fea940bc870 2023-10-25T23:36:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.731+0000 7fea9bc19700 1 -- 172.21.15.81:0/362914056 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fea94141ba0 con 0x7fea7806aed0 2023-10-25T23:36:13.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.740+0000 7fea8a7fc700 1 -- 172.21.15.81:0/362914056 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264658 (secure 0 0 0) 0x7fea94141ba0 con 0x7fea7806aed0 2023-10-25T23:36:13.744 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:13.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.742+0000 7fea9bc19700 1 -- 172.21.15.81:0/362914056 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fea7806aed0 msgr2=0x7fea7806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:13.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.742+0000 7fea9bc19700 1 --2- 172.21.15.81:0/362914056 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fea7806aed0 0x7fea7806d390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fea90005ea0 tx=0x7fea90005e30 comp rx=0 tx=0).stop 2023-10-25T23:36:13.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.742+0000 7fea9bc19700 1 -- 172.21.15.81:0/362914056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea940bc870 msgr2=0x7fea941e24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.742+0000 7fea9bc19700 1 --2- 172.21.15.81:0/362914056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea940bc870 0x7fea941e24e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fea8400c550 tx=0x7fea8400c910 comp rx=0 tx=0).stop 2023-10-25T23:36:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.742+0000 7fea9bc19700 1 -- 172.21.15.81:0/362914056 shutdown_connections 2023-10-25T23:36:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.742+0000 7fea9bc19700 1 --2- 172.21.15.81:0/362914056 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea9414cef0 0x7fea941e2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.742+0000 7fea9bc19700 1 --2- 172.21.15.81:0/362914056 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fea7806aed0 0x7fea7806d390 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.742+0000 7fea9bc19700 1 --2- 172.21.15.81:0/362914056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea9406b490 0x7fea9413bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.742+0000 7fea9bc19700 1 --2- 172.21.15.81:0/362914056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea940bc870 0x7fea941e24e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.742+0000 7fea9bc19700 1 -- 172.21.15.81:0/362914056 >> 172.21.15.81:0/362914056 conn(0x7fea9406d8b0 msgr2=0x7fea9414b250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.742+0000 7fea9bc19700 1 -- 172.21.15.81:0/362914056 shutdown_connections 2023-10-25T23:36:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.742+0000 7fea9bc19700 1 -- 172.21.15.81:0/362914056 wait complete. 2023-10-25T23:36:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-25T23:36:13.756 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-25T23:36:12.990097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219068,"kb_used_data":2872,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755652,"statfs":{"total":773094113280,"available":772869787648,"internally_reserved":0,"allocated":2940928,"data_stored":1764908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.734895"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477723+0000","last_change":"2023-10-25T23:36:09.292535+0000","last_active":"2023-10-25T23:36:10.477723+0000","last_peered":"2023-10-25T23:36:10.477723+0000","last_clean":"2023-10-25T23:36:10.477723+0000","last_became_active":"2023-10-25T23:36:09.292007+0000","last_became_peered":"2023-10-25T23:36:09.292007+0000","last_unstale":"2023-10-25T23:36:10.477723+0000","last_undegraded":"2023-10-25T23:36:10.477723+0000","last_fullsized":"2023-10-25T23:36:10.477723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:54:42.179401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.293501+0000","last_change":"2023-10-25T23:36:09.282198+0000","last_active":"2023-10-25T23:36:09.293501+0000","last_peered":"2023-10-25T23:36:09.293501+0000","last_clean":"2023-10-25T23:36:09.293501+0000","last_became_active":"2023-10-25T23:36:09.281890+0000","last_became_peered":"2023-10-25T23:36:09.281890+0000","last_unstale":"2023-10-25T23:36:09.293501+0000","last_undegraded":"2023-10-25T23:36:09.293501+0000","last_fullsized":"2023-10-25T23:36:09.293501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:11:38.668268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.299544+0000","last_change":"2023-10-25T23:36:09.284367+0000","last_active":"2023-10-25T23:36:09.299544+0000","last_peered":"2023-10-25T23:36:09.299544+0000","last_clean":"2023-10-25T23:36:09.299544+0000","last_became_active":"2023-10-25T23:36:09.284066+0000","last_became_peered":"2023-10-25T23:36:09.284066+0000","last_unstale":"2023-10-25T23:36:09.299544+0000","last_undegraded":"2023-10-25T23:36:09.299544+0000","last_fullsized":"2023-10-25T23:36:09.299544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:27.001592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887928+0000","last_change":"2023-10-25T23:36:09.300380+0000","last_active":"2023-10-25T23:36:10.887928+0000","last_peered":"2023-10-25T23:36:10.887928+0000","last_clean":"2023-10-25T23:36:10.887928+0000","last_became_active":"2023-10-25T23:36:09.299585+0000","last_became_peered":"2023-10-25T23:36:09.299585+0000","last_unstale":"2023-10-25T23:36:10.887928+0000","last_undegraded":"2023-10-25T23:36:10.887928+0000","last_fullsized":"2023-10-25T23:36:10.887928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:54.492612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477102+0000","last_change":"2023-10-25T23:36:09.287693+0000","last_active":"2023-10-25T23:36:10.477102+0000","last_peered":"2023-10-25T23:36:10.477102+0000","last_clean":"2023-10-25T23:36:10.477102+0000","last_became_active":"2023-10-25T23:36:09.287403+0000","last_became_peered":"2023-10-25T23:36:09.287403+0000","last_unstale":"2023-10-25T23:36:10.477102+0000","last_undegraded":"2023-10-25T23:36:10.477102+0000","last_fullsized":"2023-10-25T23:36:10.477102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:58:48.401709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887662+0000","last_change":"2023-10-25T23:36:09.301596+0000","last_active":"2023-10-25T23:36:10.887662+0000","last_peered":"2023-10-25T23:36:10.887662+0000","last_clean":"2023-10-25T23:36:10.887662+0000","last_became_active":"2023-10-25T23:36:09.301305+0000","last_became_peered":"2023-10-25T23:36:09.301305+0000","last_unstale":"2023-10-25T23:36:10.887662+0000","last_undegraded":"2023-10-25T23:36:10.887662+0000","last_fullsized":"2023-10-25T23:36:10.887662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:24:52.973821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477210+0000","last_change":"2023-10-25T23:36:09.293643+0000","last_active":"2023-10-25T23:36:10.477210+0000","last_peered":"2023-10-25T23:36:10.477210+0000","last_clean":"2023-10-25T23:36:10.477210+0000","last_became_active":"2023-10-25T23:36:09.293173+0000","last_became_peered":"2023-10-25T23:36:09.293173+0000","last_unstale":"2023-10-25T23:36:10.477210+0000","last_undegraded":"2023-10-25T23:36:10.477210+0000","last_fullsized":"2023-10-25T23:36:10.477210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:54.492612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298104+0000","last_change":"2023-10-25T23:36:09.295727+0000","last_active":"2023-10-25T23:36:09.298104+0000","last_peered":"2023-10-25T23:36:09.298104+0000","last_clean":"2023-10-25T23:36:09.298104+0000","last_became_active":"2023-10-25T23:36:09.295518+0000","last_became_peered":"2023-10-25T23:36:09.295518+0000","last_unstale":"2023-10-25T23:36:09.298104+0000","last_undegraded":"2023-10-25T23:36:09.298104+0000","last_fullsized":"2023-10-25T23:36:09.298104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:27.001592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477732+0000","last_change":"2023-10-25T23:36:09.297377+0000","last_active":"2023-10-25T23:36:10.477732+0000","last_peered":"2023-10-25T23:36:10.477732+0000","last_clean":"2023-10-25T23:36:10.477732+0000","last_became_active":"2023-10-25T23:36:09.297036+0000","last_became_peered":"2023-10-25T23:36:09.297036+0000","last_unstale":"2023-10-25T23:36:10.477732+0000","last_undegraded":"2023-10-25T23:36:10.477732+0000","last_fullsized":"2023-10-25T23:36:10.477732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:18:29.087327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285803+0000","last_change":"2023-10-25T23:36:09.298222+0000","last_active":"2023-10-25T23:36:10.285803+0000","last_peered":"2023-10-25T23:36:10.285803+0000","last_clean":"2023-10-25T23:36:10.285803+0000","last_became_active":"2023-10-25T23:36:09.297713+0000","last_became_peered":"2023-10-25T23:36:09.297713+0000","last_unstale":"2023-10-25T23:36:10.285803+0000","last_undegraded":"2023-10-25T23:36:10.285803+0000","last_fullsized":"2023-10-25T23:36:10.285803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:09:27.102927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285557+0000","last_change":"2023-10-25T23:36:09.297392+0000","last_active":"2023-10-25T23:36:10.285557+0000","last_peered":"2023-10-25T23:36:10.285557+0000","last_clean":"2023-10-25T23:36:10.285557+0000","last_became_active":"2023-10-25T23:36:09.297133+0000","last_became_peered":"2023-10-25T23:36:09.297133+0000","last_unstale":"2023-10-25T23:36:10.285557+0000","last_undegraded":"2023-10-25T23:36:10.285557+0000","last_fullsized":"2023-10-25T23:36:10.285557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:28.346439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.287003+0000","last_change":"2023-10-25T23:36:09.291669+0000","last_active":"2023-10-25T23:36:10.287003+0000","last_peered":"2023-10-25T23:36:10.287003+0000","last_clean":"2023-10-25T23:36:10.287003+0000","last_became_active":"2023-10-25T23:36:09.291351+0000","last_became_peered":"2023-10-25T23:36:09.291351+0000","last_unstale":"2023-10-25T23:36:10.287003+0000","last_undegraded":"2023-10-25T23:36:10.287003+0000","last_fullsized":"2023-10-25T23:36:10.287003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:01.440988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298199+0000","last_change":"2023-10-25T23:36:09.290180+0000","last_active":"2023-10-25T23:36:09.298199+0000","last_peered":"2023-10-25T23:36:09.298199+0000","last_clean":"2023-10-25T23:36:09.298199+0000","last_became_active":"2023-10-25T23:36:09.289895+0000","last_became_peered":"2023-10-25T23:36:09.289895+0000","last_unstale":"2023-10-25T23:36:09.298199+0000","last_undegraded":"2023-10-25T23:36:09.298199+0000","last_fullsized":"2023-10-25T23:36:09.298199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:28:35.026841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.290456+0000","last_change":"2023-10-25T23:36:09.283494+0000","last_active":"2023-10-25T23:36:09.290456+0000","last_peered":"2023-10-25T23:36:09.290456+0000","last_clean":"2023-10-25T23:36:09.290456+0000","last_became_active":"2023-10-25T23:36:09.283250+0000","last_became_peered":"2023-10-25T23:36:09.283250+0000","last_unstale":"2023-10-25T23:36:09.290456+0000","last_undegraded":"2023-10-25T23:36:09.290456+0000","last_fullsized":"2023-10-25T23:36:09.290456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:41:31.211304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.295253+0000","last_change":"2023-10-25T23:36:09.286460+0000","last_active":"2023-10-25T23:36:09.295253+0000","last_peered":"2023-10-25T23:36:09.295253+0000","last_clean":"2023-10-25T23:36:09.295253+0000","last_became_active":"2023-10-25T23:36:09.286191+0000","last_became_peered":"2023-10-25T23:36:09.286191+0000","last_unstale":"2023-10-25T23:36:09.295253+0000","last_undegraded":"2023-10-25T23:36:09.295253+0000","last_fullsized":"2023-10-25T23:36:09.295253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:32.136680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887574+0000","last_change":"2023-10-25T23:36:09.301475+0000","last_active":"2023-10-25T23:36:10.887574+0000","last_peered":"2023-10-25T23:36:10.887574+0000","last_clean":"2023-10-25T23:36:10.887574+0000","last_became_active":"2023-10-25T23:36:09.301040+0000","last_became_peered":"2023-10-25T23:36:09.301040+0000","last_unstale":"2023-10-25T23:36:10.887574+0000","last_undegraded":"2023-10-25T23:36:10.887574+0000","last_fullsized":"2023-10-25T23:36:10.887574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:06.986689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888186+0000","last_change":"2023-10-25T23:36:09.298189+0000","last_active":"2023-10-25T23:36:10.888186+0000","last_peered":"2023-10-25T23:36:10.888186+0000","last_clean":"2023-10-25T23:36:10.888186+0000","last_became_active":"2023-10-25T23:36:09.297892+0000","last_became_peered":"2023-10-25T23:36:09.297892+0000","last_unstale":"2023-10-25T23:36:10.888186+0000","last_undegraded":"2023-10-25T23:36:10.888186+0000","last_fullsized":"2023-10-25T23:36:10.888186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:54:42.179401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285710+0000","last_change":"2023-10-25T23:36:09.282631+0000","last_active":"2023-10-25T23:36:10.285710+0000","last_peered":"2023-10-25T23:36:10.285710+0000","last_clean":"2023-10-25T23:36:10.285710+0000","last_became_active":"2023-10-25T23:36:09.282282+0000","last_became_peered":"2023-10-25T23:36:09.282282+0000","last_unstale":"2023-10-25T23:36:10.285710+0000","last_undegraded":"2023-10-25T23:36:10.285710+0000","last_fullsized":"2023-10-25T23:36:10.285710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:27.001592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477144+0000","last_change":"2023-10-25T23:36:09.289744+0000","last_active":"2023-10-25T23:36:10.477144+0000","last_peered":"2023-10-25T23:36:10.477144+0000","last_clean":"2023-10-25T23:36:10.477144+0000","last_became_active":"2023-10-25T23:36:09.289457+0000","last_became_peered":"2023-10-25T23:36:09.289457+0000","last_unstale":"2023-10-25T23:36:10.477144+0000","last_undegraded":"2023-10-25T23:36:10.477144+0000","last_fullsized":"2023-10-25T23:36:10.477144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:25:22.432043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.302900+0000","last_change":"2023-10-25T23:36:08.271164+0000","last_active":"2023-10-25T23:36:09.302900+0000","last_peered":"2023-10-25T23:36:09.302900+0000","last_clean":"2023-10-25T23:36:09.302900+0000","last_became_active":"2023-10-25T23:36:08.270911+0000","last_became_peered":"2023-10-25T23:36:08.270911+0000","last_unstale":"2023-10-25T23:36:09.302900+0000","last_undegraded":"2023-10-25T23:36:09.302900+0000","last_fullsized":"2023-10-25T23:36:09.302900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.297866+0000","last_change":"2023-10-25T23:36:09.290526+0000","last_active":"2023-10-25T23:36:09.297866+0000","last_peered":"2023-10-25T23:36:09.297866+0000","last_clean":"2023-10-25T23:36:09.297866+0000","last_became_active":"2023-10-25T23:36:09.290260+0000","last_became_peered":"2023-10-25T23:36:09.290260+0000","last_unstale":"2023-10-25T23:36:09.297866+0000","last_undegraded":"2023-10-25T23:36:09.297866+0000","last_fullsized":"2023-10-25T23:36:09.297866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:32.136680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.299956+0000","last_change":"2023-10-25T23:36:08.269993+0000","last_active":"2023-10-25T23:36:09.299956+0000","last_peered":"2023-10-25T23:36:09.299956+0000","last_clean":"2023-10-25T23:36:09.299956+0000","last_became_active":"2023-10-25T23:36:08.269443+0000","last_became_peered":"2023-10-25T23:36:08.269443+0000","last_unstale":"2023-10-25T23:36:09.299956+0000","last_undegraded":"2023-10-25T23:36:09.299956+0000","last_fullsized":"2023-10-25T23:36:09.299956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.302118+0000","last_change":"2023-10-25T23:36:09.300013+0000","last_active":"2023-10-25T23:36:09.302118+0000","last_peered":"2023-10-25T23:36:09.302118+0000","last_clean":"2023-10-25T23:36:09.302118+0000","last_became_active":"2023-10-25T23:36:09.299738+0000","last_became_peered":"2023-10-25T23:36:09.299738+0000","last_unstale":"2023-10-25T23:36:09.302118+0000","last_undegraded":"2023-10-25T23:36:09.302118+0000","last_fullsized":"2023-10-25T23:36:09.302118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:41.029497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477442+0000","last_change":"2023-10-25T23:36:08.273879+0000","last_active":"2023-10-25T23:36:10.477442+0000","last_peered":"2023-10-25T23:36:10.477442+0000","last_clean":"2023-10-25T23:36:10.477442+0000","last_became_active":"2023-10-25T23:36:08.273574+0000","last_became_peered":"2023-10-25T23:36:08.273574+0000","last_unstale":"2023-10-25T23:36:10.477442+0000","last_undegraded":"2023-10-25T23:36:10.477442+0000","last_fullsized":"2023-10-25T23:36:10.477442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:27.340205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887909+0000","last_change":"2023-10-25T23:36:09.300549+0000","last_active":"2023-10-25T23:36:10.887909+0000","last_peered":"2023-10-25T23:36:10.887909+0000","last_clean":"2023-10-25T23:36:10.887909+0000","last_became_active":"2023-10-25T23:36:09.299916+0000","last_became_peered":"2023-10-25T23:36:09.299916+0000","last_unstale":"2023-10-25T23:36:10.887909+0000","last_undegraded":"2023-10-25T23:36:10.887909+0000","last_fullsized":"2023-10-25T23:36:10.887909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:25:22.432043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477055+0000","last_change":"2023-10-25T23:36:08.271714+0000","last_active":"2023-10-25T23:36:10.477055+0000","last_peered":"2023-10-25T23:36:10.477055+0000","last_clean":"2023-10-25T23:36:10.477055+0000","last_became_active":"2023-10-25T23:36:08.271442+0000","last_became_peered":"2023-10-25T23:36:08.271442+0000","last_unstale":"2023-10-25T23:36:10.477055+0000","last_undegraded":"2023-10-25T23:36:10.477055+0000","last_fullsized":"2023-10-25T23:36:10.477055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888055+0000","last_change":"2023-10-25T23:36:09.299476+0000","last_active":"2023-10-25T23:36:10.888055+0000","last_peered":"2023-10-25T23:36:10.888055+0000","last_clean":"2023-10-25T23:36:10.888055+0000","last_became_active":"2023-10-25T23:36:09.299130+0000","last_became_peered":"2023-10-25T23:36:09.299130+0000","last_unstale":"2023-10-25T23:36:10.888055+0000","last_undegraded":"2023-10-25T23:36:10.888055+0000","last_fullsized":"2023-10-25T23:36:10.888055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:53:09.911467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298119+0000","last_change":"2023-10-25T23:36:08.271119+0000","last_active":"2023-10-25T23:36:09.298119+0000","last_peered":"2023-10-25T23:36:09.298119+0000","last_clean":"2023-10-25T23:36:09.298119+0000","last_became_active":"2023-10-25T23:36:08.270138+0000","last_became_peered":"2023-10-25T23:36:08.270138+0000","last_unstale":"2023-10-25T23:36:09.298119+0000","last_undegraded":"2023-10-25T23:36:09.298119+0000","last_fullsized":"2023-10-25T23:36:09.298119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286865+0000","last_change":"2023-10-25T23:36:09.287742+0000","last_active":"2023-10-25T23:36:10.286865+0000","last_peered":"2023-10-25T23:36:10.286865+0000","last_clean":"2023-10-25T23:36:10.286865+0000","last_became_active":"2023-10-25T23:36:09.287455+0000","last_became_peered":"2023-10-25T23:36:09.287455+0000","last_unstale":"2023-10-25T23:36:10.286865+0000","last_undegraded":"2023-10-25T23:36:10.286865+0000","last_fullsized":"2023-10-25T23:36:10.286865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:41.029497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285393+0000","last_change":"2023-10-25T23:36:08.272686+0000","last_active":"2023-10-25T23:36:10.285393+0000","last_peered":"2023-10-25T23:36:10.285393+0000","last_clean":"2023-10-25T23:36:10.285393+0000","last_became_active":"2023-10-25T23:36:08.271974+0000","last_became_peered":"2023-10-25T23:36:08.271974+0000","last_unstale":"2023-10-25T23:36:10.285393+0000","last_undegraded":"2023-10-25T23:36:10.285393+0000","last_fullsized":"2023-10-25T23:36:10.285393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.300410+0000","last_change":"2023-10-25T23:36:09.294574+0000","last_active":"2023-10-25T23:36:09.300410+0000","last_peered":"2023-10-25T23:36:09.300410+0000","last_clean":"2023-10-25T23:36:09.300410+0000","last_became_active":"2023-10-25T23:36:09.294176+0000","last_became_peered":"2023-10-25T23:36:09.294176+0000","last_unstale":"2023-10-25T23:36:09.300410+0000","last_undegraded":"2023-10-25T23:36:09.300410+0000","last_fullsized":"2023-10-25T23:36:09.300410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:36.336468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.283027+0000","last_change":"2023-10-25T23:36:08.273513+0000","last_active":"2023-10-25T23:36:09.283027+0000","last_peered":"2023-10-25T23:36:09.283027+0000","last_clean":"2023-10-25T23:36:09.283027+0000","last_became_active":"2023-10-25T23:36:08.273035+0000","last_became_peered":"2023-10-25T23:36:08.273035+0000","last_unstale":"2023-10-25T23:36:09.283027+0000","last_undegraded":"2023-10-25T23:36:09.283027+0000","last_fullsized":"2023-10-25T23:36:09.283027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:21:29.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298126+0000","last_change":"2023-10-25T23:36:09.292852+0000","last_active":"2023-10-25T23:36:09.298126+0000","last_peered":"2023-10-25T23:36:09.298126+0000","last_clean":"2023-10-25T23:36:09.298126+0000","last_became_active":"2023-10-25T23:36:09.292546+0000","last_became_peered":"2023-10-25T23:36:09.292546+0000","last_unstale":"2023-10-25T23:36:09.298126+0000","last_undegraded":"2023-10-25T23:36:09.298126+0000","last_fullsized":"2023-10-25T23:36:09.298126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:41.029497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887617+0000","last_change":"2023-10-25T23:36:08.277462+0000","last_active":"2023-10-25T23:36:10.887617+0000","last_peered":"2023-10-25T23:36:10.887617+0000","last_clean":"2023-10-25T23:36:10.887617+0000","last_became_active":"2023-10-25T23:36:08.277138+0000","last_became_peered":"2023-10-25T23:36:08.277138+0000","last_unstale":"2023-10-25T23:36:10.887617+0000","last_undegraded":"2023-10-25T23:36:10.887617+0000","last_fullsized":"2023-10-25T23:36:10.887617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:48:32.291671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.295276+0000","last_change":"2023-10-25T23:36:09.290725+0000","last_active":"2023-10-25T23:36:09.295276+0000","last_peered":"2023-10-25T23:36:09.295276+0000","last_clean":"2023-10-25T23:36:09.295276+0000","last_became_active":"2023-10-25T23:36:09.290456+0000","last_became_peered":"2023-10-25T23:36:09.290456+0000","last_unstale":"2023-10-25T23:36:09.295276+0000","last_undegraded":"2023-10-25T23:36:09.295276+0000","last_fullsized":"2023-10-25T23:36:09.295276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:27.001592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285660+0000","last_change":"2023-10-25T23:36:08.272869+0000","last_active":"2023-10-25T23:36:10.285660+0000","last_peered":"2023-10-25T23:36:10.285660+0000","last_clean":"2023-10-25T23:36:10.285660+0000","last_became_active":"2023-10-25T23:36:08.272120+0000","last_became_peered":"2023-10-25T23:36:08.272120+0000","last_unstale":"2023-10-25T23:36:10.285660+0000","last_undegraded":"2023-10-25T23:36:10.285660+0000","last_fullsized":"2023-10-25T23:36:10.285660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888137+0000","last_change":"2023-10-25T23:36:09.293442+0000","last_active":"2023-10-25T23:36:10.888137+0000","last_peered":"2023-10-25T23:36:10.888137+0000","last_clean":"2023-10-25T23:36:10.888137+0000","last_became_active":"2023-10-25T23:36:09.293132+0000","last_became_peered":"2023-10-25T23:36:09.293132+0000","last_unstale":"2023-10-25T23:36:10.888137+0000","last_undegraded":"2023-10-25T23:36:10.888137+0000","last_fullsized":"2023-10-25T23:36:10.888137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:11:17.452696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888026+0000","last_change":"2023-10-25T23:36:08.272920+0000","last_active":"2023-10-25T23:36:10.888026+0000","last_peered":"2023-10-25T23:36:10.888026+0000","last_clean":"2023-10-25T23:36:10.888026+0000","last_became_active":"2023-10-25T23:36:08.272596+0000","last_became_peered":"2023-10-25T23:36:08.272596+0000","last_unstale":"2023-10-25T23:36:10.888026+0000","last_undegraded":"2023-10-25T23:36:10.888026+0000","last_fullsized":"2023-10-25T23:36:10.888026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.302141+0000","last_change":"2023-10-25T23:36:09.300238+0000","last_active":"2023-10-25T23:36:09.302141+0000","last_peered":"2023-10-25T23:36:09.302141+0000","last_clean":"2023-10-25T23:36:09.302141+0000","last_became_active":"2023-10-25T23:36:09.299938+0000","last_became_peered":"2023-10-25T23:36:09.299938+0000","last_unstale":"2023-10-25T23:36:09.302141+0000","last_undegraded":"2023-10-25T23:36:09.302141+0000","last_fullsized":"2023-10-25T23:36:09.302141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:28:35.026841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.297064+0000","last_change":"2023-10-25T23:36:08.279751+0000","last_active":"2023-10-25T23:36:09.297064+0000","last_peered":"2023-10-25T23:36:09.297064+0000","last_clean":"2023-10-25T23:36:09.297064+0000","last_became_active":"2023-10-25T23:36:08.279509+0000","last_became_peered":"2023-10-25T23:36:08.279509+0000","last_unstale":"2023-10-25T23:36:09.297064+0000","last_undegraded":"2023-10-25T23:36:09.297064+0000","last_fullsized":"2023-10-25T23:36:09.297064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286903+0000","last_change":"2023-10-25T23:36:09.285566+0000","last_active":"2023-10-25T23:36:10.286903+0000","last_peered":"2023-10-25T23:36:10.286903+0000","last_clean":"2023-10-25T23:36:10.286903+0000","last_became_active":"2023-10-25T23:36:09.285196+0000","last_became_peered":"2023-10-25T23:36:09.285196+0000","last_unstale":"2023-10-25T23:36:10.286903+0000","last_undegraded":"2023-10-25T23:36:10.286903+0000","last_fullsized":"2023-10-25T23:36:10.286903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:27.001592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285737+0000","last_change":"2023-10-25T23:36:08.272911+0000","last_active":"2023-10-25T23:36:10.285737+0000","last_peered":"2023-10-25T23:36:10.285737+0000","last_clean":"2023-10-25T23:36:10.285737+0000","last_became_active":"2023-10-25T23:36:08.272248+0000","last_became_peered":"2023-10-25T23:36:08.272248+0000","last_unstale":"2023-10-25T23:36:10.285737+0000","last_undegraded":"2023-10-25T23:36:10.285737+0000","last_fullsized":"2023-10-25T23:36:10.285737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477155+0000","last_change":"2023-10-25T23:36:09.292562+0000","last_active":"2023-10-25T23:36:10.477155+0000","last_peered":"2023-10-25T23:36:10.477155+0000","last_clean":"2023-10-25T23:36:10.477155+0000","last_became_active":"2023-10-25T23:36:09.292300+0000","last_became_peered":"2023-10-25T23:36:09.292300+0000","last_unstale":"2023-10-25T23:36:10.477155+0000","last_undegraded":"2023-10-25T23:36:10.477155+0000","last_fullsized":"2023-10-25T23:36:10.477155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:46:03.954978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.300664+0000","last_change":"2023-10-25T23:36:08.274407+0000","last_active":"2023-10-25T23:36:09.300664+0000","last_peered":"2023-10-25T23:36:09.300664+0000","last_clean":"2023-10-25T23:36:09.300664+0000","last_became_active":"2023-10-25T23:36:08.274162+0000","last_became_peered":"2023-10-25T23:36:08.274162+0000","last_unstale":"2023-10-25T23:36:09.300664+0000","last_undegraded":"2023-10-25T23:36:09.300664+0000","last_fullsized":"2023-10-25T23:36:09.300664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.299703+0000","last_change":"2023-10-25T23:36:09.284635+0000","last_active":"2023-10-25T23:36:09.299703+0000","last_peered":"2023-10-25T23:36:09.299703+0000","last_clean":"2023-10-25T23:36:09.299703+0000","last_became_active":"2023-10-25T23:36:09.284386+0000","last_became_peered":"2023-10-25T23:36:09.284386+0000","last_unstale":"2023-10-25T23:36:09.299703+0000","last_undegraded":"2023-10-25T23:36:09.299703+0000","last_fullsized":"2023-10-25T23:36:09.299703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:40.519153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887950+0000","last_change":"2023-10-25T23:36:08.271565+0000","last_active":"2023-10-25T23:36:10.887950+0000","last_peered":"2023-10-25T23:36:10.887950+0000","last_clean":"2023-10-25T23:36:10.887950+0000","last_became_active":"2023-10-25T23:36:08.271188+0000","last_became_peered":"2023-10-25T23:36:08.271188+0000","last_unstale":"2023-10-25T23:36:10.887950+0000","last_undegraded":"2023-10-25T23:36:10.887950+0000","last_fullsized":"2023-10-25T23:36:10.887950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:51:48.005011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477103+0000","last_change":"2023-10-25T23:36:09.294928+0000","last_active":"2023-10-25T23:36:10.477103+0000","last_peered":"2023-10-25T23:36:10.477103+0000","last_clean":"2023-10-25T23:36:10.477103+0000","last_became_active":"2023-10-25T23:36:09.294200+0000","last_became_peered":"2023-10-25T23:36:09.294200+0000","last_unstale":"2023-10-25T23:36:10.477103+0000","last_undegraded":"2023-10-25T23:36:10.477103+0000","last_fullsized":"2023-10-25T23:36:10.477103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:29:19.996286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285380+0000","last_change":"2023-10-25T23:36:08.273427+0000","last_active":"2023-10-25T23:36:10.285380+0000","last_peered":"2023-10-25T23:36:10.285380+0000","last_clean":"2023-10-25T23:36:10.285380+0000","last_became_active":"2023-10-25T23:36:08.272301+0000","last_became_peered":"2023-10-25T23:36:08.272301+0000","last_unstale":"2023-10-25T23:36:10.285380+0000","last_undegraded":"2023-10-25T23:36:10.285380+0000","last_fullsized":"2023-10-25T23:36:10.285380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285377+0000","last_change":"2023-10-25T23:36:09.291952+0000","last_active":"2023-10-25T23:36:10.285377+0000","last_peered":"2023-10-25T23:36:10.285377+0000","last_clean":"2023-10-25T23:36:10.285377+0000","last_became_active":"2023-10-25T23:36:09.291305+0000","last_became_peered":"2023-10-25T23:36:09.291305+0000","last_unstale":"2023-10-25T23:36:10.285377+0000","last_undegraded":"2023-10-25T23:36:10.285377+0000","last_fullsized":"2023-10-25T23:36:10.285377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:38:19.348985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285555+0000","last_change":"2023-10-25T23:36:08.277621+0000","last_active":"2023-10-25T23:36:10.285555+0000","last_peered":"2023-10-25T23:36:10.285555+0000","last_clean":"2023-10-25T23:36:10.285555+0000","last_became_active":"2023-10-25T23:36:08.277327+0000","last_became_peered":"2023-10-25T23:36:08.277327+0000","last_unstale":"2023-10-25T23:36:10.285555+0000","last_undegraded":"2023-10-25T23:36:10.285555+0000","last_fullsized":"2023-10-25T23:36:10.285555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:04.918703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.476928+0000","last_change":"2023-10-25T23:36:09.295493+0000","last_active":"2023-10-25T23:36:10.476928+0000","last_peered":"2023-10-25T23:36:10.476928+0000","last_clean":"2023-10-25T23:36:10.476928+0000","last_became_active":"2023-10-25T23:36:09.295231+0000","last_became_peered":"2023-10-25T23:36:09.295231+0000","last_unstale":"2023-10-25T23:36:10.476928+0000","last_undegraded":"2023-10-25T23:36:10.476928+0000","last_fullsized":"2023-10-25T23:36:10.476928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:28:06.035601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286981+0000","last_change":"2023-10-25T23:36:08.263573+0000","last_active":"2023-10-25T23:36:10.286981+0000","last_peered":"2023-10-25T23:36:10.286981+0000","last_clean":"2023-10-25T23:36:10.286981+0000","last_became_active":"2023-10-25T23:36:08.263264+0000","last_became_peered":"2023-10-25T23:36:08.263264+0000","last_unstale":"2023-10-25T23:36:10.286981+0000","last_undegraded":"2023-10-25T23:36:10.286981+0000","last_fullsized":"2023-10-25T23:36:10.286981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477258+0000","last_change":"2023-10-25T23:36:09.294572+0000","last_active":"2023-10-25T23:36:10.477258+0000","last_peered":"2023-10-25T23:36:10.477258+0000","last_clean":"2023-10-25T23:36:10.477258+0000","last_became_active":"2023-10-25T23:36:09.294298+0000","last_became_peered":"2023-10-25T23:36:09.294298+0000","last_unstale":"2023-10-25T23:36:10.477258+0000","last_undegraded":"2023-10-25T23:36:10.477258+0000","last_fullsized":"2023-10-25T23:36:10.477258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:53:09.911467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.273530+0000","last_change":"2023-10-25T23:36:08.277383+0000","last_active":"2023-10-25T23:36:09.273530+0000","last_peered":"2023-10-25T23:36:09.273530+0000","last_clean":"2023-10-25T23:36:09.273530+0000","last_became_active":"2023-10-25T23:36:08.277087+0000","last_became_peered":"2023-10-25T23:36:08.277087+0000","last_unstale":"2023-10-25T23:36:09.273530+0000","last_undegraded":"2023-10-25T23:36:09.273530+0000","last_fullsized":"2023-10-25T23:36:09.273530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888072+0000","last_change":"2023-10-25T23:36:09.299356+0000","last_active":"2023-10-25T23:36:10.888072+0000","last_peered":"2023-10-25T23:36:10.888072+0000","last_clean":"2023-10-25T23:36:10.888072+0000","last_became_active":"2023-10-25T23:36:09.298782+0000","last_became_peered":"2023-10-25T23:36:09.298782+0000","last_unstale":"2023-10-25T23:36:10.888072+0000","last_undegraded":"2023-10-25T23:36:10.888072+0000","last_fullsized":"2023-10-25T23:36:10.888072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:26:02.311707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887844+0000","last_change":"2023-10-25T23:36:08.279568+0000","last_active":"2023-10-25T23:36:10.887844+0000","last_peered":"2023-10-25T23:36:10.887844+0000","last_clean":"2023-10-25T23:36:10.887844+0000","last_became_active":"2023-10-25T23:36:08.279302+0000","last_became_peered":"2023-10-25T23:36:08.279302+0000","last_unstale":"2023-10-25T23:36:10.887844+0000","last_undegraded":"2023-10-25T23:36:10.887844+0000","last_fullsized":"2023-10-25T23:36:10.887844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:27.340205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286808+0000","last_change":"2023-10-25T23:36:09.293019+0000","last_active":"2023-10-25T23:36:10.286808+0000","last_peered":"2023-10-25T23:36:10.286808+0000","last_clean":"2023-10-25T23:36:10.286808+0000","last_became_active":"2023-10-25T23:36:09.292670+0000","last_became_peered":"2023-10-25T23:36:09.292670+0000","last_unstale":"2023-10-25T23:36:10.286808+0000","last_undegraded":"2023-10-25T23:36:10.286808+0000","last_fullsized":"2023-10-25T23:36:10.286808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:05.924938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.295684+0000","last_change":"2023-10-25T23:36:09.284019+0000","last_active":"2023-10-25T23:36:09.295684+0000","last_peered":"2023-10-25T23:36:09.295684+0000","last_clean":"2023-10-25T23:36:09.295684+0000","last_became_active":"2023-10-25T23:36:09.283766+0000","last_became_peered":"2023-10-25T23:36:09.283766+0000","last_unstale":"2023-10-25T23:36:09.295684+0000","last_undegraded":"2023-10-25T23:36:09.295684+0000","last_fullsized":"2023-10-25T23:36:09.295684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:01:23.728788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285551+0000","last_change":"2023-10-25T23:36:08.264050+0000","last_active":"2023-10-25T23:36:10.285551+0000","last_peered":"2023-10-25T23:36:10.285551+0000","last_clean":"2023-10-25T23:36:10.285551+0000","last_became_active":"2023-10-25T23:36:08.263842+0000","last_became_peered":"2023-10-25T23:36:08.263842+0000","last_unstale":"2023-10-25T23:36:10.285551+0000","last_undegraded":"2023-10-25T23:36:10.285551+0000","last_fullsized":"2023-10-25T23:36:10.285551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:31.130445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298109+0000","last_change":"2023-10-25T23:36:09.295865+0000","last_active":"2023-10-25T23:36:09.298109+0000","last_peered":"2023-10-25T23:36:09.298109+0000","last_clean":"2023-10-25T23:36:09.298109+0000","last_became_active":"2023-10-25T23:36:09.295595+0000","last_became_peered":"2023-10-25T23:36:09.295595+0000","last_unstale":"2023-10-25T23:36:09.298109+0000","last_undegraded":"2023-10-25T23:36:09.298109+0000","last_fullsized":"2023-10-25T23:36:09.298109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:40.519153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887944+0000","last_change":"2023-10-25T23:36:08.272009+0000","last_active":"2023-10-25T23:36:10.887944+0000","last_peered":"2023-10-25T23:36:10.887944+0000","last_clean":"2023-10-25T23:36:10.887944+0000","last_became_active":"2023-10-25T23:36:08.271640+0000","last_became_peered":"2023-10-25T23:36:08.271640+0000","last_unstale":"2023-10-25T23:36:10.887944+0000","last_undegraded":"2023-10-25T23:36:10.887944+0000","last_fullsized":"2023-10-25T23:36:10.887944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:40.023263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.281002+0000","last_change":"2023-10-25T23:35:58.277542+0000","last_active":"2023-10-25T23:36:09.281002+0000","last_peered":"2023-10-25T23:36:09.281002+0000","last_clean":"2023-10-25T23:36:09.281002+0000","last_became_active":"2023-10-25T23:35:58.276606+0000","last_became_peered":"2023-10-25T23:35:58.276606+0000","last_unstale":"2023-10-25T23:36:09.281002+0000","last_undegraded":"2023-10-25T23:36:09.281002+0000","last_fullsized":"2023-10-25T23:36:09.281002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:35:57.197265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:35:57.197265+0000","last_clean_scrub_stamp":"2023-10-25T23:35:57.197265+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:53:55.116662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.300287+0000","last_change":"2023-10-25T23:36:09.291404+0000","last_active":"2023-10-25T23:36:09.300287+0000","last_peered":"2023-10-25T23:36:09.300287+0000","last_clean":"2023-10-25T23:36:09.300287+0000","last_became_active":"2023-10-25T23:36:09.291072+0000","last_became_peered":"2023-10-25T23:36:09.291072+0000","last_unstale":"2023-10-25T23:36:09.300287+0000","last_undegraded":"2023-10-25T23:36:09.300287+0000","last_fullsized":"2023-10-25T23:36:09.300287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:36:48.130904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.476857+0000","last_change":"2023-10-25T23:36:08.277937+0000","last_active":"2023-10-25T23:36:10.476857+0000","last_peered":"2023-10-25T23:36:10.476857+0000","last_clean":"2023-10-25T23:36:10.476857+0000","last_became_active":"2023-10-25T23:36:08.277663+0000","last_became_peered":"2023-10-25T23:36:08.277663+0000","last_unstale":"2023-10-25T23:36:10.476857+0000","last_undegraded":"2023-10-25T23:36:10.476857+0000","last_fullsized":"2023-10-25T23:36:10.476857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:04.918703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477388+0000","last_change":"2023-10-25T23:36:08.270783+0000","last_active":"2023-10-25T23:36:10.477388+0000","last_peered":"2023-10-25T23:36:10.477388+0000","last_clean":"2023-10-25T23:36:10.477388+0000","last_became_active":"2023-10-25T23:36:08.269896+0000","last_became_peered":"2023-10-25T23:36:08.269896+0000","last_unstale":"2023-10-25T23:36:10.477388+0000","last_undegraded":"2023-10-25T23:36:10.477388+0000","last_fullsized":"2023-10-25T23:36:10.477388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.283893+0000","last_change":"2023-10-25T23:36:09.279236+0000","last_active":"2023-10-25T23:36:09.283893+0000","last_peered":"2023-10-25T23:36:09.283893+0000","last_clean":"2023-10-25T23:36:09.283893+0000","last_became_active":"2023-10-25T23:36:09.278967+0000","last_became_peered":"2023-10-25T23:36:09.278967+0000","last_unstale":"2023-10-25T23:36:09.283893+0000","last_undegraded":"2023-10-25T23:36:09.283893+0000","last_fullsized":"2023-10-25T23:36:09.283893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:05.924938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.274054+0000","last_change":"2023-10-25T23:36:08.279363+0000","last_active":"2023-10-25T23:36:09.274054+0000","last_peered":"2023-10-25T23:36:09.274054+0000","last_clean":"2023-10-25T23:36:09.274054+0000","last_became_active":"2023-10-25T23:36:08.279082+0000","last_became_peered":"2023-10-25T23:36:08.279082+0000","last_unstale":"2023-10-25T23:36:09.274054+0000","last_undegraded":"2023-10-25T23:36:09.274054+0000","last_fullsized":"2023-10-25T23:36:09.274054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298000+0000","last_change":"2023-10-25T23:36:09.290430+0000","last_active":"2023-10-25T23:36:09.298000+0000","last_peered":"2023-10-25T23:36:09.298000+0000","last_clean":"2023-10-25T23:36:09.298000+0000","last_became_active":"2023-10-25T23:36:09.289751+0000","last_became_peered":"2023-10-25T23:36:09.289751+0000","last_unstale":"2023-10-25T23:36:09.298000+0000","last_undegraded":"2023-10-25T23:36:09.298000+0000","last_fullsized":"2023-10-25T23:36:09.298000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:46.184346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285500+0000","last_change":"2023-10-25T23:36:08.274349+0000","last_active":"2023-10-25T23:36:10.285500+0000","last_peered":"2023-10-25T23:36:10.285500+0000","last_clean":"2023-10-25T23:36:10.285500+0000","last_became_active":"2023-10-25T23:36:08.273029+0000","last_became_peered":"2023-10-25T23:36:08.273029+0000","last_unstale":"2023-10-25T23:36:10.285500+0000","last_undegraded":"2023-10-25T23:36:10.285500+0000","last_fullsized":"2023-10-25T23:36:10.285500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.299735+0000","last_change":"2023-10-25T23:36:09.287779+0000","last_active":"2023-10-25T23:36:09.299735+0000","last_peered":"2023-10-25T23:36:09.299735+0000","last_clean":"2023-10-25T23:36:09.299735+0000","last_became_active":"2023-10-25T23:36:09.287532+0000","last_became_peered":"2023-10-25T23:36:09.287532+0000","last_unstale":"2023-10-25T23:36:09.299735+0000","last_undegraded":"2023-10-25T23:36:09.299735+0000","last_fullsized":"2023-10-25T23:36:09.299735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:32.136680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.476756+0000","last_change":"2023-10-25T23:36:08.266963+0000","last_active":"2023-10-25T23:36:10.476756+0000","last_peered":"2023-10-25T23:36:10.476756+0000","last_clean":"2023-10-25T23:36:10.476756+0000","last_became_active":"2023-10-25T23:36:08.266648+0000","last_became_peered":"2023-10-25T23:36:08.266648+0000","last_unstale":"2023-10-25T23:36:10.476756+0000","last_undegraded":"2023-10-25T23:36:10.476756+0000","last_fullsized":"2023-10-25T23:36:10.476756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:31.130445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286767+0000","last_change":"2023-10-25T23:36:09.285305+0000","last_active":"2023-10-25T23:36:10.286767+0000","last_peered":"2023-10-25T23:36:10.286767+0000","last_clean":"2023-10-25T23:36:10.286767+0000","last_became_active":"2023-10-25T23:36:09.284666+0000","last_became_peered":"2023-10-25T23:36:09.284666+0000","last_unstale":"2023-10-25T23:36:10.286767+0000","last_undegraded":"2023-10-25T23:36:10.286767+0000","last_fullsized":"2023-10-25T23:36:10.286767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:32.136680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.273237+0000","last_change":"2023-10-25T23:36:08.278162+0000","last_active":"2023-10-25T23:36:09.273237+0000","last_peered":"2023-10-25T23:36:09.273237+0000","last_clean":"2023-10-25T23:36:09.273237+0000","last_became_active":"2023-10-25T23:36:08.277873+0000","last_became_peered":"2023-10-25T23:36:08.277873+0000","last_unstale":"2023-10-25T23:36:09.273237+0000","last_undegraded":"2023-10-25T23:36:09.273237+0000","last_fullsized":"2023-10-25T23:36:09.273237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.297898+0000","last_change":"2023-10-25T23:36:09.289615+0000","last_active":"2023-10-25T23:36:09.297898+0000","last_peered":"2023-10-25T23:36:09.297898+0000","last_clean":"2023-10-25T23:36:09.297898+0000","last_became_active":"2023-10-25T23:36:09.289320+0000","last_became_peered":"2023-10-25T23:36:09.289320+0000","last_unstale":"2023-10-25T23:36:09.297898+0000","last_undegraded":"2023-10-25T23:36:09.297898+0000","last_fullsized":"2023-10-25T23:36:09.297898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:01:23.728788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.273563+0000","last_change":"2023-10-25T23:36:08.278921+0000","last_active":"2023-10-25T23:36:09.273563+0000","last_peered":"2023-10-25T23:36:09.273563+0000","last_clean":"2023-10-25T23:36:09.273563+0000","last_became_active":"2023-10-25T23:36:08.278656+0000","last_became_peered":"2023-10-25T23:36:08.278656+0000","last_unstale":"2023-10-25T23:36:09.273563+0000","last_undegraded":"2023-10-25T23:36:09.273563+0000","last_fullsized":"2023-10-25T23:36:09.273563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298219+0000","last_change":"2023-10-25T23:36:09.293076+0000","last_active":"2023-10-25T23:36:09.298219+0000","last_peered":"2023-10-25T23:36:09.298219+0000","last_clean":"2023-10-25T23:36:09.298219+0000","last_became_active":"2023-10-25T23:36:09.292345+0000","last_became_peered":"2023-10-25T23:36:09.292345+0000","last_unstale":"2023-10-25T23:36:09.298219+0000","last_undegraded":"2023-10-25T23:36:09.298219+0000","last_fullsized":"2023-10-25T23:36:09.298219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:41:31.211304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477225+0000","last_change":"2023-10-25T23:36:08.270589+0000","last_active":"2023-10-25T23:36:10.477225+0000","last_peered":"2023-10-25T23:36:10.477225+0000","last_clean":"2023-10-25T23:36:10.477225+0000","last_became_active":"2023-10-25T23:36:08.268753+0000","last_became_peered":"2023-10-25T23:36:08.268753+0000","last_unstale":"2023-10-25T23:36:10.477225+0000","last_undegraded":"2023-10-25T23:36:10.477225+0000","last_fullsized":"2023-10-25T23:36:10.477225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285622+0000","last_change":"2023-10-25T23:36:09.290423+0000","last_active":"2023-10-25T23:36:10.285622+0000","last_peered":"2023-10-25T23:36:10.285622+0000","last_clean":"2023-10-25T23:36:10.285622+0000","last_became_active":"2023-10-25T23:36:09.290151+0000","last_became_peered":"2023-10-25T23:36:09.290151+0000","last_unstale":"2023-10-25T23:36:10.285622+0000","last_undegraded":"2023-10-25T23:36:10.285622+0000","last_fullsized":"2023-10-25T23:36:10.285622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:51:49.011246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285753+0000","last_change":"2023-10-25T23:36:08.272161+0000","last_active":"2023-10-25T23:36:10.285753+0000","last_peered":"2023-10-25T23:36:10.285753+0000","last_clean":"2023-10-25T23:36:10.285753+0000","last_became_active":"2023-10-25T23:36:08.271846+0000","last_became_peered":"2023-10-25T23:36:08.271846+0000","last_unstale":"2023-10-25T23:36:10.285753+0000","last_undegraded":"2023-10-25T23:36:10.285753+0000","last_fullsized":"2023-10-25T23:36:10.285753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:39.512919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477335+0000","last_change":"2023-10-25T23:36:09.295948+0000","last_active":"2023-10-25T23:36:10.477335+0000","last_peered":"2023-10-25T23:36:10.477335+0000","last_clean":"2023-10-25T23:36:10.477335+0000","last_became_active":"2023-10-25T23:36:09.295635+0000","last_became_peered":"2023-10-25T23:36:09.295635+0000","last_unstale":"2023-10-25T23:36:10.477335+0000","last_undegraded":"2023-10-25T23:36:10.477335+0000","last_fullsized":"2023-10-25T23:36:10.477335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:26:02.311707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298927+0000","last_change":"2023-10-25T23:36:08.277618+0000","last_active":"2023-10-25T23:36:09.298927+0000","last_peered":"2023-10-25T23:36:09.298927+0000","last_clean":"2023-10-25T23:36:09.298927+0000","last_became_active":"2023-10-25T23:36:08.277344+0000","last_became_peered":"2023-10-25T23:36:08.277344+0000","last_unstale":"2023-10-25T23:36:09.298927+0000","last_undegraded":"2023-10-25T23:36:09.298927+0000","last_fullsized":"2023-10-25T23:36:09.298927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:21:29.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887766+0000","last_change":"2023-10-25T23:36:09.300169+0000","last_active":"2023-10-25T23:36:10.887766+0000","last_peered":"2023-10-25T23:36:10.887766+0000","last_clean":"2023-10-25T23:36:10.887766+0000","last_became_active":"2023-10-25T23:36:09.299234+0000","last_became_peered":"2023-10-25T23:36:09.299234+0000","last_unstale":"2023-10-25T23:36:10.887766+0000","last_undegraded":"2023-10-25T23:36:10.887766+0000","last_fullsized":"2023-10-25T23:36:10.887766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:29:19.996286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285721+0000","last_change":"2023-10-25T23:36:08.269389+0000","last_active":"2023-10-25T23:36:10.285721+0000","last_peered":"2023-10-25T23:36:10.285721+0000","last_clean":"2023-10-25T23:36:10.285721+0000","last_became_active":"2023-10-25T23:36:08.269065+0000","last_became_peered":"2023-10-25T23:36:08.269065+0000","last_unstale":"2023-10-25T23:36:10.285721+0000","last_undegraded":"2023-10-25T23:36:10.285721+0000","last_fullsized":"2023-10-25T23:36:10.285721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477633+0000","last_change":"2023-10-25T23:36:09.294804+0000","last_active":"2023-10-25T23:36:10.477633+0000","last_peered":"2023-10-25T23:36:10.477633+0000","last_clean":"2023-10-25T23:36:10.477633+0000","last_became_active":"2023-10-25T23:36:09.294494+0000","last_became_peered":"2023-10-25T23:36:09.294494+0000","last_unstale":"2023-10-25T23:36:10.477633+0000","last_undegraded":"2023-10-25T23:36:10.477633+0000","last_fullsized":"2023-10-25T23:36:10.477633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:11:17.452696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285801+0000","last_change":"2023-10-25T23:36:09.292116+0000","last_active":"2023-10-25T23:36:10.285801+0000","last_peered":"2023-10-25T23:36:10.285801+0000","last_clean":"2023-10-25T23:36:10.285801+0000","last_became_active":"2023-10-25T23:36:09.291665+0000","last_became_peered":"2023-10-25T23:36:09.291665+0000","last_unstale":"2023-10-25T23:36:10.285801+0000","last_undegraded":"2023-10-25T23:36:10.285801+0000","last_fullsized":"2023-10-25T23:36:10.285801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:48:33.297905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285669+0000","last_change":"2023-10-25T23:36:09.296271+0000","last_active":"2023-10-25T23:36:10.285669+0000","last_peered":"2023-10-25T23:36:10.285669+0000","last_clean":"2023-10-25T23:36:10.285669+0000","last_became_active":"2023-10-25T23:36:09.295817+0000","last_became_peered":"2023-10-25T23:36:09.295817+0000","last_unstale":"2023-10-25T23:36:10.285669+0000","last_undegraded":"2023-10-25T23:36:10.285669+0000","last_fullsized":"2023-10-25T23:36:10.285669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:41.029497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887836+0000","last_change":"2023-10-25T23:36:09.299282+0000","last_active":"2023-10-25T23:36:10.887836+0000","last_peered":"2023-10-25T23:36:10.887836+0000","last_clean":"2023-10-25T23:36:10.887836+0000","last_became_active":"2023-10-25T23:36:09.299024+0000","last_became_peered":"2023-10-25T23:36:09.299024+0000","last_unstale":"2023-10-25T23:36:10.887836+0000","last_undegraded":"2023-10-25T23:36:10.887836+0000","last_fullsized":"2023-10-25T23:36:10.887836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:46:03.954978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.300372+0000","last_change":"2023-10-25T23:36:09.292598+0000","last_active":"2023-10-25T23:36:09.300372+0000","last_peered":"2023-10-25T23:36:09.300372+0000","last_clean":"2023-10-25T23:36:09.300372+0000","last_became_active":"2023-10-25T23:36:09.292344+0000","last_became_peered":"2023-10-25T23:36:09.292344+0000","last_unstale":"2023-10-25T23:36:09.300372+0000","last_undegraded":"2023-10-25T23:36:09.300372+0000","last_fullsized":"2023-10-25T23:36:09.300372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:01:23.728788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298408+0000","last_change":"2023-10-25T23:36:09.297451+0000","last_active":"2023-10-25T23:36:09.298408+0000","last_peered":"2023-10-25T23:36:09.298408+0000","last_clean":"2023-10-25T23:36:09.298408+0000","last_became_active":"2023-10-25T23:36:09.297202+0000","last_became_peered":"2023-10-25T23:36:09.297202+0000","last_unstale":"2023-10-25T23:36:09.298408+0000","last_undegraded":"2023-10-25T23:36:09.298408+0000","last_fullsized":"2023-10-25T23:36:09.298408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:36.336468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.295322+0000","last_change":"2023-10-25T23:36:09.293431+0000","last_active":"2023-10-25T23:36:09.295322+0000","last_peered":"2023-10-25T23:36:09.295322+0000","last_clean":"2023-10-25T23:36:09.295322+0000","last_became_active":"2023-10-25T23:36:09.293157+0000","last_became_peered":"2023-10-25T23:36:09.293157+0000","last_unstale":"2023-10-25T23:36:09.295322+0000","last_undegraded":"2023-10-25T23:36:09.295322+0000","last_fullsized":"2023-10-25T23:36:09.295322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:41.029497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285934+0000","last_change":"2023-10-25T23:36:09.288432+0000","last_active":"2023-10-25T23:36:10.285934+0000","last_peered":"2023-10-25T23:36:10.285934+0000","last_clean":"2023-10-25T23:36:10.285934+0000","last_became_active":"2023-10-25T23:36:09.288127+0000","last_became_peered":"2023-10-25T23:36:09.288127+0000","last_unstale":"2023-10-25T23:36:10.285934+0000","last_undegraded":"2023-10-25T23:36:10.285934+0000","last_fullsized":"2023-10-25T23:36:10.285934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:06.986689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298019+0000","last_change":"2023-10-25T23:36:09.290608+0000","last_active":"2023-10-25T23:36:09.298019+0000","last_peered":"2023-10-25T23:36:09.298019+0000","last_clean":"2023-10-25T23:36:09.298019+0000","last_became_active":"2023-10-25T23:36:09.290160+0000","last_became_peered":"2023-10-25T23:36:09.290160+0000","last_unstale":"2023-10-25T23:36:09.298019+0000","last_undegraded":"2023-10-25T23:36:09.298019+0000","last_fullsized":"2023-10-25T23:36:09.298019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:01.440988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887814+0000","last_change":"2023-10-25T23:36:09.298886+0000","last_active":"2023-10-25T23:36:10.887814+0000","last_peered":"2023-10-25T23:36:10.887814+0000","last_clean":"2023-10-25T23:36:10.887814+0000","last_became_active":"2023-10-25T23:36:09.298637+0000","last_became_peered":"2023-10-25T23:36:09.298637+0000","last_unstale":"2023-10-25T23:36:10.887814+0000","last_undegraded":"2023-10-25T23:36:10.887814+0000","last_fullsized":"2023-10-25T23:36:10.887814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:58:48.401709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.298019+0000","last_change":"2023-10-25T23:36:09.290809+0000","last_active":"2023-10-25T23:36:09.298019+0000","last_peered":"2023-10-25T23:36:09.298019+0000","last_clean":"2023-10-25T23:36:09.298019+0000","last_became_active":"2023-10-25T23:36:09.290546+0000","last_became_peered":"2023-10-25T23:36:09.290546+0000","last_unstale":"2023-10-25T23:36:09.298019+0000","last_undegraded":"2023-10-25T23:36:09.298019+0000","last_fullsized":"2023-10-25T23:36:09.298019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:05.924938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887720+0000","last_change":"2023-10-25T23:36:09.296735+0000","last_active":"2023-10-25T23:36:10.887720+0000","last_peered":"2023-10-25T23:36:10.887720+0000","last_clean":"2023-10-25T23:36:10.887720+0000","last_became_active":"2023-10-25T23:36:09.296280+0000","last_became_peered":"2023-10-25T23:36:09.296280+0000","last_unstale":"2023-10-25T23:36:10.887720+0000","last_undegraded":"2023-10-25T23:36:10.887720+0000","last_fullsized":"2023-10-25T23:36:10.887720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:28:06.035601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.299782+0000","last_change":"2023-10-25T23:36:09.285887+0000","last_active":"2023-10-25T23:36:09.299782+0000","last_peered":"2023-10-25T23:36:09.299782+0000","last_clean":"2023-10-25T23:36:09.299782+0000","last_became_active":"2023-10-25T23:36:09.285610+0000","last_became_peered":"2023-10-25T23:36:09.285610+0000","last_unstale":"2023-10-25T23:36:09.299782+0000","last_undegraded":"2023-10-25T23:36:09.299782+0000","last_fullsized":"2023-10-25T23:36:09.299782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:05.924938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285693+0000","last_change":"2023-10-25T23:36:09.291838+0000","last_active":"2023-10-25T23:36:10.285693+0000","last_peered":"2023-10-25T23:36:10.285693+0000","last_clean":"2023-10-25T23:36:10.285693+0000","last_became_active":"2023-10-25T23:36:09.291566+0000","last_became_peered":"2023-10-25T23:36:09.291566+0000","last_unstale":"2023-10-25T23:36:10.285693+0000","last_undegraded":"2023-10-25T23:36:10.285693+0000","last_fullsized":"2023-10-25T23:36:10.285693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:26:04.639901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":69429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":660275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":70881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":69359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-25T23:36:13.761 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-25T23:36:13.762 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2023-10-25T23:36:13.762 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-25T23:36:13.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.916+0000 7f3857b85700 1 -- 172.21.15.81:0/3806347120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3850144f60 msgr2=0x7f385014b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.916+0000 7f3857b85700 1 --2- 172.21.15.81:0/3806347120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3850144f60 0x7f385014b990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3840005fd0 tx=0x7f3840009c70 comp rx=0 tx=0).stop 2023-10-25T23:36:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.916+0000 7f3857b85700 1 -- 172.21.15.81:0/3806347120 shutdown_connections 2023-10-25T23:36:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.916+0000 7f3857b85700 1 --2- 172.21.15.81:0/3806347120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3850144f60 0x7f385014b990 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.916+0000 7f3857b85700 1 -- 172.21.15.81:0/3806347120 >> 172.21.15.81:0/3806347120 conn(0x7f385006b320 msgr2=0x7f385006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:13.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.916+0000 7f3857b85700 1 -- 172.21.15.81:0/3806347120 shutdown_connections 2023-10-25T23:36:13.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.916+0000 7f3857b85700 1 -- 172.21.15.81:0/3806347120 wait complete. 2023-10-25T23:36:13.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.917+0000 7f3857b85700 1 Processor -- start 2023-10-25T23:36:13.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.917+0000 7f3857b85700 1 -- start start 2023-10-25T23:36:13.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.918+0000 7f3857b85700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38500bb530 0x7f38500b8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:13.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.918+0000 7f3857b85700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3850144f60 0x7f38501e1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:13.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.918+0000 7f3857b85700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38501538f0 0x7f38501e53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:13.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.918+0000 7f3857b85700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3850137010 con 0x7f38501538f0 2023-10-25T23:36:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.918+0000 7f3857b85700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385013b4c0 con 0x7f38500bb530 2023-10-25T23:36:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.918+0000 7f3857b85700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38501e58e0 con 0x7f3850144f60 2023-10-25T23:36:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.918+0000 7f3856122700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38501538f0 0x7f38501e53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.918+0000 7f3856122700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38501538f0 0x7f38501e53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36244/0 (socket says 172.21.15.81:36244) 2023-10-25T23:36:13.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.918+0000 7f3856122700 1 -- 172.21.15.81:0/4185218493 learned_addr learned my addr 172.21.15.81:0/4185218493 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:13.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.918+0000 7f3855921700 1 --2- 172.21.15.81:0/4185218493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38500bb530 0x7f38500b8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:13.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.918+0000 7f3855120700 1 --2- 172.21.15.81:0/4185218493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3850144f60 0x7f38501e1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:13.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.918+0000 7f3856122700 1 -- 172.21.15.81:0/4185218493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3850144f60 msgr2=0x7f38501e1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:13.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.918+0000 7f3856122700 1 --2- 172.21.15.81:0/4185218493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3850144f60 0x7f38501e1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.918+0000 7f3856122700 1 -- 172.21.15.81:0/4185218493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38500bb530 msgr2=0x7f38500b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:13.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.918+0000 7f3856122700 1 --2- 172.21.15.81:0/4185218493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38500bb530 0x7f38500b8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:13.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.918+0000 7f3856122700 1 -- 172.21.15.81:0/4185218493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38400095f0 con 0x7f38501538f0 2023-10-25T23:36:13.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.919+0000 7f3856122700 1 --2- 172.21.15.81:0/4185218493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38501538f0 0x7f38501e53a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f384800cc80 tx=0x7f384800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:13.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.919+0000 7f38467fc700 1 -- 172.21.15.81:0/4185218493 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848003c00 con 0x7f38501538f0 2023-10-25T23:36:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.919+0000 7f38467fc700 1 -- 172.21.15.81:0/4185218493 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3848003d60 con 0x7f38501538f0 2023-10-25T23:36:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.919+0000 7f3857b85700 1 -- 172.21.15.81:0/4185218493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38501e1a50 con 0x7f38501538f0 2023-10-25T23:36:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.919+0000 7f38467fc700 1 -- 172.21.15.81:0/4185218493 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384800aac0 con 0x7f38501538f0 2023-10-25T23:36:13.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.919+0000 7f3857b85700 1 -- 172.21.15.81:0/4185218493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385013c190 con 0x7f38501538f0 2023-10-25T23:36:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.920+0000 7f3857b85700 1 -- 172.21.15.81:0/4185218493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385014b1f0 con 0x7f38501538f0 2023-10-25T23:36:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.920+0000 7f38467fc700 1 -- 172.21.15.81:0/4185218493 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f384800ac20 con 0x7f38501538f0 2023-10-25T23:36:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.920+0000 7f38467fc700 1 --2- 172.21.15.81:0/4185218493 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f383406aed0 0x7f383406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.921+0000 7f38467fc700 1 -- 172.21.15.81:0/4185218493 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38480896f0 con 0x7f38501538f0 2023-10-25T23:36:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.921+0000 7f3855921700 1 --2- 172.21.15.81:0/4185218493 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f383406aed0 0x7f383406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:13.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.921+0000 7f3855921700 1 --2- 172.21.15.81:0/4185218493 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f383406aed0 0x7f383406d390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3840000c00 tx=0x7f38400047c0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:13.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:13.925+0000 7f38467fc700 1 -- 172.21.15.81:0/4185218493 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f385014b1f0 con 0x7f38501538f0 2023-10-25T23:36:14.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.113+0000 7f3857b85700 1 -- 172.21.15.81:0/4185218493 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7f385014b1f0 con 0x7f38501538f0 2023-10-25T23:36:14.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.114+0000 7f38467fc700 1 -- 172.21.15.81:0/4185218493 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v26) v1 ==== 86+0+160 (secure 0 0 0) 0x7f385014b1f0 con 0x7f38501538f0 2023-10-25T23:36:14.116 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:14.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.116+0000 7f3857b85700 1 -- 172.21.15.81:0/4185218493 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f383406aed0 msgr2=0x7f383406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:14.118 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.116+0000 7f3857b85700 1 --2- 172.21.15.81:0/4185218493 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f383406aed0 0x7f383406d390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3840000c00 tx=0x7f38400047c0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.116+0000 7f3857b85700 1 -- 172.21.15.81:0/4185218493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38501538f0 msgr2=0x7f38501e53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.116+0000 7f3857b85700 1 --2- 172.21.15.81:0/4185218493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38501538f0 0x7f38501e53a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f384800cc80 tx=0x7f384800cf90 comp rx=0 tx=0).stop 2023-10-25T23:36:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.116+0000 7f3857b85700 1 -- 172.21.15.81:0/4185218493 shutdown_connections 2023-10-25T23:36:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.116+0000 7f3857b85700 1 --2- 172.21.15.81:0/4185218493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38501538f0 0x7f38501e53a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.116+0000 7f3857b85700 1 --2- 172.21.15.81:0/4185218493 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f383406aed0 0x7f383406d390 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.116+0000 7f3857b85700 1 --2- 172.21.15.81:0/4185218493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38500bb530 0x7f38500b8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.116+0000 7f3857b85700 1 --2- 172.21.15.81:0/4185218493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3850144f60 0x7f38501e1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.116+0000 7f3857b85700 1 -- 172.21.15.81:0/4185218493 >> 172.21.15.81:0/4185218493 conn(0x7f385006b320 msgr2=0x7f385006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.116+0000 7f3857b85700 1 -- 172.21.15.81:0/4185218493 shutdown_connections 2023-10-25T23:36:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.116+0000 7f3857b85700 1 -- 172.21.15.81:0/4185218493 wait complete. 2023-10-25T23:36:14.130 INFO:teuthology.orchestra.run.smithi081.stdout:[{"version":26,"timestamp":"2023-10-25T23:35:54.121541+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"6321.488409"}]}] 2023-10-25T23:36:14.130 INFO:tasks.ceph_manager:config epoch is 26 2023-10-25T23:36:14.130 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-25T23:36:14.131 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-25T23:36:14.131 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-25T23:36:14.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.250+0000 7f8f30572700 1 -- 172.21.15.81:0/822450309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f280bc390 msgr2=0x7f8f2806e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:14.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.251+0000 7f8f30572700 1 --2- 172.21.15.81:0/822450309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f280bc390 0x7f8f2806e170 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8f240098f0 tx=0x7f8f24009c00 comp rx=0 tx=0).stop 2023-10-25T23:36:14.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.251+0000 7f8f30572700 1 -- 172.21.15.81:0/822450309 shutdown_connections 2023-10-25T23:36:14.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.251+0000 7f8f30572700 1 --2- 172.21.15.81:0/822450309 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f280bc390 0x7f8f2806e170 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.251+0000 7f8f30572700 1 -- 172.21.15.81:0/822450309 >> 172.21.15.81:0/822450309 conn(0x7f8f280c1b30 msgr2=0x7f8f280c1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:14.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.251+0000 7f8f30572700 1 -- 172.21.15.81:0/822450309 shutdown_connections 2023-10-25T23:36:14.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.251+0000 7f8f30572700 1 -- 172.21.15.81:0/822450309 wait complete. 2023-10-25T23:36:14.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.252+0000 7f8f30572700 1 Processor -- start 2023-10-25T23:36:14.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.252+0000 7f8f30572700 1 -- start start 2023-10-25T23:36:14.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.252+0000 7f8f30572700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f2806dd90 0x7f8f281e2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:14.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.252+0000 7f8f30572700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f280bc390 0x7f8f280b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:14.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.252+0000 7f8f30572700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f280c1050 0x7f8f281e3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:14.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.252+0000 7f8f30572700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f281d8290 con 0x7f8f280c1050 2023-10-25T23:36:14.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.252+0000 7f8f30572700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f28147d20 con 0x7f8f2806dd90 2023-10-25T23:36:14.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.252+0000 7f8f30572700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f28148b80 con 0x7f8f280bc390 2023-10-25T23:36:14.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.252+0000 7f8f2eb0f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f280c1050 0x7f8f281e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:14.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.252+0000 7f8f2eb0f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f280c1050 0x7f8f281e3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36258/0 (socket says 172.21.15.81:36258) 2023-10-25T23:36:14.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.252+0000 7f8f2eb0f700 1 -- 172.21.15.81:0/2502455008 learned_addr learned my addr 172.21.15.81:0/2502455008 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:14.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.253+0000 7f8f2db0d700 1 --2- 172.21.15.81:0/2502455008 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f280bc390 0x7f8f280b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:14.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.253+0000 7f8f2e30e700 1 --2- 172.21.15.81:0/2502455008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f2806dd90 0x7f8f281e2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:14.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.253+0000 7f8f2eb0f700 1 -- 172.21.15.81:0/2502455008 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f280bc390 msgr2=0x7f8f280b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:14.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.253+0000 7f8f2eb0f700 1 --2- 172.21.15.81:0/2502455008 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f280bc390 0x7f8f280b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.253+0000 7f8f2eb0f700 1 -- 172.21.15.81:0/2502455008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f2806dd90 msgr2=0x7f8f281e2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:14.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.253+0000 7f8f2eb0f700 1 --2- 172.21.15.81:0/2502455008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f2806dd90 0x7f8f281e2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.253+0000 7f8f2eb0f700 1 -- 172.21.15.81:0/2502455008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f24009520 con 0x7f8f280c1050 2023-10-25T23:36:14.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.253+0000 7f8f2db0d700 1 --2- 172.21.15.81:0/2502455008 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f280bc390 0x7f8f280b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:36:14.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.253+0000 7f8f2e30e700 1 --2- 172.21.15.81:0/2502455008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f2806dd90 0x7f8f281e2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:36:14.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.253+0000 7f8f2eb0f700 1 --2- 172.21.15.81:0/2502455008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f280c1050 0x7f8f281e3360 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8f2000c8f0 tx=0x7f8f2000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:14.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.253+0000 7f8f1effd700 1 -- 172.21.15.81:0/2502455008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f20003e10 con 0x7f8f280c1050 2023-10-25T23:36:14.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.253+0000 7f8f30572700 1 -- 172.21.15.81:0/2502455008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f281dd360 con 0x7f8f280c1050 2023-10-25T23:36:14.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.253+0000 7f8f1effd700 1 -- 172.21.15.81:0/2502455008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8f20005070 con 0x7f8f280c1050 2023-10-25T23:36:14.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.253+0000 7f8f1effd700 1 -- 172.21.15.81:0/2502455008 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f20005480 con 0x7f8f280c1050 2023-10-25T23:36:14.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.253+0000 7f8f30572700 1 -- 172.21.15.81:0/2502455008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f280b6040 con 0x7f8f280c1050 2023-10-25T23:36:14.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.254+0000 7f8f30572700 1 -- 172.21.15.81:0/2502455008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f280b3dd0 con 0x7f8f280c1050 2023-10-25T23:36:14.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.254+0000 7f8f1effd700 1 -- 172.21.15.81:0/2502455008 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8f200055e0 con 0x7f8f280c1050 2023-10-25T23:36:14.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.255+0000 7f8f1effd700 1 --2- 172.21.15.81:0/2502455008 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f8f0c06aed0 0x7f8f0c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:14.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.255+0000 7f8f1effd700 1 -- 172.21.15.81:0/2502455008 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f20089030 con 0x7f8f280c1050 2023-10-25T23:36:14.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.255+0000 7f8f2e30e700 1 --2- 172.21.15.81:0/2502455008 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f8f0c06aed0 0x7f8f0c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:14.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.256+0000 7f8f2e30e700 1 --2- 172.21.15.81:0/2502455008 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f8f0c06aed0 0x7f8f0c06d390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f180011e0 tx=0x7f8f18009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:14.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.259+0000 7f8f1effd700 1 -- 172.21.15.81:0/2502455008 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8f20054060 con 0x7f8f280c1050 2023-10-25T23:36:14.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.506+0000 7f8f30572700 1 -- 172.21.15.81:0/2502455008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8f2804e4c0 con 0x7f8f280c1050 2023-10-25T23:36:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.509+0000 7f8f1effd700 1 -- 172.21.15.81:0/2502455008 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171028 (secure 0 0 0) 0x7f8f20057680 con 0x7f8f280c1050 2023-10-25T23:36:14.514 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.512+0000 7f8f30572700 1 -- 172.21.15.81:0/2502455008 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f8f0c06aed0 msgr2=0x7f8f0c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.512+0000 7f8f30572700 1 --2- 172.21.15.81:0/2502455008 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f8f0c06aed0 0x7f8f0c06d390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f180011e0 tx=0x7f8f18009040 comp rx=0 tx=0).stop 2023-10-25T23:36:14.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.512+0000 7f8f30572700 1 -- 172.21.15.81:0/2502455008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f280c1050 msgr2=0x7f8f281e3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:14.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.512+0000 7f8f30572700 1 --2- 172.21.15.81:0/2502455008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f280c1050 0x7f8f281e3360 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8f2000c8f0 tx=0x7f8f2000ccb0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.512+0000 7f8f30572700 1 -- 172.21.15.81:0/2502455008 shutdown_connections 2023-10-25T23:36:14.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.512+0000 7f8f30572700 1 --2- 172.21.15.81:0/2502455008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f280c1050 0x7f8f281e3360 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.512+0000 7f8f30572700 1 --2- 172.21.15.81:0/2502455008 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f8f0c06aed0 0x7f8f0c06d390 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.512+0000 7f8f30572700 1 --2- 172.21.15.81:0/2502455008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f2806dd90 0x7f8f281e2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.512+0000 7f8f30572700 1 --2- 172.21.15.81:0/2502455008 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f280bc390 0x7f8f280b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.512+0000 7f8f30572700 1 -- 172.21.15.81:0/2502455008 >> 172.21.15.81:0/2502455008 conn(0x7f8f280c1b30 msgr2=0x7f8f280a0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:14.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.512+0000 7f8f30572700 1 -- 172.21.15.81:0/2502455008 shutdown_connections 2023-10-25T23:36:14.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.512+0000 7f8f30572700 1 -- 172.21.15.81:0/2502455008 wait complete. 2023-10-25T23:36:14.526 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"active_gid":4133,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3905428844},{"type":"v1","addr":"172.21.15.89:6833","nonce":3905428844}]},"active_addr":"172.21.15.89:6833/3905428844","active_change":"2023-10-25T23:35:48.977996+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4114,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":2810528853}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":680718514}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":616390557}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":1289308351}]}]} 2023-10-25T23:36:14.533 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-25T23:36:14.534 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-25T23:36:14.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T23:36:14.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.655+0000 7f6adf95b700 1 -- 172.21.15.81:0/1894725219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ad80bc390 msgr2=0x7f6ad806e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:14.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.655+0000 7f6adf95b700 1 --2- 172.21.15.81:0/1894725219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ad80bc390 0x7f6ad806e170 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40098c0 tx=0x7f6ad4009bd0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.655+0000 7f6adf95b700 1 -- 172.21.15.81:0/1894725219 shutdown_connections 2023-10-25T23:36:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.655+0000 7f6adf95b700 1 --2- 172.21.15.81:0/1894725219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ad80c1050 0x7f6ad80bd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.655+0000 7f6adf95b700 1 --2- 172.21.15.81:0/1894725219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ad80bc390 0x7f6ad806e170 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.655+0000 7f6adf95b700 1 -- 172.21.15.81:0/1894725219 >> 172.21.15.81:0/1894725219 conn(0x7f6ad80c1b30 msgr2=0x7f6ad80c1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.655+0000 7f6adf95b700 1 -- 172.21.15.81:0/1894725219 shutdown_connections 2023-10-25T23:36:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.655+0000 7f6adf95b700 1 -- 172.21.15.81:0/1894725219 wait complete. 2023-10-25T23:36:14.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.656+0000 7f6adf95b700 1 Processor -- start 2023-10-25T23:36:14.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.656+0000 7f6adf95b700 1 -- start start 2023-10-25T23:36:14.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6adf95b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ad806dd90 0x7f6ad80b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:14.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6adf95b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad80bc390 0x7f6ad80b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:14.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6adf95b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ad80c1050 0x7f6ad80b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:14.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6adf95b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad81e3f70 con 0x7f6ad80c1050 2023-10-25T23:36:14.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6adf95b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad81e6410 con 0x7f6ad80bc390 2023-10-25T23:36:14.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6adf95b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad80bb710 con 0x7f6ad806dd90 2023-10-25T23:36:14.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6addef8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ad80c1050 0x7f6ad80b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:14.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6addef8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ad80c1050 0x7f6ad80b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36272/0 (socket says 172.21.15.81:36272) 2023-10-25T23:36:14.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6addef8700 1 -- 172.21.15.81:0/3978055969 learned_addr learned my addr 172.21.15.81:0/3978055969 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:14.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6adcef6700 1 --2- 172.21.15.81:0/3978055969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad80bc390 0x7f6ad80b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:14.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6add6f7700 1 --2- 172.21.15.81:0/3978055969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ad806dd90 0x7f6ad80b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:14.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6addef8700 1 -- 172.21.15.81:0/3978055969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ad806dd90 msgr2=0x7f6ad80b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:14.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6addef8700 1 --2- 172.21.15.81:0/3978055969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ad806dd90 0x7f6ad80b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6addef8700 1 -- 172.21.15.81:0/3978055969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad80bc390 msgr2=0x7f6ad80b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:14.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6addef8700 1 --2- 172.21.15.81:0/3978055969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad80bc390 0x7f6ad80b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6addef8700 1 -- 172.21.15.81:0/3978055969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad4009520 con 0x7f6ad80c1050 2023-10-25T23:36:14.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6addef8700 1 --2- 172.21.15.81:0/3978055969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ad80c1050 0x7f6ad80b42d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0007fc0 tx=0x7f6ad000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:14.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6acdffb700 1 -- 172.21.15.81:0/3978055969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0004bb0 con 0x7f6ad80c1050 2023-10-25T23:36:14.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6acdffb700 1 -- 172.21.15.81:0/3978055969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6ad0004e00 con 0x7f6ad80c1050 2023-10-25T23:36:14.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6adf95b700 1 -- 172.21.15.81:0/3978055969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad80bb9f0 con 0x7f6ad80c1050 2023-10-25T23:36:14.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.657+0000 7f6acdffb700 1 -- 172.21.15.81:0/3978055969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0005280 con 0x7f6ad80c1050 2023-10-25T23:36:14.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.658+0000 7f6adf95b700 1 -- 172.21.15.81:0/3978055969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad806e170 con 0x7f6ad80c1050 2023-10-25T23:36:14.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.658+0000 7f6adf95b700 1 -- 172.21.15.81:0/3978055969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad81e40e0 con 0x7f6ad80c1050 2023-10-25T23:36:14.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.659+0000 7f6acdffb700 1 -- 172.21.15.81:0/3978055969 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6ad00053e0 con 0x7f6ad80c1050 2023-10-25T23:36:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.659+0000 7f6acdffb700 1 --2- 172.21.15.81:0/3978055969 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6abc06aed0 0x7f6abc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.659+0000 7f6acdffb700 1 -- 172.21.15.81:0/3978055969 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ad00898b0 con 0x7f6ad80c1050 2023-10-25T23:36:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.659+0000 7f6add6f7700 1 --2- 172.21.15.81:0/3978055969 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6abc06aed0 0x7f6abc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.660+0000 7f6add6f7700 1 --2- 172.21.15.81:0/3978055969 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6abc06aed0 0x7f6abc06d390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8004740 tx=0x7f6ac8007f40 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.664+0000 7f6acdffb700 1 -- 172.21.15.81:0/3978055969 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ad00549f0 con 0x7f6ad80c1050 2023-10-25T23:36:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.852+0000 7f6adf95b700 1 -- 172.21.15.81:0/3978055969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ad804e4c0 con 0x7f6ad80c1050 2023-10-25T23:36:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.853+0000 7f6acdffb700 1 -- 172.21.15.81:0/3978055969 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f6ad0058010 con 0x7f6ad80c1050 2023-10-25T23:36:14.855 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:14.855 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf","created":"2023-10-25T23:35:42.986840+0000","modified":"2023-10-25T23:36:10.277991+0000","last_up_change":"2023-10-25T23:35:55.052199+0000","last_in_change":"2023-10-25T23:35:46.443490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T23:35:57.031170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T23:36:06.841771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T23:36:07.613269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48415836-8f22-4dcd-baa3-1d09c90c9a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6809","nonce":1045657984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6811","nonce":1045657984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6815","nonce":1045657984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6813","nonce":1045657984}]},"public_addr":"172.21.15.81:6809/1045657984","cluster_addr":"172.21.15.81:6811/1045657984","heartbeat_back_addr":"172.21.15.81:6815/1045657984","heartbeat_front_addr":"172.21.15.81:6813/1045657984","state":["exists","up"]},{"osd":1,"uuid":"19a4f6b5-e75c-45ae-aa08-b3467e69eed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6801","nonce":725386907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6803","nonce":725386907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6807","nonce":725386907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6805","nonce":725386907}]},"public_addr":"172.21.15.81:6801/725386907","cluster_addr":"172.21.15.81:6803/725386907","heartbeat_back_addr":"172.21.15.81:6807/725386907","heartbeat_front_addr":"172.21.15.81:6805/725386907","state":["exists","up"]},{"osd":2,"uuid":"60645312-54f5-4a74-ae52-68d17ff2d6e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6825","nonce":1744054610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6827","nonce":1744054610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6831","nonce":1744054610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6829","nonce":1744054610}]},"public_addr":"172.21.15.81:6825/1744054610","cluster_addr":"172.21.15.81:6827/1744054610","heartbeat_back_addr":"172.21.15.81:6831/1744054610","heartbeat_front_addr":"172.21.15.81:6829/1744054610","state":["exists","up"]},{"osd":3,"uuid":"c636a4a2-c1e8-4306-a78b-fe37eebab526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6817","nonce":1391123341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6819","nonce":1391123341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6823","nonce":1391123341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6821","nonce":1391123341}]},"public_addr":"172.21.15.81:6817/1391123341","cluster_addr":"172.21.15.81:6819/1391123341","heartbeat_back_addr":"172.21.15.81:6823/1391123341","heartbeat_front_addr":"172.21.15.81:6821/1391123341","state":["exists","up"]},{"osd":4,"uuid":"3cafc826-e531-4aa7-8b2a-b592f318f138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6817","nonce":1232781703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6819","nonce":1232781703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6823","nonce":1232781703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6821","nonce":1232781703}]},"public_addr":"172.21.15.89:6817/1232781703","cluster_addr":"172.21.15.89:6819/1232781703","heartbeat_back_addr":"172.21.15.89:6823/1232781703","heartbeat_front_addr":"172.21.15.89:6821/1232781703","state":["exists","up"]},{"osd":5,"uuid":"6098deb2-258e-47e1-b283-9a24c9dddf27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6801","nonce":2255820086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6803","nonce":2255820086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6807","nonce":2255820086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6805","nonce":2255820086}]},"public_addr":"172.21.15.89:6801/2255820086","cluster_addr":"172.21.15.89:6803/2255820086","heartbeat_back_addr":"172.21.15.89:6807/2255820086","heartbeat_front_addr":"172.21.15.89:6805/2255820086","state":["exists","up"]},{"osd":6,"uuid":"d79f68de-3c19-4f68-bbd1-59c8484dfaa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6809","nonce":2561967165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6811","nonce":2561967165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6815","nonce":2561967165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6813","nonce":2561967165}]},"public_addr":"172.21.15.89:6809/2561967165","cluster_addr":"172.21.15.89:6811/2561967165","heartbeat_back_addr":"172.21.15.89:6815/2561967165","heartbeat_front_addr":"172.21.15.89:6813/2561967165","state":["exists","up"]},{"osd":7,"uuid":"f1f7002e-4de9-4a08-97a1-fb52a116687f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6825","nonce":2647243500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6827","nonce":2647243500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6831","nonce":2647243500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6829","nonce":2647243500}]},"public_addr":"172.21.15.89:6825/2647243500","cluster_addr":"172.21.15.89:6827/2647243500","heartbeat_back_addr":"172.21.15.89:6831/2647243500","heartbeat_front_addr":"172.21.15.89:6829/2647243500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.613750+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.593515+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.713198+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.725623+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.686409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.596728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.670930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.676762+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T23:36:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.855+0000 7f6adf95b700 1 -- 172.21.15.81:0/3978055969 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6abc06aed0 msgr2=0x7f6abc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.855+0000 7f6adf95b700 1 --2- 172.21.15.81:0/3978055969 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6abc06aed0 0x7f6abc06d390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8004740 tx=0x7f6ac8007f40 comp rx=0 tx=0).stop 2023-10-25T23:36:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.855+0000 7f6adf95b700 1 -- 172.21.15.81:0/3978055969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ad80c1050 msgr2=0x7f6ad80b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:14.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.855+0000 7f6adf95b700 1 --2- 172.21.15.81:0/3978055969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ad80c1050 0x7f6ad80b42d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0007fc0 tx=0x7f6ad000a650 comp rx=0 tx=0).stop 2023-10-25T23:36:14.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.855+0000 7f6adf95b700 1 -- 172.21.15.81:0/3978055969 shutdown_connections 2023-10-25T23:36:14.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.855+0000 7f6adf95b700 1 --2- 172.21.15.81:0/3978055969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ad80c1050 0x7f6ad80b42d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.855+0000 7f6adf95b700 1 --2- 172.21.15.81:0/3978055969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6ad806dd90 0x7f6ad80b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.855+0000 7f6adf95b700 1 --2- 172.21.15.81:0/3978055969 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6abc06aed0 0x7f6abc06d390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.855+0000 7f6adf95b700 1 --2- 172.21.15.81:0/3978055969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6ad80bc390 0x7f6ad80b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.855+0000 7f6adf95b700 1 -- 172.21.15.81:0/3978055969 >> 172.21.15.81:0/3978055969 conn(0x7f6ad80c1b30 msgr2=0x7f6ad814b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:14.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.855+0000 7f6adf95b700 1 -- 172.21.15.81:0/3978055969 shutdown_connections 2023-10-25T23:36:14.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.855+0000 7f6adf95b700 1 -- 172.21.15.81:0/3978055969 wait complete. 2023-10-25T23:36:14.869 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-25T23:36:14.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T23:36:14.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.990+0000 7faff6c83700 1 -- 172.21.15.81:0/1292487370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faff00be8c0 msgr2=0x7faff00bf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:14.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.990+0000 7faff6c83700 1 --2- 172.21.15.81:0/1292487370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faff00be8c0 0x7faff00bf640 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0098c0 tx=0x7fafdc009bd0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.990+0000 7faff6c83700 1 -- 172.21.15.81:0/1292487370 shutdown_connections 2023-10-25T23:36:14.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.990+0000 7faff6c83700 1 --2- 172.21.15.81:0/1292487370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faff00bfb80 0x7faff0155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.990+0000 7faff6c83700 1 --2- 172.21.15.81:0/1292487370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faff00be8c0 0x7faff00bf640 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:14.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.990+0000 7faff6c83700 1 -- 172.21.15.81:0/1292487370 >> 172.21.15.81:0/1292487370 conn(0x7faff00bd540 msgr2=0x7faff00bd950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:14.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.990+0000 7faff6c83700 1 -- 172.21.15.81:0/1292487370 shutdown_connections 2023-10-25T23:36:14.993 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.990+0000 7faff6c83700 1 -- 172.21.15.81:0/1292487370 wait complete. 2023-10-25T23:36:14.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.991+0000 7faff6c83700 1 Processor -- start 2023-10-25T23:36:14.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.992+0000 7faff6c83700 1 -- start start 2023-10-25T23:36:14.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.992+0000 7faff6c83700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faff006f500 0x7faff00b9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:14.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.992+0000 7faff6c83700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faff00be8c0 0x7faff014e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:14.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.992+0000 7faff6c83700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faff00bfb80 0x7faff00b9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:14.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.992+0000 7faff6c83700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff0147060 con 0x7faff00bfb80 2023-10-25T23:36:14.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.992+0000 7faff6c83700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff00b9960 con 0x7faff00be8c0 2023-10-25T23:36:14.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.992+0000 7faff6c83700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff0147920 con 0x7faff006f500 2023-10-25T23:36:14.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.992+0000 7faff5220700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faff00bfb80 0x7faff00b9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:14.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.992+0000 7faff5220700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faff00bfb80 0x7faff00b9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36286/0 (socket says 172.21.15.81:36286) 2023-10-25T23:36:14.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.992+0000 7faff5220700 1 -- 172.21.15.81:0/2428053416 learned_addr learned my addr 172.21.15.81:0/2428053416 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:15.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.993+0000 7fafeffff700 1 --2- 172.21.15.81:0/2428053416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faff00be8c0 0x7faff014e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.993+0000 7faff4a1f700 1 --2- 172.21.15.81:0/2428053416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faff006f500 0x7faff00b9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.993+0000 7faff5220700 1 -- 172.21.15.81:0/2428053416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faff006f500 msgr2=0x7faff00b9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.993+0000 7faff5220700 1 --2- 172.21.15.81:0/2428053416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faff006f500 0x7faff00b9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.993+0000 7faff5220700 1 -- 172.21.15.81:0/2428053416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faff00be8c0 msgr2=0x7faff014e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.993+0000 7faff5220700 1 --2- 172.21.15.81:0/2428053416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faff00be8c0 0x7faff014e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.993+0000 7faff5220700 1 -- 172.21.15.81:0/2428053416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc009520 con 0x7faff00bfb80 2023-10-25T23:36:15.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.993+0000 7faff5220700 1 --2- 172.21.15.81:0/2428053416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faff00bfb80 0x7faff00b9fc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fafe800cf40 tx=0x7fafe800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.993+0000 7fafed7fa700 1 -- 172.21.15.81:0/2428053416 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe8004bb0 con 0x7faff00bfb80 2023-10-25T23:36:15.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.993+0000 7fafed7fa700 1 -- 172.21.15.81:0/2428053416 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fafe8004e40 con 0x7faff00bfb80 2023-10-25T23:36:15.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.993+0000 7faff6c83700 1 -- 172.21.15.81:0/2428053416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff0147c00 con 0x7faff00bfb80 2023-10-25T23:36:15.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.993+0000 7fafed7fa700 1 -- 172.21.15.81:0/2428053416 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe8005280 con 0x7faff00bfb80 2023-10-25T23:36:15.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.993+0000 7faff6c83700 1 -- 172.21.15.81:0/2428053416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff014c410 con 0x7faff00bfb80 2023-10-25T23:36:15.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.994+0000 7faff6c83700 1 -- 172.21.15.81:0/2428053416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff00a23e0 con 0x7faff00bfb80 2023-10-25T23:36:15.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.995+0000 7fafed7fa700 1 -- 172.21.15.81:0/2428053416 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fafe80053e0 con 0x7faff00bfb80 2023-10-25T23:36:15.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.995+0000 7fafed7fa700 1 --2- 172.21.15.81:0/2428053416 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fafd406aed0 0x7fafd406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.995+0000 7fafed7fa700 1 -- 172.21.15.81:0/2428053416 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafe8089fd0 con 0x7faff00bfb80 2023-10-25T23:36:15.005 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.995+0000 7faff4a1f700 1 --2- 172.21.15.81:0/2428053416 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fafd406aed0 0x7fafd406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.996+0000 7faff4a1f700 1 --2- 172.21.15.81:0/2428053416 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fafd406aed0 0x7fafd406d390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fafe4007fd0 tx=0x7fafe4009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.006 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:14.999+0000 7fafed7fa700 1 -- 172.21.15.81:0/2428053416 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fafe80551f0 con 0x7faff00bfb80 2023-10-25T23:36:15.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.190+0000 7faff6c83700 1 -- 172.21.15.81:0/2428053416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faff004e4c0 con 0x7faff00bfb80 2023-10-25T23:36:15.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.191+0000 7fafed7fa700 1 -- 172.21.15.81:0/2428053416 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fafe8022020 con 0x7faff00bfb80 2023-10-25T23:36:15.192 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:15.193 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf","created":"2023-10-25T23:35:42.986840+0000","modified":"2023-10-25T23:36:10.277991+0000","last_up_change":"2023-10-25T23:35:55.052199+0000","last_in_change":"2023-10-25T23:35:46.443490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T23:35:57.031170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T23:36:06.841771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T23:36:07.613269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48415836-8f22-4dcd-baa3-1d09c90c9a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6809","nonce":1045657984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6811","nonce":1045657984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6815","nonce":1045657984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6813","nonce":1045657984}]},"public_addr":"172.21.15.81:6809/1045657984","cluster_addr":"172.21.15.81:6811/1045657984","heartbeat_back_addr":"172.21.15.81:6815/1045657984","heartbeat_front_addr":"172.21.15.81:6813/1045657984","state":["exists","up"]},{"osd":1,"uuid":"19a4f6b5-e75c-45ae-aa08-b3467e69eed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6801","nonce":725386907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6803","nonce":725386907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6807","nonce":725386907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6805","nonce":725386907}]},"public_addr":"172.21.15.81:6801/725386907","cluster_addr":"172.21.15.81:6803/725386907","heartbeat_back_addr":"172.21.15.81:6807/725386907","heartbeat_front_addr":"172.21.15.81:6805/725386907","state":["exists","up"]},{"osd":2,"uuid":"60645312-54f5-4a74-ae52-68d17ff2d6e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6825","nonce":1744054610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6827","nonce":1744054610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6831","nonce":1744054610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6829","nonce":1744054610}]},"public_addr":"172.21.15.81:6825/1744054610","cluster_addr":"172.21.15.81:6827/1744054610","heartbeat_back_addr":"172.21.15.81:6831/1744054610","heartbeat_front_addr":"172.21.15.81:6829/1744054610","state":["exists","up"]},{"osd":3,"uuid":"c636a4a2-c1e8-4306-a78b-fe37eebab526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6817","nonce":1391123341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6819","nonce":1391123341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6823","nonce":1391123341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6821","nonce":1391123341}]},"public_addr":"172.21.15.81:6817/1391123341","cluster_addr":"172.21.15.81:6819/1391123341","heartbeat_back_addr":"172.21.15.81:6823/1391123341","heartbeat_front_addr":"172.21.15.81:6821/1391123341","state":["exists","up"]},{"osd":4,"uuid":"3cafc826-e531-4aa7-8b2a-b592f318f138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6817","nonce":1232781703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6819","nonce":1232781703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6823","nonce":1232781703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6821","nonce":1232781703}]},"public_addr":"172.21.15.89:6817/1232781703","cluster_addr":"172.21.15.89:6819/1232781703","heartbeat_back_addr":"172.21.15.89:6823/1232781703","heartbeat_front_addr":"172.21.15.89:6821/1232781703","state":["exists","up"]},{"osd":5,"uuid":"6098deb2-258e-47e1-b283-9a24c9dddf27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6801","nonce":2255820086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6803","nonce":2255820086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6807","nonce":2255820086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6805","nonce":2255820086}]},"public_addr":"172.21.15.89:6801/2255820086","cluster_addr":"172.21.15.89:6803/2255820086","heartbeat_back_addr":"172.21.15.89:6807/2255820086","heartbeat_front_addr":"172.21.15.89:6805/2255820086","state":["exists","up"]},{"osd":6,"uuid":"d79f68de-3c19-4f68-bbd1-59c8484dfaa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6809","nonce":2561967165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6811","nonce":2561967165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6815","nonce":2561967165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6813","nonce":2561967165}]},"public_addr":"172.21.15.89:6809/2561967165","cluster_addr":"172.21.15.89:6811/2561967165","heartbeat_back_addr":"172.21.15.89:6815/2561967165","heartbeat_front_addr":"172.21.15.89:6813/2561967165","state":["exists","up"]},{"osd":7,"uuid":"f1f7002e-4de9-4a08-97a1-fb52a116687f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6825","nonce":2647243500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6827","nonce":2647243500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6831","nonce":2647243500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6829","nonce":2647243500}]},"public_addr":"172.21.15.89:6825/2647243500","cluster_addr":"172.21.15.89:6827/2647243500","heartbeat_back_addr":"172.21.15.89:6831/2647243500","heartbeat_front_addr":"172.21.15.89:6829/2647243500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.613750+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.593515+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.713198+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.725623+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.686409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.596728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.670930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.676762+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T23:36:15.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.193+0000 7faff6c83700 1 -- 172.21.15.81:0/2428053416 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fafd406aed0 msgr2=0x7fafd406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.193+0000 7faff6c83700 1 --2- 172.21.15.81:0/2428053416 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fafd406aed0 0x7fafd406d390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fafe4007fd0 tx=0x7fafe4009040 comp rx=0 tx=0).stop 2023-10-25T23:36:15.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.193+0000 7faff6c83700 1 -- 172.21.15.81:0/2428053416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faff00bfb80 msgr2=0x7faff00b9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.193+0000 7faff6c83700 1 --2- 172.21.15.81:0/2428053416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faff00bfb80 0x7faff00b9fc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fafe800cf40 tx=0x7fafe800a650 comp rx=0 tx=0).stop 2023-10-25T23:36:15.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.193+0000 7faff6c83700 1 -- 172.21.15.81:0/2428053416 shutdown_connections 2023-10-25T23:36:15.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.193+0000 7faff6c83700 1 --2- 172.21.15.81:0/2428053416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faff00bfb80 0x7faff00b9fc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.193+0000 7faff6c83700 1 --2- 172.21.15.81:0/2428053416 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faff006f500 0x7faff00b9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.193+0000 7faff6c83700 1 --2- 172.21.15.81:0/2428053416 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fafd406aed0 0x7fafd406d390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.193+0000 7faff6c83700 1 --2- 172.21.15.81:0/2428053416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faff00be8c0 0x7faff014e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.193+0000 7faff6c83700 1 -- 172.21.15.81:0/2428053416 >> 172.21.15.81:0/2428053416 conn(0x7faff00bd540 msgr2=0x7faff014db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.193+0000 7faff6c83700 1 -- 172.21.15.81:0/2428053416 shutdown_connections 2023-10-25T23:36:15.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.193+0000 7faff6c83700 1 -- 172.21.15.81:0/2428053416 wait complete. 2023-10-25T23:36:15.206 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-25T23:36:15.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-25T23:36:15.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-25T23:36:15.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-25T23:36:15.209 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-25T23:36:15.209 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-25T23:36:15.210 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-25T23:36:15.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-25T23:36:15.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.419+0000 7f634a05f700 1 -- 172.21.15.81:0/1084476756 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f632c005330 msgr2=0x7f632c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.421 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.419+0000 7f634a05f700 1 --2- 172.21.15.81:0/1084476756 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f632c005330 0x7f632c00ba10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6334001050 tx=0x7f632c005880 comp rx=0 tx=0).stop 2023-10-25T23:36:15.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.420+0000 7f6343fff700 1 -- 172.21.15.81:0/1084476756 reap_dead start 2023-10-25T23:36:15.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.420+0000 7f634a05f700 1 -- 172.21.15.81:0/1084476756 shutdown_connections 2023-10-25T23:36:15.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.420+0000 7f634a05f700 1 -- 172.21.15.81:0/1084476756 >> 172.21.15.81:0/1084476756 conn(0x7f63440bf7c0 msgr2=0x7f63440bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.420+0000 7f634a05f700 1 -- 172.21.15.81:0/1084476756 shutdown_connections 2023-10-25T23:36:15.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.420+0000 7f634a05f700 1 -- 172.21.15.81:0/1084476756 wait complete. 2023-10-25T23:36:15.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.422+0000 7f634a05f700 1 Processor -- start 2023-10-25T23:36:15.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.422+0000 7f634a05f700 1 -- start start 2023-10-25T23:36:15.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.423+0000 7f634a05f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632c005330 0x7f63440b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.423+0000 7f634a05f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63441da1a0 0x7f63441e8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.423+0000 7f634a05f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63441e91a0 0x7f63440b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.423+0000 7f634a05f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63440a1050 con 0x7f63441da1a0 2023-10-25T23:36:15.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.423+0000 7f634a05f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63440b6040 con 0x7f632c005330 2023-10-25T23:36:15.426 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.423+0000 7f634a05f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63441e9620 con 0x7f63441e91a0 2023-10-25T23:36:15.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.424+0000 7f63437fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632c005330 0x7f63440b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.424+0000 7f6343fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63441e91a0 0x7f63440b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.424+0000 7f6343fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63441e91a0 0x7f63440b2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:59238/0 (socket says 172.21.15.81:59238) 2023-10-25T23:36:15.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.424+0000 7f6343fff700 1 -- 172.21.15.81:0/2355301023 learned_addr learned my addr 172.21.15.81:0/2355301023 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:15.427 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.424+0000 7f6343fff700 1 -- 172.21.15.81:0/2355301023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632c005330 msgr2=0x7f63440b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.428 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.424+0000 7f6343fff700 1 --2- 172.21.15.81:0/2355301023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f632c005330 0x7f63440b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.424+0000 7f6343fff700 1 -- 172.21.15.81:0/2355301023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63441da1a0 msgr2=0x7f63441e8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.424+0000 7f6343fff700 1 --2- 172.21.15.81:0/2355301023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63441da1a0 0x7f63441e8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.429 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.424+0000 7f6343fff700 1 -- 172.21.15.81:0/2355301023 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63440a0720 con 0x7f63441e91a0 2023-10-25T23:36:15.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.424+0000 7f6772487700 1 -- 172.21.15.81:0/78590292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f676c0a4290 msgr2=0x7f676c0bbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.424+0000 7f6772487700 1 --2- 172.21.15.81:0/78590292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f676c0a4290 0x7f676c0bbc40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f67540098c0 tx=0x7f6754009bd0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.425+0000 7f6772487700 1 -- 172.21.15.81:0/78590292 shutdown_connections 2023-10-25T23:36:15.430 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.425+0000 7f6772487700 1 --2- 172.21.15.81:0/78590292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f676c0a4290 0x7f676c0bbc40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.431 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.425+0000 7f6772487700 1 --2- 172.21.15.81:0/78590292 >> v2:172.21.15.81:3300/0 conn(0x7f676c06bb80 0x7f676c0ba970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.425+0000 7f6772487700 1 -- 172.21.15.81:0/78590292 >> 172.21.15.81:0/78590292 conn(0x7f676c0bf7c0 msgr2=0x7f676c0bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.425+0000 7f6343fff700 1 --2- 172.21.15.81:0/2355301023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63441e91a0 0x7f63440b2100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f633400c9a0 tx=0x7f633400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.425+0000 7f6772487700 1 -- 172.21.15.81:0/78590292 shutdown_connections 2023-10-25T23:36:15.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.425+0000 7f632bfff700 1 -- 172.21.15.81:0/2355301023 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6334001c80 con 0x7f63441e91a0 2023-10-25T23:36:15.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.425+0000 7f632bfff700 1 -- 172.21.15.81:0/2355301023 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6334020070 con 0x7f63441e91a0 2023-10-25T23:36:15.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.425+0000 7f632bfff700 1 -- 172.21.15.81:0/2355301023 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6334003a10 con 0x7f63441e91a0 2023-10-25T23:36:15.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.425+0000 7f634a05f700 1 -- 172.21.15.81:0/2355301023 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63440a0a00 con 0x7f63441e91a0 2023-10-25T23:36:15.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.425+0000 7f634a05f700 1 -- 172.21.15.81:0/2355301023 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63440b07f0 con 0x7f63441e91a0 2023-10-25T23:36:15.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.426+0000 7f634a05f700 1 -- 172.21.15.81:0/2355301023 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f63440bbff0 con 0x7f63441e91a0 2023-10-25T23:36:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.426+0000 7f139520c700 1 -- 172.21.15.81:0/3389525648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13900bb860 msgr2=0x7f13900ba970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.426+0000 7f139520c700 1 --2- 172.21.15.81:0/3389525648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13900bb860 0x7f13900ba970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1388009fd0 tx=0x7f138800b380 comp rx=0 tx=0).stop 2023-10-25T23:36:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.426+0000 7f139520c700 1 -- 172.21.15.81:0/3389525648 shutdown_connections 2023-10-25T23:36:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.426+0000 7f139520c700 1 --2- 172.21.15.81:0/3389525648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13900bb860 0x7f13900ba970 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1388009fd0 tx=0x7f138800b380 comp rx=0 tx=0).stop 2023-10-25T23:36:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.426+0000 7f139520c700 1 --2- 172.21.15.81:0/3389525648 >> v2:172.21.15.81:3300/0 conn(0x7f139006bb80 0x7f13900bbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.426+0000 7f139520c700 1 -- 172.21.15.81:0/3389525648 >> 172.21.15.81:0/3389525648 conn(0x7f13900bf7c0 msgr2=0x7f13900bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.426+0000 7f139520c700 1 -- 172.21.15.81:0/3389525648 shutdown_connections 2023-10-25T23:36:15.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.426+0000 7f139520c700 1 -- 172.21.15.81:0/3389525648 wait complete. 2023-10-25T23:36:15.436 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.425+0000 7f6772487700 1 -- 172.21.15.81:0/78590292 wait complete. 2023-10-25T23:36:15.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.427+0000 7f6772487700 1 Processor -- start 2023-10-25T23:36:15.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.427+0000 7fde5a048700 1 -- 172.21.15.81:0/609762671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde540a4290 msgr2=0x7fde5406cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.427+0000 7fde5a048700 1 --2- 172.21.15.81:0/609762671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde540a4290 0x7fde5406cfa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fde44005fd0 tx=0x7fde44009c70 comp rx=0 tx=0).stop 2023-10-25T23:36:15.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.427+0000 7fde5a048700 1 -- 172.21.15.81:0/609762671 shutdown_connections 2023-10-25T23:36:15.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.427+0000 7fde5a048700 1 --2- 172.21.15.81:0/609762671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde540a4290 0x7fde5406cfa0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.427+0000 7fde5a048700 1 --2- 172.21.15.81:0/609762671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde540bbad0 0x7fde540ba970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.427+0000 7fde5a048700 1 -- 172.21.15.81:0/609762671 >> 172.21.15.81:0/609762671 conn(0x7fde540bf7c0 msgr2=0x7fde540bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.427+0000 7f6772487700 1 -- start start 2023-10-25T23:36:15.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.428+0000 7fde5a048700 1 -- 172.21.15.81:0/609762671 shutdown_connections 2023-10-25T23:36:15.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.428+0000 7f139520c700 1 Processor -- start 2023-10-25T23:36:15.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.428+0000 7f6772487700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f676c06bb80 0x7f676c099e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.428+0000 7f6772487700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f676c0a4290 0x7f676c097a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.428+0000 7f6772487700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f676c0bb860 0x7f676c097f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.428+0000 7f6772487700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c09e8c0 con 0x7f676c06bb80 2023-10-25T23:36:15.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.428+0000 7f6772487700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c151530 con 0x7f676c0a4290 2023-10-25T23:36:15.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.428+0000 7f6772487700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676c09a380 con 0x7f676c0bb860 2023-10-25T23:36:15.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.428+0000 7f676b7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f676c0a4290 0x7f676c097a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.428+0000 7f676b7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f676c0a4290 0x7f676c097a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:56410/0 (socket says 172.21.15.81:56410) 2023-10-25T23:36:15.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.428+0000 7f676b7fe700 1 -- 172.21.15.81:0/3930499854 learned_addr learned my addr 172.21.15.81:0/3930499854 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:15.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.428+0000 7fde5a048700 1 -- 172.21.15.81:0/609762671 wait complete. 2023-10-25T23:36:15.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.428+0000 7f632bfff700 1 -- 172.21.15.81:0/2355301023 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6334003b70 con 0x7f63441e91a0 2023-10-25T23:36:15.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.429+0000 7f632bfff700 1 --2- 172.21.15.81:0/2355301023 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f633006afa0 0x7f633006d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.429+0000 7f632bfff700 1 -- 172.21.15.81:0/2355301023 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f633408b5a0 con 0x7f63441e91a0 2023-10-25T23:36:15.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.429+0000 7f632bfff700 1 --2- 172.21.15.81:0/2355301023 >> [v2:172.21.15.81:6824/1744054610,v1:172.21.15.81:6825/1744054610] conn(0x7f63300731c0 0x7f63300755e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.429+0000 7f632bfff700 1 -- 172.21.15.81:0/2355301023 --> [v2:172.21.15.81:6824/1744054610,v1:172.21.15.81:6825/1744054610] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6330075c90 con 0x7f63300731c0 2023-10-25T23:36:15.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.429+0000 7f632bfff700 1 -- 172.21.15.81:0/2355301023 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f633408b950 con 0x7f63441e91a0 2023-10-25T23:36:15.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7f63437fe700 1 --2- 172.21.15.81:0/2355301023 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f633006afa0 0x7f633006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7f6342ffd700 1 --2- 172.21.15.81:0/2355301023 >> [v2:172.21.15.81:6824/1744054610,v1:172.21.15.81:6825/1744054610] conn(0x7f63300731c0 0x7f63300755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.428+0000 7f139520c700 1 -- start start 2023-10-25T23:36:15.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.429+0000 7f139520c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139006bb80 0x7f13901ed2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.429+0000 7f139520c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13900a4290 0x7f13900bdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.429+0000 7f139520c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f139014f430 0x7f139014f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.429+0000 7f139520c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13901ed7e0 con 0x7f139006bb80 2023-10-25T23:36:15.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.429+0000 7f139520c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13900be280 con 0x7f139014f430 2023-10-25T23:36:15.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.429+0000 7f139520c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139014fe20 con 0x7f13900a4290 2023-10-25T23:36:15.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.429+0000 7f676b7fe700 1 -- 172.21.15.81:0/3930499854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f676c0bb860 msgr2=0x7f676c097f40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-25T23:36:15.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.429+0000 7f676b7fe700 1 --2- 172.21.15.81:0/3930499854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f676c0bb860 0x7f676c097f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.429+0000 7f676b7fe700 1 -- 172.21.15.81:0/3930499854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f676c06bb80 msgr2=0x7f676c099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.429+0000 7f676b7fe700 1 --2- 172.21.15.81:0/3930499854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f676c06bb80 0x7f676c099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.429+0000 7f676b7fe700 1 -- 172.21.15.81:0/3930499854 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6754009520 con 0x7f676c0a4290 2023-10-25T23:36:15.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.429+0000 7f676b7fe700 1 --2- 172.21.15.81:0/3930499854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f676c0a4290 0x7f676c097a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f675c00b580 tx=0x7f675c00b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.448 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7f138e59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13900a4290 0x7f13900bdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7f138e59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13900a4290 0x7f13900bdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:59268/0 (socket says 172.21.15.81:59268) 2023-10-25T23:36:15.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7f138e59c700 1 -- 172.21.15.81:0/72392193 learned_addr learned my addr 172.21.15.81:0/72392193 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:15.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7f138f59e700 1 --2- 172.21.15.81:0/72392193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f139014f430 0x7f139014f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.449 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7fde5a048700 1 Processor -- start 2023-10-25T23:36:15.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7fa8428d0700 1 -- 172.21.15.81:0/1079391172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa83c06d1c0 msgr2=0x7fa83c06d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7fa8428d0700 1 --2- 172.21.15.81:0/1079391172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa83c06d1c0 0x7fa83c06d5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00c040 tx=0x7fa82c009460 comp rx=0 tx=0).stop 2023-10-25T23:36:15.450 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7f6768ff9700 1 -- 172.21.15.81:0/3930499854 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c011830 con 0x7f676c0a4290 2023-10-25T23:36:15.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7f6768ff9700 1 -- 172.21.15.81:0/3930499854 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f675c011a80 con 0x7f676c0a4290 2023-10-25T23:36:15.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7f6768ff9700 1 -- 172.21.15.81:0/3930499854 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c011e90 con 0x7f676c0a4290 2023-10-25T23:36:15.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7f6772487700 1 -- 172.21.15.81:0/3930499854 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676c09df40 con 0x7f676c0a4290 2023-10-25T23:36:15.451 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7f6772487700 1 -- 172.21.15.81:0/3930499854 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676c09e200 con 0x7f676c0a4290 2023-10-25T23:36:15.452 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7fde5a048700 1 -- start start 2023-10-25T23:36:15.453 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7f6342ffd700 1 --2- 172.21.15.81:0/2355301023 >> [v2:172.21.15.81:6824/1744054610,v1:172.21.15.81:6825/1744054610] conn(0x7f63300731c0 0x7f63300755e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.431+0000 7f63437fe700 1 --2- 172.21.15.81:0/2355301023 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f633006afa0 0x7f633006d460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f63440c0790 tx=0x7f633c00c040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.454 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7f138ed9d700 1 --2- 172.21.15.81:0/72392193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139006bb80 0x7f13901ed2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7f138e59c700 1 -- 172.21.15.81:0/72392193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f139014f430 msgr2=0x7f139014f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7f138e59c700 1 --2- 172.21.15.81:0/72392193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f139014f430 0x7f139014f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7f138e59c700 1 -- 172.21.15.81:0/72392193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139006bb80 msgr2=0x7f13901ed2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.455 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7f138e59c700 1 --2- 172.21.15.81:0/72392193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139006bb80 0x7f13901ed2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.430+0000 7f138e59c700 1 -- 172.21.15.81:0/72392193 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1388009d00 con 0x7f13900a4290 2023-10-25T23:36:15.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.431+0000 7f138e59c700 1 --2- 172.21.15.81:0/72392193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13900a4290 0x7f13900bdd40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f138000b500 tx=0x7f138000b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.431+0000 7f13777fe700 1 -- 172.21.15.81:0/72392193 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1380011830 con 0x7f13900a4290 2023-10-25T23:36:15.456 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.431+0000 7f13777fe700 1 -- 172.21.15.81:0/72392193 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1380011a80 con 0x7f13900a4290 2023-10-25T23:36:15.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.431+0000 7f13777fe700 1 -- 172.21.15.81:0/72392193 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1380011e90 con 0x7f13900a4290 2023-10-25T23:36:15.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.431+0000 7f138ed9d700 1 --2- 172.21.15.81:0/72392193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f139006bb80 0x7f13901ed2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:36:15.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.431+0000 7f139520c700 1 -- 172.21.15.81:0/72392193 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139009b040 con 0x7f13900a4290 2023-10-25T23:36:15.457 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.431+0000 7f139520c700 1 -- 172.21.15.81:0/72392193 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139009b600 con 0x7f13900a4290 2023-10-25T23:36:15.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.431+0000 7fde5a048700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde5406bb80 0x7fde540b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.458 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.431+0000 7fde5a048700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde540a4290 0x7fde541e03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.431+0000 7fde5a048700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde540bbad0 0x7fde541e0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.431+0000 7fde5a048700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde541da280 con 0x7fde540a4290 2023-10-25T23:36:15.459 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.431+0000 7fde5a048700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde541e1d80 con 0x7fde5406bb80 2023-10-25T23:36:15.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.431+0000 7fde5a048700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde540715d0 con 0x7fde540bbad0 2023-10-25T23:36:15.460 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.432+0000 7f632bfff700 1 -- 172.21.15.81:0/2355301023 <== osd.2 v2:172.21.15.81:6824/1744054610 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f6330075c90 con 0x7f63300731c0 2023-10-25T23:36:15.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.431+0000 7fa8428d0700 1 -- 172.21.15.81:0/1079391172 shutdown_connections 2023-10-25T23:36:15.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.431+0000 7fa8428d0700 1 --2- 172.21.15.81:0/1079391172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa83c0bbe40 0x7fa83c088790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.461 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.431+0000 7fa8428d0700 1 --2- 172.21.15.81:0/1079391172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa83c06d1c0 0x7fa83c06d5a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.431+0000 7fa8428d0700 1 -- 172.21.15.81:0/1079391172 >> 172.21.15.81:0/1079391172 conn(0x7fa83c0bf7c0 msgr2=0x7fa83c0bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.432+0000 7fde537fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde5406bb80 0x7fde540b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.432+0000 7fde53fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde540bbad0 0x7fde541e0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.462 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.432+0000 7fde537fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde5406bb80 0x7fde540b8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:56432/0 (socket says 172.21.15.81:56432) 2023-10-25T23:36:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.432+0000 7fde537fe700 1 -- 172.21.15.81:0/1466755271 learned_addr learned my addr 172.21.15.81:0/1466755271 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.432+0000 7f2009062700 1 -- 172.21.15.81:0/3285985719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20040bbad0 msgr2=0x7f20040ba970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.463 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.432+0000 7f2009062700 1 --2- 172.21.15.81:0/3285985719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20040bbad0 0x7f20040ba970 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1ff80098c0 tx=0x7f1ff8009bd0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.432+0000 7f9f702ba700 1 -- 172.21.15.81:0/3483775853 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f68144780 msgr2=0x7f9f68070050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.432+0000 7f9f702ba700 1 --2- 172.21.15.81:0/3483775853 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f68144780 0x7f9f68070050 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9f64005fd0 tx=0x7f9f6400af90 comp rx=0 tx=0).stop 2023-10-25T23:36:15.464 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.432+0000 7f6768ff9700 1 -- 172.21.15.81:0/3930499854 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f675c01a400 con 0x7f676c0a4290 2023-10-25T23:36:15.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.432+0000 7f2009062700 1 -- 172.21.15.81:0/3285985719 shutdown_connections 2023-10-25T23:36:15.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.432+0000 7f2009062700 1 --2- 172.21.15.81:0/3285985719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20040bbad0 0x7f20040ba970 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.432+0000 7f2009062700 1 -- 172.21.15.81:0/3285985719 >> 172.21.15.81:0/3285985719 conn(0x7f20040bf7c0 msgr2=0x7f20040bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.432+0000 7fde53fff700 1 -- 172.21.15.81:0/1466755271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde5406bb80 msgr2=0x7fde540b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.432+0000 7fde53fff700 1 --2- 172.21.15.81:0/1466755271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde5406bb80 0x7fde540b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.432+0000 7fde53fff700 1 -- 172.21.15.81:0/1466755271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde540a4290 msgr2=0x7fde541e03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.432+0000 7fde53fff700 1 --2- 172.21.15.81:0/1466755271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde540a4290 0x7fde541e03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.432+0000 7fde53fff700 1 -- 172.21.15.81:0/1466755271 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde440095f0 con 0x7fde540bbad0 2023-10-25T23:36:15.467 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.433+0000 7f2009062700 1 -- 172.21.15.81:0/3285985719 shutdown_connections 2023-10-25T23:36:15.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.433+0000 7fa8428d0700 1 -- 172.21.15.81:0/1079391172 shutdown_connections 2023-10-25T23:36:15.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.433+0000 7f6768ff9700 1 --2- 172.21.15.81:0/3930499854 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f674c06afa0 0x7f674c06d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.433+0000 7f6768ff9700 1 -- 172.21.15.81:0/3930499854 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f675c089730 con 0x7f676c0a4290 2023-10-25T23:36:15.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.433+0000 7fde53fff700 1 --2- 172.21.15.81:0/1466755271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde540bbad0 0x7fde541e0910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fde44015000 tx=0x7fde44004260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.433+0000 7fde3bfff700 1 -- 172.21.15.81:0/1466755271 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4401d070 con 0x7fde540bbad0 2023-10-25T23:36:15.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.433+0000 7fde3bfff700 1 -- 172.21.15.81:0/1466755271 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fde44003e50 con 0x7fde540bbad0 2023-10-25T23:36:15.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.433+0000 7fde3bfff700 1 -- 172.21.15.81:0/1466755271 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde440045f0 con 0x7fde540bbad0 2023-10-25T23:36:15.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.433+0000 7f13777fe700 1 -- 172.21.15.81:0/72392193 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f138001a400 con 0x7f13900a4290 2023-10-25T23:36:15.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.433+0000 7f6772487700 1 --2- 172.21.15.81:0/3930499854 >> [v2:172.21.15.89:6816/1232781703,v1:172.21.15.89:6817/1232781703] conn(0x7f67500015e0 0x7f6750003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.433+0000 7f6772487700 1 -- 172.21.15.81:0/3930499854 --> [v2:172.21.15.89:6816/1232781703,v1:172.21.15.89:6817/1232781703] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6750006bd0 con 0x7f67500015e0 2023-10-25T23:36:15.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.433+0000 7f676bfff700 1 --2- 172.21.15.81:0/3930499854 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f674c06afa0 0x7f674c06d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.433+0000 7f6770a24700 1 --2- 172.21.15.81:0/3930499854 >> [v2:172.21.15.89:6816/1232781703,v1:172.21.15.89:6817/1232781703] conn(0x7f67500015e0 0x7f6750003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.471 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.434+0000 7f676bfff700 1 --2- 172.21.15.81:0/3930499854 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f674c06afa0 0x7f674c06d460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f67640012e0 tx=0x7f6764001630 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.434+0000 7f13777fe700 1 --2- 172.21.15.81:0/72392193 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f137c06afa0 0x7f137c06d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.472 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.434+0000 7f13777fe700 1 -- 172.21.15.81:0/72392193 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1380089630 con 0x7f13900a4290 2023-10-25T23:36:15.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.433+0000 7fde5a048700 1 -- 172.21.15.81:0/1466755271 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde54071870 con 0x7fde540bbad0 2023-10-25T23:36:15.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.433+0000 7fde5a048700 1 -- 172.21.15.81:0/1466755271 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde541f1f60 con 0x7fde540bbad0 2023-10-25T23:36:15.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.434+0000 7f6770a24700 1 --2- 172.21.15.81:0/3930499854 >> [v2:172.21.15.89:6816/1232781703,v1:172.21.15.89:6817/1232781703] conn(0x7f67500015e0 0x7f6750003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.433+0000 7fa8428d0700 1 -- 172.21.15.81:0/1079391172 wait complete. 2023-10-25T23:36:15.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.434+0000 7fa8428d0700 1 Processor -- start 2023-10-25T23:36:15.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.434+0000 7fa8428d0700 1 -- start start 2023-10-25T23:36:15.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.434+0000 7f138ed9d700 1 --2- 172.21.15.81:0/72392193 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f137c06afa0 0x7f137c06d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.433+0000 7f2009062700 1 -- 172.21.15.81:0/3285985719 wait complete. 2023-10-25T23:36:15.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.435+0000 7f2009062700 1 Processor -- start 2023-10-25T23:36:15.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.435+0000 7f9f702ba700 1 -- 172.21.15.81:0/3483775853 shutdown_connections 2023-10-25T23:36:15.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.435+0000 7f9f702ba700 1 --2- 172.21.15.81:0/3483775853 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f68144780 0x7f9f68070050 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.435+0000 7f9f702ba700 1 --2- 172.21.15.81:0/3483775853 >> v2:172.21.15.81:3300/0 conn(0x7f9f680bae20 0x7f9f6814ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.435+0000 7f9f702ba700 1 -- 172.21.15.81:0/3483775853 >> 172.21.15.81:0/3483775853 conn(0x7f9f6806ab40 msgr2=0x7f9f680bc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.435+0000 7f2009062700 1 -- start start 2023-10-25T23:36:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.435+0000 7f139520c700 1 --2- 172.21.15.81:0/72392193 >> [v2:172.21.15.81:6816/1391123341,v1:172.21.15.81:6817/1391123341] conn(0x7f13700015e0 0x7f1370003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.435+0000 7f139520c700 1 -- 172.21.15.81:0/72392193 --> [v2:172.21.15.81:6816/1391123341,v1:172.21.15.81:6817/1391123341] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1370006bd0 con 0x7f13700015e0 2023-10-25T23:36:15.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.435+0000 7f138ed9d700 1 --2- 172.21.15.81:0/72392193 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f137c06afa0 0x7f137c06d460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f139006bac0 tx=0x7f1388004b40 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.478 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.435+0000 7f6768ff9700 1 -- 172.21.15.81:0/3930499854 <== osd.4 v2:172.21.15.89:6816/1232781703 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f6750006bd0 con 0x7f67500015e0 2023-10-25T23:36:15.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.435+0000 7f138f59e700 1 --2- 172.21.15.81:0/72392193 >> [v2:172.21.15.81:6816/1391123341,v1:172.21.15.81:6817/1391123341] conn(0x7f13700015e0 0x7f1370003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7fa8428d0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa83c06d1c0 0x7fa83c1f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7fa8428d0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83c0bb9b0 0x7fa83c0b8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7fa8428d0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa83c0bbe40 0x7fa83c0b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7fa8428d0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0b60e0 con 0x7fa83c0bb9b0 2023-10-25T23:36:15.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7fa8428d0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0b3ad0 con 0x7fa83c06d1c0 2023-10-25T23:36:15.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7fa8428d0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c1f53c0 con 0x7fa83c0bbe40 2023-10-25T23:36:15.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7fde5a048700 1 -- 172.21.15.81:0/1466755271 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fde34000fc0 con 0x7fde540bbad0 2023-10-25T23:36:15.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7f138f59e700 1 --2- 172.21.15.81:0/72392193 >> [v2:172.21.15.81:6816/1391123341,v1:172.21.15.81:6817/1391123341] conn(0x7f13700015e0 0x7f1370003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7fa83bfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa83c06d1c0 0x7fa83c1f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7fa83bfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa83c06d1c0 0x7fa83c1f4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:56442/0 (socket says 172.21.15.81:56442) 2023-10-25T23:36:15.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7fa83bfff700 1 -- 172.21.15.81:0/1058895471 learned_addr learned my addr 172.21.15.81:0/1058895471 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:15.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7fa8337fe700 1 --2- 172.21.15.81:0/1058895471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83c0bb9b0 0x7fa83c0b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7fa840e6d700 1 --2- 172.21.15.81:0/1058895471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa83c0bbe40 0x7fa83c0b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7f9f702ba700 1 -- 172.21.15.81:0/3483775853 shutdown_connections 2023-10-25T23:36:15.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7fde3bfff700 1 -- 172.21.15.81:0/1466755271 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fde4400b820 con 0x7fde540bbad0 2023-10-25T23:36:15.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7f2009062700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f200406bb80 0x7f200406cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7f2002d9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f200406bb80 0x7f200406cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7f2002d9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f200406bb80 0x7f200406cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:56448/0 (socket says 172.21.15.81:56448) 2023-10-25T23:36:15.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7f2009062700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20040a4290 0x7f200409cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7f2009062700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20040bbad0 0x7f20040995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7f200259c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20040a4290 0x7f200409cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7f2009062700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200406e310 con 0x7f20040bbad0 2023-10-25T23:36:15.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7f2009062700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20041592b0 con 0x7f200406bb80 2023-10-25T23:36:15.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7f2009062700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2004158fd0 con 0x7f20040a4290 2023-10-25T23:36:15.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7f200259c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20040a4290 0x7f200409cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:59294/0 (socket says 172.21.15.81:59294) 2023-10-25T23:36:15.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7f200259c700 1 -- 172.21.15.81:0/1431205414 learned_addr learned my addr 172.21.15.81:0/1431205414 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:15.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7f13777fe700 1 -- 172.21.15.81:0/72392193 <== osd.3 v2:172.21.15.81:6816/1391123341 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f1370006bd0 con 0x7f13700015e0 2023-10-25T23:36:15.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7f200259c700 1 -- 172.21.15.81:0/1431205414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f200406bb80 msgr2=0x7f200406cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7f200259c700 1 --2- 172.21.15.81:0/1431205414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f200406bb80 0x7f200406cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7f200259c700 1 -- 172.21.15.81:0/1431205414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20040bbad0 msgr2=0x7f20040995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7f200259c700 1 --2- 172.21.15.81:0/1431205414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20040bbad0 0x7f20040995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7f200259c700 1 -- 172.21.15.81:0/1431205414 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff8009520 con 0x7f20040a4290 2023-10-25T23:36:15.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7fde3bfff700 1 --2- 172.21.15.81:0/1466755271 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fde4006aed0 0x7fde4006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7fde3bfff700 1 -- 172.21.15.81:0/1466755271 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde4408a6b0 con 0x7fde540bbad0 2023-10-25T23:36:15.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7fde3bfff700 1 --2- 172.21.15.81:0/1466755271 >> [v2:172.21.15.81:6808/1045657984,v1:172.21.15.81:6809/1045657984] conn(0x7fde40073070 0x7fde40075490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7fde3bfff700 1 -- 172.21.15.81:0/1466755271 --> [v2:172.21.15.81:6808/1045657984,v1:172.21.15.81:6809/1045657984] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde40075b40 con 0x7fde40073070 2023-10-25T23:36:15.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7fde3bfff700 1 -- 172.21.15.81:0/1466755271 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde4408cc90 con 0x7fde540bbad0 2023-10-25T23:36:15.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7f2002d9d700 1 --2- 172.21.15.81:0/1431205414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f200406bb80 0x7f200406cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:36:15.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7fa840e6d700 1 -- 172.21.15.81:0/1058895471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa83c06d1c0 msgr2=0x7fa83c1f4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7fa840e6d700 1 --2- 172.21.15.81:0/1058895471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa83c06d1c0 0x7fa83c1f4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7fa840e6d700 1 -- 172.21.15.81:0/1058895471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83c0bb9b0 msgr2=0x7fa83c0b8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7fa840e6d700 1 --2- 172.21.15.81:0/1058895471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83c0bb9b0 0x7fa83c0b8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7fa840e6d700 1 -- 172.21.15.81:0/1058895471 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c00bc60 con 0x7fa83c0bbe40 2023-10-25T23:36:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7fa8337fe700 1 --2- 172.21.15.81:0/1058895471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa83c0bb9b0 0x7fa83c0b8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-25T23:36:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7fa840e6d700 1 --2- 172.21.15.81:0/1058895471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa83c0bbe40 0x7fa83c0b8b60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0bc290 tx=0x7fa834007a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7fa8397fa700 1 -- 172.21.15.81:0/1058895471 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83400f040 con 0x7fa83c0bbe40 2023-10-25T23:36:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7fa8397fa700 1 -- 172.21.15.81:0/1058895471 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa834004340 con 0x7fa83c0bbe40 2023-10-25T23:36:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7fa8397fa700 1 -- 172.21.15.81:0/1058895471 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8340136c0 con 0x7fa83c0bbe40 2023-10-25T23:36:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7fa8428d0700 1 -- 172.21.15.81:0/1058895471 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83c06e7a0 con 0x7fa83c0bbe40 2023-10-25T23:36:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.437+0000 7fa8428d0700 1 -- 172.21.15.81:0/1058895471 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83c0b3760 con 0x7fa83c0bbe40 2023-10-25T23:36:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.436+0000 7f9f702ba700 1 -- 172.21.15.81:0/3483775853 wait complete. 2023-10-25T23:36:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.438+0000 7fde537fe700 1 --2- 172.21.15.81:0/1466755271 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fde4006aed0 0x7fde4006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.438+0000 7f200259c700 1 --2- 172.21.15.81:0/1431205414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20040a4290 0x7f200409cf30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc002060 tx=0x7f1ffc00a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.438+0000 7fde52ffd700 1 --2- 172.21.15.81:0/1466755271 >> [v2:172.21.15.81:6808/1045657984,v1:172.21.15.81:6809/1045657984] conn(0x7fde40073070 0x7fde40075490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.438+0000 7f9f702ba700 1 Processor -- start 2023-10-25T23:36:15.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.438+0000 7f9f702ba700 1 -- start start 2023-10-25T23:36:15.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.438+0000 7fde52ffd700 1 --2- 172.21.15.81:0/1466755271 >> [v2:172.21.15.81:6808/1045657984,v1:172.21.15.81:6809/1045657984] conn(0x7fde40073070 0x7fde40075490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.438+0000 7fde537fe700 1 --2- 172.21.15.81:0/1466755271 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fde4006aed0 0x7fde4006d390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fde48009c80 tx=0x7fde48009260 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.439+0000 7f9f702ba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f680b55d0 0x7f9f6806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.439+0000 7f9f702ba700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f680bae20 0x7f9f681d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.439+0000 7f9f702ba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f68144780 0x7f9f681e0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.439+0000 7f9f702ba700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f681e43f0 con 0x7f9f68144780 2023-10-25T23:36:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.439+0000 7f9f702ba700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6806dd60 con 0x7f9f680bae20 2023-10-25T23:36:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.439+0000 7f9f702ba700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6813e1b0 con 0x7f9f680b55d0 2023-10-25T23:36:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.439+0000 7f9f6d855700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f680bae20 0x7f9f681d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.439+0000 7f9f6d855700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f680bae20 0x7f9f681d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:56460/0 (socket says 172.21.15.81:56460) 2023-10-25T23:36:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.439+0000 7f9f6d855700 1 -- 172.21.15.81:0/1652338172 learned_addr learned my addr 172.21.15.81:0/1652338172 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.439+0000 7f9f6e056700 1 --2- 172.21.15.81:0/1652338172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f680b55d0 0x7f9f6806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.440+0000 7f9f6e857700 1 --2- 172.21.15.81:0/1652338172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f68144780 0x7f9f681e0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.440+0000 7fde3bfff700 1 -- 172.21.15.81:0/1466755271 <== osd.0 v2:172.21.15.81:6808/1045657984 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fde40075b40 con 0x7fde40073070 2023-10-25T23:36:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.440+0000 7f9f6e857700 1 -- 172.21.15.81:0/1652338172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f680b55d0 msgr2=0x7f9f6806d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.440+0000 7f9f6e857700 1 --2- 172.21.15.81:0/1652338172 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f680b55d0 0x7f9f6806d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.440+0000 7f9f6e857700 1 -- 172.21.15.81:0/1652338172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f680bae20 msgr2=0x7f9f681d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.440+0000 7f9f6e857700 1 --2- 172.21.15.81:0/1652338172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f680bae20 0x7f9f681d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.440+0000 7f9f6e857700 1 -- 172.21.15.81:0/1652338172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f640071c0 con 0x7f9f68144780 2023-10-25T23:36:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.439+0000 7fa8397fa700 1 -- 172.21.15.81:0/1058895471 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa834013820 con 0x7fa83c0bbe40 2023-10-25T23:36:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.440+0000 7fa8397fa700 1 --2- 172.21.15.81:0/1058895471 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa81c06af20 0x7fa81c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.440+0000 7fa8397fa700 1 -- 172.21.15.81:0/1058895471 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8340897f0 con 0x7fa83c0bbe40 2023-10-25T23:36:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.440+0000 7fa83bfff700 1 --2- 172.21.15.81:0/1058895471 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa81c06af20 0x7fa81c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.440+0000 7f9f6e857700 1 --2- 172.21.15.81:0/1652338172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f68144780 0x7f9f681e0710 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9f6001db50 tx=0x7f9f6001df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.441+0000 7fa83bfff700 1 --2- 172.21.15.81:0/1058895471 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa81c06af20 0x7fa81c06d3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00bc00 tx=0x7fa82c004b40 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.440+0000 7f9f5effd700 1 -- 172.21.15.81:0/1652338172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f60003a00 con 0x7f9f68144780 2023-10-25T23:36:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.440+0000 7f9f5effd700 1 -- 172.21.15.81:0/1652338172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9f60003b60 con 0x7f9f68144780 2023-10-25T23:36:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.440+0000 7f9f5effd700 1 -- 172.21.15.81:0/1652338172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6001b8c0 con 0x7f9f68144780 2023-10-25T23:36:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.441+0000 7f9f702ba700 1 -- 172.21.15.81:0/1652338172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f681e6870 con 0x7f9f68144780 2023-10-25T23:36:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.441+0000 7f9f702ba700 1 -- 172.21.15.81:0/1652338172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6806dfb0 con 0x7f9f68144780 2023-10-25T23:36:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.443+0000 7f9f702ba700 1 -- 172.21.15.81:0/1652338172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f50000fc0 con 0x7f9f68144780 2023-10-25T23:36:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.444+0000 7f9f5effd700 1 -- 172.21.15.81:0/1652338172 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9f6001ba20 con 0x7f9f68144780 2023-10-25T23:36:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.438+0000 7f1feb7fe700 1 -- 172.21.15.81:0/1431205414 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc00ada0 con 0x7f20040a4290 2023-10-25T23:36:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.438+0000 7f1feb7fe700 1 -- 172.21.15.81:0/1431205414 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1ffc012420 con 0x7f20040a4290 2023-10-25T23:36:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.438+0000 7f1feb7fe700 1 -- 172.21.15.81:0/1431205414 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc012810 con 0x7f20040a4290 2023-10-25T23:36:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.438+0000 7f2009062700 1 -- 172.21.15.81:0/1431205414 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2004098af0 con 0x7f20040a4290 2023-10-25T23:36:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.439+0000 7f2009062700 1 -- 172.21.15.81:0/1431205414 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20040990b0 con 0x7f20040a4290 2023-10-25T23:36:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.441+0000 7f1feb7fe700 1 -- 172.21.15.81:0/1431205414 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1ffc01b410 con 0x7f20040a4290 2023-10-25T23:36:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.442+0000 7f1feb7fe700 1 --2- 172.21.15.81:0/1431205414 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f1ff006af20 0x7f1ff006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.442+0000 7f1feb7fe700 1 -- 172.21.15.81:0/1431205414 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ffc089a00 con 0x7f20040a4290 2023-10-25T23:36:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.442+0000 7f2002d9d700 1 --2- 172.21.15.81:0/1431205414 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f1ff006af20 0x7f1ff006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.445+0000 7f9f5effd700 1 --2- 172.21.15.81:0/1652338172 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9f4c06af20 0x7f9f4c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.445+0000 7f2009062700 1 --2- 172.21.15.81:0/1431205414 >> [v2:172.21.15.89:6808/2561967165,v1:172.21.15.89:6809/2561967165] conn(0x7f1fe40015e0 0x7f1fe4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.445+0000 7f2009062700 1 -- 172.21.15.81:0/1431205414 --> [v2:172.21.15.89:6808/2561967165,v1:172.21.15.89:6809/2561967165] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1fe4006bd0 con 0x7f1fe40015e0 2023-10-25T23:36:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.445+0000 7f9f5effd700 1 -- 172.21.15.81:0/1652338172 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f6009aaf0 con 0x7f9f68144780 2023-10-25T23:36:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.445+0000 7f9f5effd700 1 --2- 172.21.15.81:0/1652338172 >> [v2:172.21.15.89:6824/2647243500,v1:172.21.15.89:6825/2647243500] conn(0x7f9f4c073140 0x7f9f4c075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.445+0000 7f9f5effd700 1 -- 172.21.15.81:0/1652338172 --> [v2:172.21.15.89:6824/2647243500,v1:172.21.15.89:6825/2647243500] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f4c075c10 con 0x7f9f4c073140 2023-10-25T23:36:15.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.445+0000 7f9f5effd700 1 -- 172.21.15.81:0/1652338172 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f6009af90 con 0x7f9f68144780 2023-10-25T23:36:15.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.445+0000 7f200359e700 1 --2- 172.21.15.81:0/1431205414 >> [v2:172.21.15.89:6808/2561967165,v1:172.21.15.89:6809/2561967165] conn(0x7f1fe40015e0 0x7f1fe4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.446+0000 7f9f6d855700 1 --2- 172.21.15.81:0/1652338172 >> [v2:172.21.15.89:6824/2647243500,v1:172.21.15.89:6825/2647243500] conn(0x7f9f4c073140 0x7f9f4c075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.446+0000 7f9f6e056700 1 --2- 172.21.15.81:0/1652338172 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9f4c06af20 0x7f9f4c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.446+0000 7f9f6d855700 1 --2- 172.21.15.81:0/1652338172 >> [v2:172.21.15.89:6824/2647243500,v1:172.21.15.89:6825/2647243500] conn(0x7f9f4c073140 0x7f9f4c075560 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.446+0000 7f200359e700 1 --2- 172.21.15.81:0/1431205414 >> [v2:172.21.15.89:6808/2561967165,v1:172.21.15.89:6809/2561967165] conn(0x7f1fe40015e0 0x7f1fe4003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.446+0000 7f9f6e056700 1 --2- 172.21.15.81:0/1652338172 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9f4c06af20 0x7f9f4c06d3e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9f640074b0 tx=0x7f9f640047c0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.513 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.447+0000 7fa8428d0700 1 --2- 172.21.15.81:0/1058895471 >> [v2:172.21.15.81:6800/725386907,v1:172.21.15.81:6801/725386907] conn(0x7fa83c097f30 0x7fa83c086060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.447+0000 7fa8428d0700 1 -- 172.21.15.81:0/1058895471 --> [v2:172.21.15.81:6800/725386907,v1:172.21.15.81:6801/725386907] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa83c0b3c80 con 0x7fa83c097f30 2023-10-25T23:36:15.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.447+0000 7f2002d9d700 1 --2- 172.21.15.81:0/1431205414 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f1ff006af20 0x7f1ff006d3e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8009230 tx=0x7f1ff8011040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.514 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.447+0000 7f1feb7fe700 1 -- 172.21.15.81:0/1431205414 <== osd.6 v2:172.21.15.89:6808/2561967165 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f1fe4006bd0 con 0x7f1fe40015e0 2023-10-25T23:36:15.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.447+0000 7fa8337fe700 1 --2- 172.21.15.81:0/1058895471 >> [v2:172.21.15.81:6800/725386907,v1:172.21.15.81:6801/725386907] conn(0x7fa83c097f30 0x7fa83c086060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.447+0000 7fa8337fe700 1 --2- 172.21.15.81:0/1058895471 >> [v2:172.21.15.81:6800/725386907,v1:172.21.15.81:6801/725386907] conn(0x7fa83c097f30 0x7fa83c086060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.515 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.448+0000 7fa8397fa700 1 -- 172.21.15.81:0/1058895471 <== osd.1 v2:172.21.15.81:6800/725386907 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fa83c0b3c80 con 0x7fa83c097f30 2023-10-25T23:36:15.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.451+0000 7f9f5effd700 1 -- 172.21.15.81:0/1652338172 <== osd.7 v2:172.21.15.89:6824/2647243500 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f9f4c075c10 con 0x7f9f4c073140 2023-10-25T23:36:15.516 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.458+0000 7f139520c700 1 -- 172.21.15.81:0/72392193 --> [v2:172.21.15.81:6816/1391123341,v1:172.21.15.81:6817/1391123341] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1370005cb0 con 0x7f13700015e0 2023-10-25T23:36:15.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.459+0000 7f13777fe700 1 -- 172.21.15.81:0/72392193 <== osd.3 v2:172.21.15.81:6816/1391123341 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1370005cb0 con 0x7f13700015e0 2023-10-25T23:36:15.517 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.460+0000 7fde5a048700 1 -- 172.21.15.81:0/1466755271 --> [v2:172.21.15.81:6808/1045657984,v1:172.21.15.81:6809/1045657984] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fde34002d40 con 0x7fde40073070 2023-10-25T23:36:15.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.464+0000 7f139520c700 1 -- 172.21.15.81:0/72392193 >> [v2:172.21.15.81:6816/1391123341,v1:172.21.15.81:6817/1391123341] conn(0x7f13700015e0 msgr2=0x7f1370003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.464+0000 7f139520c700 1 --2- 172.21.15.81:0/72392193 >> [v2:172.21.15.81:6816/1391123341,v1:172.21.15.81:6817/1391123341] conn(0x7f13700015e0 0x7f1370003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.464+0000 7f139520c700 1 -- 172.21.15.81:0/72392193 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f137c06afa0 msgr2=0x7f137c06d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.464+0000 7f139520c700 1 --2- 172.21.15.81:0/72392193 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f137c06afa0 0x7f137c06d460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f139006bac0 tx=0x7f1388004b40 comp rx=0 tx=0).stop 2023-10-25T23:36:15.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.464+0000 7f139520c700 1 -- 172.21.15.81:0/72392193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13900a4290 msgr2=0x7f13900bdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.464+0000 7f139520c700 1 --2- 172.21.15.81:0/72392193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f13900a4290 0x7f13900bdd40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f138000b500 tx=0x7f138000b810 comp rx=0 tx=0).stop 2023-10-25T23:36:15.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.464+0000 7f138f59e700 1 -- 172.21.15.81:0/72392193 reap_dead start 2023-10-25T23:36:15.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.464+0000 7f139520c700 1 -- 172.21.15.81:0/72392193 shutdown_connections 2023-10-25T23:36:15.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.464+0000 7f139520c700 1 -- 172.21.15.81:0/72392193 >> 172.21.15.81:0/72392193 conn(0x7f13900bf7c0 msgr2=0x7f139006d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.464+0000 7f139520c700 1 -- 172.21.15.81:0/72392193 shutdown_connections 2023-10-25T23:36:15.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.464+0000 7f139520c700 1 -- 172.21.15.81:0/72392193 wait complete. 2023-10-25T23:36:15.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.466+0000 7f634a05f700 1 -- 172.21.15.81:0/2355301023 --> [v2:172.21.15.81:6824/1744054610,v1:172.21.15.81:6825/1744054610] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f63441e8a80 con 0x7f63300731c0 2023-10-25T23:36:15.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.468+0000 7f632bfff700 1 -- 172.21.15.81:0/2355301023 <== osd.2 v2:172.21.15.81:6824/1744054610 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f63441e8a80 con 0x7f63300731c0 2023-10-25T23:36:15.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.470+0000 7fde3bfff700 1 -- 172.21.15.81:0/1466755271 <== osd.0 v2:172.21.15.81:6808/1045657984 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fde34002d40 con 0x7fde40073070 2023-10-25T23:36:15.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.470+0000 7f634a05f700 1 -- 172.21.15.81:0/2355301023 >> [v2:172.21.15.81:6824/1744054610,v1:172.21.15.81:6825/1744054610] conn(0x7f63300731c0 msgr2=0x7f63300755e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.470+0000 7f634a05f700 1 --2- 172.21.15.81:0/2355301023 >> [v2:172.21.15.81:6824/1744054610,v1:172.21.15.81:6825/1744054610] conn(0x7f63300731c0 0x7f63300755e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.470+0000 7f6772487700 1 -- 172.21.15.81:0/3930499854 --> [v2:172.21.15.89:6816/1232781703,v1:172.21.15.89:6817/1232781703] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6750005c50 con 0x7f67500015e0 2023-10-25T23:36:15.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.470+0000 7f634a05f700 1 -- 172.21.15.81:0/2355301023 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f633006afa0 msgr2=0x7f633006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.470+0000 7f634a05f700 1 --2- 172.21.15.81:0/2355301023 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f633006afa0 0x7f633006d460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f63440c0790 tx=0x7f633c00c040 comp rx=0 tx=0).stop 2023-10-25T23:36:15.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.470+0000 7f634a05f700 1 -- 172.21.15.81:0/2355301023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63441e91a0 msgr2=0x7f63440b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.470+0000 7f634a05f700 1 --2- 172.21.15.81:0/2355301023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63441e91a0 0x7f63440b2100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f633400c9a0 tx=0x7f633400cf60 comp rx=0 tx=0).stop 2023-10-25T23:36:15.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.470+0000 7f6343fff700 1 -- 172.21.15.81:0/2355301023 reap_dead start 2023-10-25T23:36:15.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.471+0000 7f6768ff9700 1 -- 172.21.15.81:0/3930499854 <== osd.4 v2:172.21.15.89:6816/1232781703 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6750005c50 con 0x7f67500015e0 2023-10-25T23:36:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.471+0000 7fde5a048700 1 -- 172.21.15.81:0/1466755271 >> [v2:172.21.15.81:6808/1045657984,v1:172.21.15.81:6809/1045657984] conn(0x7fde40073070 msgr2=0x7fde40075490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.471+0000 7fde5a048700 1 --2- 172.21.15.81:0/1466755271 >> [v2:172.21.15.81:6808/1045657984,v1:172.21.15.81:6809/1045657984] conn(0x7fde40073070 0x7fde40075490 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.471+0000 7fde5a048700 1 -- 172.21.15.81:0/1466755271 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fde4006aed0 msgr2=0x7fde4006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.471+0000 7fde5a048700 1 --2- 172.21.15.81:0/1466755271 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fde4006aed0 0x7fde4006d390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fde48009c80 tx=0x7fde48009260 comp rx=0 tx=0).stop 2023-10-25T23:36:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.471+0000 7fde5a048700 1 -- 172.21.15.81:0/1466755271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde540bbad0 msgr2=0x7fde541e0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.471+0000 7fde5a048700 1 --2- 172.21.15.81:0/1466755271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde540bbad0 0x7fde541e0910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fde44015000 tx=0x7fde44004260 comp rx=0 tx=0).stop 2023-10-25T23:36:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.471+0000 7fde53fff700 1 -- 172.21.15.81:0/1466755271 reap_dead start 2023-10-25T23:36:15.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.471+0000 7fde5a048700 1 -- 172.21.15.81:0/1466755271 shutdown_connections 2023-10-25T23:36:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.471+0000 7fde5a048700 1 -- 172.21.15.81:0/1466755271 >> 172.21.15.81:0/1466755271 conn(0x7fde540bf7c0 msgr2=0x7fde5406aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.471+0000 7f634a05f700 1 -- 172.21.15.81:0/2355301023 shutdown_connections 2023-10-25T23:36:15.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.471+0000 7f634a05f700 1 -- 172.21.15.81:0/2355301023 >> 172.21.15.81:0/2355301023 conn(0x7f63440bf7c0 msgr2=0x7f6344071590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.471+0000 7f6772487700 1 -- 172.21.15.81:0/3930499854 >> [v2:172.21.15.89:6816/1232781703,v1:172.21.15.89:6817/1232781703] conn(0x7f67500015e0 msgr2=0x7f6750003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.471+0000 7f6772487700 1 --2- 172.21.15.81:0/3930499854 >> [v2:172.21.15.89:6816/1232781703,v1:172.21.15.89:6817/1232781703] conn(0x7f67500015e0 0x7f6750003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f6772487700 1 -- 172.21.15.81:0/3930499854 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f674c06afa0 msgr2=0x7f674c06d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f6772487700 1 --2- 172.21.15.81:0/3930499854 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f674c06afa0 0x7f674c06d460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f67640012e0 tx=0x7f6764001630 comp rx=0 tx=0).stop 2023-10-25T23:36:15.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f6772487700 1 -- 172.21.15.81:0/3930499854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f676c0a4290 msgr2=0x7f676c097a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f6772487700 1 --2- 172.21.15.81:0/3930499854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f676c0a4290 0x7f676c097a00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f675c00b580 tx=0x7f675c00b940 comp rx=0 tx=0).stop 2023-10-25T23:36:15.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f6770a24700 1 -- 172.21.15.81:0/3930499854 reap_dead start 2023-10-25T23:36:15.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f6772487700 1 -- 172.21.15.81:0/3930499854 shutdown_connections 2023-10-25T23:36:15.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f6772487700 1 -- 172.21.15.81:0/3930499854 >> 172.21.15.81:0/3930499854 conn(0x7f676c0bf7c0 msgr2=0x7f676c06d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f634a05f700 1 -- 172.21.15.81:0/2355301023 shutdown_connections 2023-10-25T23:36:15.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f634a05f700 1 -- 172.21.15.81:0/2355301023 wait complete. 2023-10-25T23:36:15.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f6772487700 1 -- 172.21.15.81:0/3930499854 shutdown_connections 2023-10-25T23:36:15.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f507866b700 1 -- 172.21.15.81:0/1676031937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f507006bb80 msgr2=0x7f50700ba970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f507866b700 1 --2- 172.21.15.81:0/1676031937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f507006bb80 0x7f50700ba970 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f50600098c0 tx=0x7f5060009bd0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f6772487700 1 -- 172.21.15.81:0/3930499854 wait complete. 2023-10-25T23:36:15.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f507866b700 1 -- 172.21.15.81:0/1676031937 shutdown_connections 2023-10-25T23:36:15.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f507866b700 1 --2- 172.21.15.81:0/1676031937 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f50700a4290 0x7f50700bbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f507866b700 1 --2- 172.21.15.81:0/1676031937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f507006bb80 0x7f50700ba970 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f507866b700 1 -- 172.21.15.81:0/1676031937 >> 172.21.15.81:0/1676031937 conn(0x7f50700bf7c0 msgr2=0x7f50700bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f507866b700 1 -- 172.21.15.81:0/1676031937 shutdown_connections 2023-10-25T23:36:15.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.472+0000 7f507866b700 1 -- 172.21.15.81:0/1676031937 wait complete. 2023-10-25T23:36:15.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.473+0000 7fde5a048700 1 -- 172.21.15.81:0/1466755271 shutdown_connections 2023-10-25T23:36:15.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.473+0000 7fde5a048700 1 -- 172.21.15.81:0/1466755271 wait complete. 2023-10-25T23:36:15.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.474+0000 7f507866b700 1 Processor -- start 2023-10-25T23:36:15.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.474+0000 7f507866b700 1 -- start start 2023-10-25T23:36:15.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.475+0000 7f507866b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f507006bb80 0x7f50701ec960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.475+0000 7f507866b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50700a4290 0x7f507014efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.475+0000 7f507866b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50700bb860 0x7f50700bd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.475+0000 7f507866b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507009eee0 con 0x7f50700a4290 2023-10-25T23:36:15.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.475+0000 7f507866b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700986a0 con 0x7f50700bb860 2023-10-25T23:36:15.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.475+0000 7f507866b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5070097e40 con 0x7f507006bb80 2023-10-25T23:36:15.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.475+0000 7f5075c06700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50700a4290 0x7f507014efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.475+0000 7f5075c06700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50700a4290 0x7f507014efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36410/0 (socket says 172.21.15.81:36410) 2023-10-25T23:36:15.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.475+0000 7f5075c06700 1 -- 172.21.15.81:0/547264710 learned_addr learned my addr 172.21.15.81:0/547264710 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:15.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.475+0000 7f5076c08700 1 --2- 172.21.15.81:0/547264710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50700bb860 0x7f50700bd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.476+0000 7f5075c06700 1 -- 172.21.15.81:0/547264710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f507006bb80 msgr2=0x7f50701ec960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.476+0000 7f5076407700 1 --2- 172.21.15.81:0/547264710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f507006bb80 0x7f50701ec960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.476+0000 7f5075c06700 1 --2- 172.21.15.81:0/547264710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f507006bb80 0x7f50701ec960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.476+0000 7f5075c06700 1 -- 172.21.15.81:0/547264710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50700bb860 msgr2=0x7f50700bd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.476+0000 7f5075c06700 1 --2- 172.21.15.81:0/547264710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50700bb860 0x7f50700bd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.476+0000 7f5075c06700 1 -- 172.21.15.81:0/547264710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5060009520 con 0x7f50700a4290 2023-10-25T23:36:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.476+0000 7f5076407700 1 --2- 172.21.15.81:0/547264710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f507006bb80 0x7f50701ec960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:36:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.476+0000 7f5076c08700 1 --2- 172.21.15.81:0/547264710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50700bb860 0x7f50700bd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-25T23:36:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.476+0000 7f5075c06700 1 --2- 172.21.15.81:0/547264710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50700a4290 0x7f507014efe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5060004000 tx=0x7f5060004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.476+0000 7f5066ffd700 1 -- 172.21.15.81:0/547264710 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506001c070 con 0x7f50700a4290 2023-10-25T23:36:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.476+0000 7f5066ffd700 1 -- 172.21.15.81:0/547264710 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f506000b770 con 0x7f50700a4290 2023-10-25T23:36:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.476+0000 7f5066ffd700 1 -- 172.21.15.81:0/547264710 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506000bb60 con 0x7f50700a4290 2023-10-25T23:36:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.476+0000 7f507866b700 1 -- 172.21.15.81:0/547264710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50700980e0 con 0x7f50700a4290 2023-10-25T23:36:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.476+0000 7f507866b700 1 -- 172.21.15.81:0/547264710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5070099130 con 0x7f50700a4290 2023-10-25T23:36:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.477+0000 7f507866b700 1 -- 172.21.15.81:0/547264710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f507004e4c0 con 0x7f50700a4290 2023-10-25T23:36:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.479+0000 7f5066ffd700 1 -- 172.21.15.81:0/547264710 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f506000bcc0 con 0x7f50700a4290 2023-10-25T23:36:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.479+0000 7f5066ffd700 1 --2- 172.21.15.81:0/547264710 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f505406aed0 0x7f505406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.479+0000 7f5066ffd700 1 -- 172.21.15.81:0/547264710 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f506008b1f0 con 0x7f50700a4290 2023-10-25T23:36:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.480+0000 7f5066ffd700 1 --2- 172.21.15.81:0/547264710 >> [v2:172.21.15.89:6800/2255820086,v1:172.21.15.89:6801/2255820086] conn(0x7f5054073070 0x7f5054075490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.480+0000 7f5066ffd700 1 -- 172.21.15.81:0/547264710 --> [v2:172.21.15.89:6800/2255820086,v1:172.21.15.89:6801/2255820086] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5054075b40 con 0x7f5054073070 2023-10-25T23:36:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.480+0000 7f5066ffd700 1 -- 172.21.15.81:0/547264710 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f506008b560 con 0x7f50700a4290 2023-10-25T23:36:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.480+0000 7f5076407700 1 --2- 172.21.15.81:0/547264710 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f505406aed0 0x7f505406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.480+0000 7f5076c08700 1 --2- 172.21.15.81:0/547264710 >> [v2:172.21.15.89:6800/2255820086,v1:172.21.15.89:6801/2255820086] conn(0x7f5054073070 0x7f5054075490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.480+0000 7f5076c08700 1 --2- 172.21.15.81:0/547264710 >> [v2:172.21.15.89:6800/2255820086,v1:172.21.15.89:6801/2255820086] conn(0x7f5054073070 0x7f5054075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.481+0000 7f5076407700 1 --2- 172.21.15.81:0/547264710 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f505406aed0 0x7f505406d390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5068001f00 tx=0x7f5068009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.481+0000 7f5066ffd700 1 -- 172.21.15.81:0/547264710 <== osd.5 v2:172.21.15.89:6800/2255820086 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f5054075b40 con 0x7f5054073070 2023-10-25T23:36:15.547 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-25T23:36:15.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-25T23:36:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.483+0000 7fa8428d0700 1 -- 172.21.15.81:0/1058895471 --> [v2:172.21.15.81:6800/725386907,v1:172.21.15.81:6801/725386907] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa83c0670a0 con 0x7fa83c097f30 2023-10-25T23:36:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.483+0000 7fa8397fa700 1 -- 172.21.15.81:0/1058895471 <== osd.1 v2:172.21.15.81:6800/725386907 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa83c0670a0 con 0x7fa83c097f30 2023-10-25T23:36:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.484+0000 7fa8428d0700 1 -- 172.21.15.81:0/1058895471 >> [v2:172.21.15.81:6800/725386907,v1:172.21.15.81:6801/725386907] conn(0x7fa83c097f30 msgr2=0x7fa83c086060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.484+0000 7fa8428d0700 1 --2- 172.21.15.81:0/1058895471 >> [v2:172.21.15.81:6800/725386907,v1:172.21.15.81:6801/725386907] conn(0x7fa83c097f30 0x7fa83c086060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.484+0000 7fa8428d0700 1 -- 172.21.15.81:0/1058895471 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa81c06af20 msgr2=0x7fa81c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.484+0000 7fa8428d0700 1 --2- 172.21.15.81:0/1058895471 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa81c06af20 0x7fa81c06d3e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00bc00 tx=0x7fa82c004b40 comp rx=0 tx=0).stop 2023-10-25T23:36:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.484+0000 7fa8428d0700 1 -- 172.21.15.81:0/1058895471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa83c0bbe40 msgr2=0x7fa83c0b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.484+0000 7fa8428d0700 1 --2- 172.21.15.81:0/1058895471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa83c0bbe40 0x7fa83c0b8b60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0bc290 tx=0x7fa834007a90 comp rx=0 tx=0).stop 2023-10-25T23:36:15.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.484+0000 7f2009062700 1 -- 172.21.15.81:0/1431205414 --> [v2:172.21.15.89:6808/2561967165,v1:172.21.15.89:6809/2561967165] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1fe4005cb0 con 0x7f1fe40015e0 2023-10-25T23:36:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.484+0000 7fa840e6d700 1 -- 172.21.15.81:0/1058895471 reap_dead start 2023-10-25T23:36:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.484+0000 7fa8428d0700 1 -- 172.21.15.81:0/1058895471 shutdown_connections 2023-10-25T23:36:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.484+0000 7fa8428d0700 1 -- 172.21.15.81:0/1058895471 >> 172.21.15.81:0/1058895471 conn(0x7fa83c0bf7c0 msgr2=0x7fa83c06fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.484+0000 7fa8428d0700 1 -- 172.21.15.81:0/1058895471 shutdown_connections 2023-10-25T23:36:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.484+0000 7fa8428d0700 1 -- 172.21.15.81:0/1058895471 wait complete. 2023-10-25T23:36:15.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.485+0000 7f1feb7fe700 1 -- 172.21.15.81:0/1431205414 <== osd.6 v2:172.21.15.89:6808/2561967165 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1fe4005cb0 con 0x7f1fe40015e0 2023-10-25T23:36:15.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.485+0000 7f2009062700 1 -- 172.21.15.81:0/1431205414 >> [v2:172.21.15.89:6808/2561967165,v1:172.21.15.89:6809/2561967165] conn(0x7f1fe40015e0 msgr2=0x7f1fe4003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.485+0000 7f2009062700 1 --2- 172.21.15.81:0/1431205414 >> [v2:172.21.15.89:6808/2561967165,v1:172.21.15.89:6809/2561967165] conn(0x7f1fe40015e0 0x7f1fe4003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.485+0000 7f2009062700 1 -- 172.21.15.81:0/1431205414 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f1ff006af20 msgr2=0x7f1ff006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.485+0000 7f2009062700 1 --2- 172.21.15.81:0/1431205414 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f1ff006af20 0x7f1ff006d3e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8009230 tx=0x7f1ff8011040 comp rx=0 tx=0).stop 2023-10-25T23:36:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.485+0000 7f2009062700 1 -- 172.21.15.81:0/1431205414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20040a4290 msgr2=0x7f200409cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.485+0000 7f2009062700 1 --2- 172.21.15.81:0/1431205414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20040a4290 0x7f200409cf30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc002060 tx=0x7f1ffc00a340 comp rx=0 tx=0).stop 2023-10-25T23:36:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.485+0000 7f200359e700 1 -- 172.21.15.81:0/1431205414 reap_dead start 2023-10-25T23:36:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.485+0000 7f2009062700 1 -- 172.21.15.81:0/1431205414 shutdown_connections 2023-10-25T23:36:15.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.485+0000 7f2009062700 1 -- 172.21.15.81:0/1431205414 >> 172.21.15.81:0/1431205414 conn(0x7f20040bf7c0 msgr2=0x7f20040b6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.487+0000 7f2009062700 1 -- 172.21.15.81:0/1431205414 shutdown_connections 2023-10-25T23:36:15.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.487+0000 7f2009062700 1 -- 172.21.15.81:0/1431205414 wait complete. 2023-10-25T23:36:15.557 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2023-10-25T23:36:15.557 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-25T23:36:15.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.495+0000 7f9f702ba700 1 -- 172.21.15.81:0/1652338172 --> [v2:172.21.15.89:6824/2647243500,v1:172.21.15.89:6825/2647243500] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9f50002d40 con 0x7f9f4c073140 2023-10-25T23:36:15.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.495+0000 7f9f5effd700 1 -- 172.21.15.81:0/1652338172 <== osd.7 v2:172.21.15.89:6824/2647243500 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9f50002d40 con 0x7f9f4c073140 2023-10-25T23:36:15.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.496+0000 7f9f702ba700 1 -- 172.21.15.81:0/1652338172 >> [v2:172.21.15.89:6824/2647243500,v1:172.21.15.89:6825/2647243500] conn(0x7f9f4c073140 msgr2=0x7f9f4c075560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.496+0000 7f9f702ba700 1 --2- 172.21.15.81:0/1652338172 >> [v2:172.21.15.89:6824/2647243500,v1:172.21.15.89:6825/2647243500] conn(0x7f9f4c073140 0x7f9f4c075560 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.496+0000 7f9f702ba700 1 -- 172.21.15.81:0/1652338172 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9f4c06af20 msgr2=0x7f9f4c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.496+0000 7f9f702ba700 1 --2- 172.21.15.81:0/1652338172 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9f4c06af20 0x7f9f4c06d3e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9f640074b0 tx=0x7f9f640047c0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.496+0000 7f9f702ba700 1 -- 172.21.15.81:0/1652338172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f68144780 msgr2=0x7f9f681e0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.496+0000 7f9f702ba700 1 --2- 172.21.15.81:0/1652338172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f68144780 0x7f9f681e0710 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9f6001db50 tx=0x7f9f6001df10 comp rx=0 tx=0).stop 2023-10-25T23:36:15.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.496+0000 7f9f6e857700 1 -- 172.21.15.81:0/1652338172 reap_dead start 2023-10-25T23:36:15.561 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2023-10-25T23:36:15.562 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-25T23:36:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.498+0000 7f9f702ba700 1 -- 172.21.15.81:0/1652338172 shutdown_connections 2023-10-25T23:36:15.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.498+0000 7f9f702ba700 1 -- 172.21.15.81:0/1652338172 >> 172.21.15.81:0/1652338172 conn(0x7f9f6806ab40 msgr2=0x7f9f680b4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.499+0000 7f9f702ba700 1 -- 172.21.15.81:0/1652338172 shutdown_connections 2023-10-25T23:36:15.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.499+0000 7f9f702ba700 1 -- 172.21.15.81:0/1652338172 wait complete. 2023-10-25T23:36:15.564 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-25T23:36:15.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-25T23:36:15.566 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2023-10-25T23:36:15.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-25T23:36:15.567 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-25T23:36:15.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-25T23:36:15.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.510+0000 7f507866b700 1 -- 172.21.15.81:0/547264710 --> [v2:172.21.15.89:6800/2255820086,v1:172.21.15.89:6801/2255820086] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f50700728b0 con 0x7f5054073070 2023-10-25T23:36:15.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.511+0000 7f5066ffd700 1 -- 172.21.15.81:0/547264710 <== osd.5 v2:172.21.15.89:6800/2255820086 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f50700728b0 con 0x7f5054073070 2023-10-25T23:36:15.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.511+0000 7f507866b700 1 -- 172.21.15.81:0/547264710 >> [v2:172.21.15.89:6800/2255820086,v1:172.21.15.89:6801/2255820086] conn(0x7f5054073070 msgr2=0x7f5054075490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.511+0000 7f507866b700 1 --2- 172.21.15.81:0/547264710 >> [v2:172.21.15.89:6800/2255820086,v1:172.21.15.89:6801/2255820086] conn(0x7f5054073070 0x7f5054075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.511+0000 7f507866b700 1 -- 172.21.15.81:0/547264710 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f505406aed0 msgr2=0x7f505406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.511+0000 7f507866b700 1 --2- 172.21.15.81:0/547264710 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f505406aed0 0x7f505406d390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5068001f00 tx=0x7f5068009040 comp rx=0 tx=0).stop 2023-10-25T23:36:15.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.511+0000 7f507866b700 1 -- 172.21.15.81:0/547264710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50700a4290 msgr2=0x7f507014efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.511+0000 7f507866b700 1 --2- 172.21.15.81:0/547264710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50700a4290 0x7f507014efe0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5060004000 tx=0x7f5060004260 comp rx=0 tx=0).stop 2023-10-25T23:36:15.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.511+0000 7f5076c08700 1 -- 172.21.15.81:0/547264710 reap_dead start 2023-10-25T23:36:15.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.511+0000 7f507866b700 1 -- 172.21.15.81:0/547264710 shutdown_connections 2023-10-25T23:36:15.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.511+0000 7f507866b700 1 -- 172.21.15.81:0/547264710 >> 172.21.15.81:0/547264710 conn(0x7f50700bf7c0 msgr2=0x7f50700a0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.512+0000 7f507866b700 1 -- 172.21.15.81:0/547264710 shutdown_connections 2023-10-25T23:36:15.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.512+0000 7f507866b700 1 -- 172.21.15.81:0/547264710 wait complete. 2023-10-25T23:36:15.574 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-25T23:36:15.575 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-25T23:36:15.575 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-25T23:36:15.576 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-25T23:36:15.793 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.792+0000 7f7441837700 1 -- 172.21.15.81:0/3973833441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f743c0bb860 msgr2=0x7f743c0ba970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.792+0000 7f7441837700 1 --2- 172.21.15.81:0/3973833441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f743c0bb860 0x7f743c0ba970 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7434009f60 tx=0x7f7434009f90 comp rx=0 tx=0).stop 2023-10-25T23:36:15.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.792+0000 7f7441837700 1 -- 172.21.15.81:0/3973833441 shutdown_connections 2023-10-25T23:36:15.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.792+0000 7f7441837700 1 --2- 172.21.15.81:0/3973833441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f743c0bb860 0x7f743c0ba970 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.794 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.792+0000 7f7441837700 1 -- 172.21.15.81:0/3973833441 >> 172.21.15.81:0/3973833441 conn(0x7f743c0bf7c0 msgr2=0x7f743c0bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.792+0000 7f7441837700 1 -- 172.21.15.81:0/3973833441 shutdown_connections 2023-10-25T23:36:15.795 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.792+0000 7f7441837700 1 -- 172.21.15.81:0/3973833441 wait complete. 2023-10-25T23:36:15.796 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.794+0000 7f7441837700 1 Processor -- start 2023-10-25T23:36:15.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.795+0000 7f7441837700 1 -- start start 2023-10-25T23:36:15.797 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.796+0000 7f7441837700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f743c06bb80 0x7f743c0b9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.796+0000 7f7441837700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f743c0a4290 0x7f743c153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.796+0000 7f7441837700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f743c0bb860 0x7f743c1f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.796+0000 7f7441837700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0b9d70 con 0x7f743c0bb860 2023-10-25T23:36:15.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.796+0000 7f7441837700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0b95c0 con 0x7f743c0a4290 2023-10-25T23:36:15.798 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.796+0000 7f7441837700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c071200 con 0x7f743c06bb80 2023-10-25T23:36:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.797+0000 7f743b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f743c0bb860 0x7f743c1f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.797+0000 7f743b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f743c0bb860 0x7f743c1f2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36428/0 (socket says 172.21.15.81:36428) 2023-10-25T23:36:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.797+0000 7f743b7fe700 1 -- 172.21.15.81:0/2581538913 learned_addr learned my addr 172.21.15.81:0/2581538913 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:15.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.797+0000 7f743b7fe700 1 -- 172.21.15.81:0/2581538913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f743c06bb80 msgr2=0x7f743c0b9080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-25T23:36:15.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.797+0000 7f743b7fe700 1 --2- 172.21.15.81:0/2581538913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f743c06bb80 0x7f743c0b9080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.797+0000 7f743b7fe700 1 -- 172.21.15.81:0/2581538913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f743c0a4290 msgr2=0x7f743c153330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-25T23:36:15.800 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.797+0000 7f743b7fe700 1 --2- 172.21.15.81:0/2581538913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f743c0a4290 0x7f743c153330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.797+0000 7f743b7fe700 1 -- 172.21.15.81:0/2581538913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7434009c40 con 0x7f743c0bb860 2023-10-25T23:36:15.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.798+0000 7f743b7fe700 1 --2- 172.21.15.81:0/2581538913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f743c0bb860 0x7f743c1f2580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f742c00c480 tx=0x7f742c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.798+0000 7f7423fff700 1 -- 172.21.15.81:0/2581538913 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c016070 con 0x7f743c0bb860 2023-10-25T23:36:15.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.798+0000 7f7423fff700 1 -- 172.21.15.81:0/2581538913 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f742c006a10 con 0x7f743c0bb860 2023-10-25T23:36:15.801 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.798+0000 7f7423fff700 1 -- 172.21.15.81:0/2581538913 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c006e20 con 0x7f743c0bb860 2023-10-25T23:36:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.798+0000 7f7441837700 1 -- 172.21.15.81:0/2581538913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c0b9a90 con 0x7f743c0bb860 2023-10-25T23:36:15.802 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.798+0000 7f7441837700 1 -- 172.21.15.81:0/2581538913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743c1e15e0 con 0x7f743c0bb860 2023-10-25T23:36:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.800+0000 7f7441837700 1 -- 172.21.15.81:0/2581538913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c0052f0 con 0x7f743c0bb860 2023-10-25T23:36:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.800+0000 7f7423fff700 1 -- 172.21.15.81:0/2581538913 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f742c006f80 con 0x7f743c0bb860 2023-10-25T23:36:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.801+0000 7f7423fff700 1 --2- 172.21.15.81:0/2581538913 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f742806af20 0x7f742806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.803 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.801+0000 7f7423fff700 1 -- 172.21.15.81:0/2581538913 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f742c088cb0 con 0x7f743c0bb860 2023-10-25T23:36:15.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.801+0000 7f743affd700 1 --2- 172.21.15.81:0/2581538913 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f742806af20 0x7f742806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.804 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.802+0000 7f743affd700 1 --2- 172.21.15.81:0/2581538913 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f742806af20 0x7f742806d3e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7434000f80 tx=0x7f7434004b40 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.813+0000 7f92caa13700 1 -- 172.21.15.81:0/2661885224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c40b6730 msgr2=0x7f92c40b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.813+0000 7f92caa13700 1 --2- 172.21.15.81:0/2661885224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c40b6730 0x7f92c40b5ab0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92b80098c0 tx=0x7f92b8009bd0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.813+0000 7f92caa13700 1 -- 172.21.15.81:0/2661885224 shutdown_connections 2023-10-25T23:36:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.813+0000 7f92caa13700 1 --2- 172.21.15.81:0/2661885224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c40b6730 0x7f92c40b5ab0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.813+0000 7f92caa13700 1 -- 172.21.15.81:0/2661885224 >> 172.21.15.81:0/2661885224 conn(0x7f92c40bc290 msgr2=0x7f92c40bc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.813+0000 7f92caa13700 1 -- 172.21.15.81:0/2661885224 shutdown_connections 2023-10-25T23:36:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.813+0000 7f92caa13700 1 -- 172.21.15.81:0/2661885224 wait complete. 2023-10-25T23:36:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.814+0000 7f92caa13700 1 Processor -- start 2023-10-25T23:36:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.814+0000 7f7423fff700 1 -- 172.21.15.81:0/2581538913 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f742c053ed0 con 0x7f743c0bb860 2023-10-25T23:36:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.815+0000 7f92caa13700 1 -- start start 2023-10-25T23:36:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.816+0000 7f92caa13700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c40b56d0 0x7f92c4144af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.816+0000 7f92caa13700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c40b6730 0x7f92c4145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.816+0000 7f92caa13700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92c40bb8b0 0x7f92c41eb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.816+0000 7f92caa13700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c4146700 con 0x7f92c40bb8b0 2023-10-25T23:36:15.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.816+0000 7f92caa13700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40b7510 con 0x7f92c40b56d0 2023-10-25T23:36:15.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.816+0000 7f92caa13700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40b7cc0 con 0x7f92c40b6730 2023-10-25T23:36:15.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.816+0000 7f92c3fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c40b56d0 0x7f92c4144af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.818 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.816+0000 7f92c37fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c40b6730 0x7f92c4145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.816+0000 7f92c37fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c40b6730 0x7f92c4145030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:59372/0 (socket says 172.21.15.81:59372) 2023-10-25T23:36:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.816+0000 7f92c37fe700 1 -- 172.21.15.81:0/32340357 learned_addr learned my addr 172.21.15.81:0/32340357 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.816+0000 7f92c8fb0700 1 --2- 172.21.15.81:0/32340357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92c40bb8b0 0x7f92c41eb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7f92c37fe700 1 -- 172.21.15.81:0/32340357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c40b56d0 msgr2=0x7f92c4144af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7f92c37fe700 1 --2- 172.21.15.81:0/32340357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c40b56d0 0x7f92c4144af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7f92c37fe700 1 -- 172.21.15.81:0/32340357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92c40bb8b0 msgr2=0x7f92c41eb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7f92c37fe700 1 --2- 172.21.15.81:0/32340357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92c40bb8b0 0x7f92c41eb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7f92c37fe700 1 -- 172.21.15.81:0/32340357 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b8009520 con 0x7f92c40b6730 2023-10-25T23:36:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7f92c8fb0700 1 --2- 172.21.15.81:0/32340357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92c40bb8b0 0x7f92c41eb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-25T23:36:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7fe9745d3700 1 -- 172.21.15.81:0/1598034323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe96c0a3510 msgr2=0x7fe96c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7fe9745d3700 1 --2- 172.21.15.81:0/1598034323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe96c0a3510 0x7fe96c06e3c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe964009fd0 tx=0x7fe96400b380 comp rx=0 tx=0).stop 2023-10-25T23:36:15.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7f92c37fe700 1 --2- 172.21.15.81:0/32340357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c40b6730 0x7f92c4145030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009fd0 tx=0x7f92b80176a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7fe9745d3700 1 -- 172.21.15.81:0/1598034323 shutdown_connections 2023-10-25T23:36:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7fe9745d3700 1 --2- 172.21.15.81:0/1598034323 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe96c0a3510 0x7fe96c06e3c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7fe9745d3700 1 --2- 172.21.15.81:0/1598034323 >> v2:172.21.15.81:3300/0 conn(0x7fe96c0bb8a0 0x7fe96c0a38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7fe9745d3700 1 -- 172.21.15.81:0/1598034323 >> 172.21.15.81:0/1598034323 conn(0x7fe96c0bf7c0 msgr2=0x7fe96c0bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7fe9745d3700 1 -- 172.21.15.81:0/1598034323 shutdown_connections 2023-10-25T23:36:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7fe9745d3700 1 -- 172.21.15.81:0/1598034323 wait complete. 2023-10-25T23:36:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7f92c0ff9700 1 -- 172.21.15.81:0/32340357 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b801c070 con 0x7f92c40b6730 2023-10-25T23:36:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7f92c0ff9700 1 -- 172.21.15.81:0/32340357 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f92b8017b90 con 0x7f92c40b6730 2023-10-25T23:36:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7f92c0ff9700 1 -- 172.21.15.81:0/32340357 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8004020 con 0x7f92c40b6730 2023-10-25T23:36:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7f92caa13700 1 -- 172.21.15.81:0/32340357 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c41ec640 con 0x7f92c40b6730 2023-10-25T23:36:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7f92caa13700 1 -- 172.21.15.81:0/32340357 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c40b79e0 con 0x7f92c40b6730 2023-10-25T23:36:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7f94766d9700 1 -- 172.21.15.81:0/1347105682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9458005410 msgr2=0x7f945800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.817+0000 7f94766d9700 1 --2- 172.21.15.81:0/1347105682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9458005410 0x7f945800ba10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f946800c630 tx=0x7f9458005880 comp rx=0 tx=0).stop 2023-10-25T23:36:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.818+0000 7f94766d9700 1 -- 172.21.15.81:0/1347105682 shutdown_connections 2023-10-25T23:36:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.818+0000 7f94766d9700 1 --2- 172.21.15.81:0/1347105682 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9458005410 0x7f945800ba10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.818+0000 7f94766d9700 1 -- 172.21.15.81:0/1347105682 >> 172.21.15.81:0/1347105682 conn(0x7f94700bf7c0 msgr2=0x7f94700bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.819+0000 7fe9745d3700 1 Processor -- start 2023-10-25T23:36:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.819+0000 7f92caa13700 1 -- 172.21.15.81:0/32340357 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c406fd50 con 0x7f92c40b6730 2023-10-25T23:36:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.819+0000 7fe9745d3700 1 -- start start 2023-10-25T23:36:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.819+0000 7f92c0ff9700 1 -- 172.21.15.81:0/32340357 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f92b8004180 con 0x7f92c40b6730 2023-10-25T23:36:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.820+0000 7f92c0ff9700 1 --2- 172.21.15.81:0/32340357 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f92ac06afc0 0x7f92ac06d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.819+0000 7fe9745d3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe96c0a3510 0x7fe96c0b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.819+0000 7fe9745d3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96c0bb8a0 0x7fe96c0b7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.819+0000 7fe9745d3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe96c0bf090 0x7fe96c0b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.819+0000 7fe9745d3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c09e9d0 con 0x7fe96c0bb8a0 2023-10-25T23:36:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.819+0000 7fe9745d3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c1e94e0 con 0x7fe96c0bf090 2023-10-25T23:36:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.819+0000 7fe9745d3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c0b4350 con 0x7fe96c0a3510 2023-10-25T23:36:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.819+0000 7fe97236f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe96c0a3510 0x7fe96c0b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.819+0000 7fe97236f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe96c0a3510 0x7fe96c0b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:59382/0 (socket says 172.21.15.81:59382) 2023-10-25T23:36:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.819+0000 7fe97236f700 1 -- 172.21.15.81:0/1998582044 learned_addr learned my addr 172.21.15.81:0/1998582044 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:15.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.820+0000 7f94766d9700 1 -- 172.21.15.81:0/1347105682 shutdown_connections 2023-10-25T23:36:15.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.820+0000 7fe972b70700 1 --2- 172.21.15.81:0/1998582044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe96c0bf090 0x7fe96c0b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.820+0000 7f92c0ff9700 1 -- 172.21.15.81:0/32340357 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92b808ad70 con 0x7f92c40b6730 2023-10-25T23:36:15.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.820+0000 7f94766d9700 1 -- 172.21.15.81:0/1347105682 wait complete. 2023-10-25T23:36:15.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.820+0000 7fe97236f700 1 -- 172.21.15.81:0/1998582044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe96c0bf090 msgr2=0x7fe96c0b7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.820+0000 7fe97236f700 1 --2- 172.21.15.81:0/1998582044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe96c0bf090 0x7fe96c0b7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.820+0000 7fe97236f700 1 -- 172.21.15.81:0/1998582044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96c0bb8a0 msgr2=0x7fe96c0b7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.820+0000 7fe97236f700 1 --2- 172.21.15.81:0/1998582044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96c0bb8a0 0x7fe96c0b7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.820+0000 7fe97236f700 1 -- 172.21.15.81:0/1998582044 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe964009d00 con 0x7fe96c0a3510 2023-10-25T23:36:15.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.820+0000 7fe97236f700 1 --2- 172.21.15.81:0/1998582044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe96c0a3510 0x7fe96c0b3a10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe96400b070 tx=0x7fe96400bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.821+0000 7f777e46d700 1 -- 172.21.15.81:0/1463562905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7778151c50 msgr2=0x7f777806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.821+0000 7f777e46d700 1 --2- 172.21.15.81:0/1463562905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7778151c50 0x7f777806b760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7770009f60 tx=0x7f7770009f90 comp rx=0 tx=0).stop 2023-10-25T23:36:15.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.821+0000 7f777e46d700 1 -- 172.21.15.81:0/1463562905 shutdown_connections 2023-10-25T23:36:15.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.821+0000 7f777e46d700 1 --2- 172.21.15.81:0/1463562905 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7778151c50 0x7f777806b760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.821+0000 7f777e46d700 1 -- 172.21.15.81:0/1463562905 >> 172.21.15.81:0/1463562905 conn(0x7f77780c3c10 msgr2=0x7f77780c4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.821+0000 7f94766d9700 1 Processor -- start 2023-10-25T23:36:15.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.821+0000 7f777e46d700 1 -- 172.21.15.81:0/1463562905 shutdown_connections 2023-10-25T23:36:15.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.821+0000 7f777e46d700 1 -- 172.21.15.81:0/1463562905 wait complete. 2023-10-25T23:36:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.822+0000 7f94766d9700 1 -- start start 2023-10-25T23:36:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.822+0000 7f92c3fff700 1 --2- 172.21.15.81:0/32340357 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f92ac06afc0 0x7f92ac06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.823+0000 7f94766d9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9458005410 0x7f94700b8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.823+0000 7f94766d9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9470147c50 0x7f94701480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.823+0000 7f94766d9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94701ebc80 0x7f94701ec100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.823+0000 7f94766d9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947014a650 con 0x7f9458005410 2023-10-25T23:36:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.823+0000 7f94766d9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947014bf20 con 0x7f9470147c50 2023-10-25T23:36:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.823+0000 7f94766d9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94700b8820 con 0x7f94701ebc80 2023-10-25T23:36:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.823+0000 7f946ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9458005410 0x7f94700b8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.823+0000 7f946ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9458005410 0x7f94700b8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36478/0 (socket says 172.21.15.81:36478) 2023-10-25T23:36:15.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.823+0000 7f946ffff700 1 -- 172.21.15.81:0/644020609 learned_addr learned my addr 172.21.15.81:0/644020609 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:15.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.823+0000 7f9474c76700 1 --2- 172.21.15.81:0/644020609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94701ebc80 0x7f94701ec100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.823+0000 7f946f7fe700 1 --2- 172.21.15.81:0/644020609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9470147c50 0x7f94701480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.823+0000 7f946ffff700 1 -- 172.21.15.81:0/644020609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94701ebc80 msgr2=0x7f94701ec100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.823+0000 7f946ffff700 1 --2- 172.21.15.81:0/644020609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94701ebc80 0x7f94701ec100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.823+0000 7f946ffff700 1 -- 172.21.15.81:0/644020609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9470147c50 msgr2=0x7f94701480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.823+0000 7f946ffff700 1 --2- 172.21.15.81:0/644020609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9470147c50 0x7f94701480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.823+0000 7f946ffff700 1 -- 172.21.15.81:0/644020609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947014b310 con 0x7f9458005410 2023-10-25T23:36:15.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.823+0000 7f777e46d700 1 Processor -- start 2023-10-25T23:36:15.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.824+0000 7f946ffff700 1 --2- 172.21.15.81:0/644020609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9458005410 0x7f94700b8e70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9464004e20 tx=0x7f9464001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.842 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.824+0000 7f946cff9700 1 -- 172.21.15.81:0/644020609 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464011660 con 0x7f9458005410 2023-10-25T23:36:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.824+0000 7f909adb0700 1 -- 172.21.15.81:0/253886731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90940bb860 msgr2=0x7f90940ba970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.824+0000 7f909adb0700 1 --2- 172.21.15.81:0/253886731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90940bb860 0x7f90940ba970 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f90940c0790 tx=0x7f9088009ba0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.824+0000 7f909adb0700 1 -- 172.21.15.81:0/253886731 shutdown_connections 2023-10-25T23:36:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.824+0000 7f909adb0700 1 --2- 172.21.15.81:0/253886731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90940bb860 0x7f90940ba970 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.824+0000 7f909adb0700 1 --2- 172.21.15.81:0/253886731 >> v2:172.21.15.81:3300/0 conn(0x7f909406bb80 0x7f90940bbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.824+0000 7f909adb0700 1 -- 172.21.15.81:0/253886731 >> 172.21.15.81:0/253886731 conn(0x7f90940bf7c0 msgr2=0x7f90940bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.824+0000 7f909adb0700 1 -- 172.21.15.81:0/253886731 shutdown_connections 2023-10-25T23:36:15.844 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.823+0000 7f777e46d700 1 -- start start 2023-10-25T23:36:15.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.824+0000 7f777e46d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f777806bca0 0x7f777814c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.824+0000 7f777e46d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7778151c50 0x7f777814ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.825+0000 7f777e46d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7778156d00 0x7f77781e3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.825+0000 7f777e46d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777814bf40 con 0x7f7778156d00 2023-10-25T23:36:15.845 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.825+0000 7f777e46d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77781e9b90 con 0x7f777806bca0 2023-10-25T23:36:15.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.825+0000 7f777e46d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77781ea110 con 0x7f7778151c50 2023-10-25T23:36:15.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.824+0000 7f946cff9700 1 -- 172.21.15.81:0/644020609 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f94640118b0 con 0x7f9458005410 2023-10-25T23:36:15.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.824+0000 7f946cff9700 1 -- 172.21.15.81:0/644020609 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464011ca0 con 0x7f9458005410 2023-10-25T23:36:15.846 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.825+0000 7f94766d9700 1 -- 172.21.15.81:0/644020609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94700b93b0 con 0x7f9458005410 2023-10-25T23:36:15.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.825+0000 7f94766d9700 1 -- 172.21.15.81:0/644020609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947014e4e0 con 0x7f9458005410 2023-10-25T23:36:15.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.825+0000 7f9474c76700 1 --2- 172.21.15.81:0/644020609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94701ebc80 0x7f94701ec100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:36:15.847 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.825+0000 7f777ca0a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7778156d00 0x7f77781e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.825+0000 7f777ca0a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7778156d00 0x7f77781e3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36488/0 (socket says 172.21.15.81:36488) 2023-10-25T23:36:15.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.825+0000 7f777ca0a700 1 -- 172.21.15.81:0/1828779625 learned_addr learned my addr 172.21.15.81:0/1828779625 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:15.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.825+0000 7f77777fe700 1 --2- 172.21.15.81:0/1828779625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7778151c50 0x7f777814ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.848 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.826+0000 7f7777fff700 1 --2- 172.21.15.81:0/1828779625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f777806bca0 0x7f777814c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.824+0000 7f909adb0700 1 -- 172.21.15.81:0/253886731 wait complete. 2023-10-25T23:36:15.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.826+0000 7f909adb0700 1 Processor -- start 2023-10-25T23:36:15.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.825+0000 7fe962ffd700 1 -- 172.21.15.81:0/1998582044 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96400e050 con 0x7fe96c0a3510 2023-10-25T23:36:15.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.826+0000 7f92c0ff9700 1 -- 172.21.15.81:0/32340357 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f92c406fd50 con 0x7f92c40b6730 2023-10-25T23:36:15.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.827+0000 7f94766d9700 1 -- 172.21.15.81:0/644020609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94700670a0 con 0x7f9458005410 2023-10-25T23:36:15.850 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.826+0000 7f77777fe700 1 -- 172.21.15.81:0/1828779625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f777806bca0 msgr2=0x7f777814c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.826+0000 7f77777fe700 1 --2- 172.21.15.81:0/1828779625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f777806bca0 0x7f777814c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.826+0000 7f77777fe700 1 -- 172.21.15.81:0/1828779625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7778156d00 msgr2=0x7f77781e3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.826+0000 7f77777fe700 1 --2- 172.21.15.81:0/1828779625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7778156d00 0x7f77781e3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.826+0000 7f77777fe700 1 -- 172.21.15.81:0/1828779625 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7770009c40 con 0x7f7778151c50 2023-10-25T23:36:15.851 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.826+0000 7f77777fe700 1 --2- 172.21.15.81:0/1828779625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7778151c50 0x7f777814ba00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f776800c520 tx=0x7f776800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.826+0000 7fe962ffd700 1 -- 172.21.15.81:0/1998582044 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe964008d10 con 0x7fe96c0a3510 2023-10-25T23:36:15.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.826+0000 7fe962ffd700 1 -- 172.21.15.81:0/1998582044 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964004290 con 0x7fe96c0a3510 2023-10-25T23:36:15.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.827+0000 7fe9745d3700 1 -- 172.21.15.81:0/1998582044 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96c1e9730 con 0x7fe96c0a3510 2023-10-25T23:36:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.827+0000 7fe9745d3700 1 -- 172.21.15.81:0/1998582044 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96c0b9180 con 0x7fe96c0a3510 2023-10-25T23:36:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.826+0000 7f909adb0700 1 -- start start 2023-10-25T23:36:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.827+0000 7f909adb0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f909406bb80 0x7f9094158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.827+0000 7f909adb0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90940a4290 0x7f90941f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.827+0000 7f909adb0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90940bb860 0x7f9094159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.827+0000 7f909adb0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90941590b0 con 0x7f909406bb80 2023-10-25T23:36:15.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.827+0000 7f909adb0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9094159670 con 0x7f90940a4290 2023-10-25T23:36:15.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.827+0000 7f909adb0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909415ab60 con 0x7f90940bb860 2023-10-25T23:36:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.827+0000 7f9098b4c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f909406bb80 0x7f9094158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.827+0000 7f9098b4c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f909406bb80 0x7f9094158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36490/0 (socket says 172.21.15.81:36490) 2023-10-25T23:36:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.827+0000 7f9098b4c700 1 -- 172.21.15.81:0/1432560762 learned_addr learned my addr 172.21.15.81:0/1432560762 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.827+0000 7f909934d700 1 --2- 172.21.15.81:0/1432560762 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90940bb860 0x7f9094159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.828+0000 7f9093fff700 1 --2- 172.21.15.81:0/1432560762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90940a4290 0x7f90941f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.828+0000 7f9098b4c700 1 -- 172.21.15.81:0/1432560762 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90940bb860 msgr2=0x7f9094159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.828+0000 7f9098b4c700 1 --2- 172.21.15.81:0/1432560762 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90940bb860 0x7f9094159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.828+0000 7f9098b4c700 1 -- 172.21.15.81:0/1432560762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90940a4290 msgr2=0x7f90941f52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.828+0000 7f9098b4c700 1 --2- 172.21.15.81:0/1432560762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90940a4290 0x7f90941f52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.828+0000 7f9098b4c700 1 -- 172.21.15.81:0/1432560762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9088009520 con 0x7f909406bb80 2023-10-25T23:36:15.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.828+0000 7f909934d700 1 --2- 172.21.15.81:0/1432560762 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90940bb860 0x7f9094159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:36:15.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.828+0000 7f9093fff700 1 --2- 172.21.15.81:0/1432560762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90940a4290 0x7f90941f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:36:15.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.828+0000 7f9098b4c700 1 --2- 172.21.15.81:0/1432560762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f909406bb80 0x7f9094158740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f90940a4ee0 tx=0x7f908800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.827+0000 7f946cff9700 1 -- 172.21.15.81:0/644020609 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f946401a400 con 0x7f9458005410 2023-10-25T23:36:15.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.828+0000 7f946cff9700 1 --2- 172.21.15.81:0/644020609 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f945c06aed0 0x7f945c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.828+0000 7f946cff9700 1 -- 172.21.15.81:0/644020609 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9464089ff0 con 0x7f9458005410 2023-10-25T23:36:15.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.828+0000 7f946f7fe700 1 --2- 172.21.15.81:0/644020609 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f945c06aed0 0x7f945c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.828+0000 7f946f7fe700 1 --2- 172.21.15.81:0/644020609 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f945c06aed0 0x7f945c06d390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f94700becf0 tx=0x7f946000b260 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.830+0000 7fe962ffd700 1 -- 172.21.15.81:0/1998582044 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe964019040 con 0x7fe96c0a3510 2023-10-25T23:36:15.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.830+0000 7fe962ffd700 1 --2- 172.21.15.81:0/1998582044 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe95006afa0 0x7fe95006d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.859 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.830+0000 7fe962ffd700 1 -- 172.21.15.81:0/1998582044 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe96408a0d0 con 0x7fe96c0a3510 2023-10-25T23:36:15.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.830+0000 7fe971b6e700 1 --2- 172.21.15.81:0/1998582044 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe95006afa0 0x7fe95006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.827+0000 7f7774ff9700 1 -- 172.21.15.81:0/1828779625 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77680054e0 con 0x7f7778151c50 2023-10-25T23:36:15.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.827+0000 7f7774ff9700 1 -- 172.21.15.81:0/1828779625 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7768003680 con 0x7f7778151c50 2023-10-25T23:36:15.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.827+0000 7f7774ff9700 1 -- 172.21.15.81:0/1828779625 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768003a90 con 0x7f7778151c50 2023-10-25T23:36:15.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.827+0000 7f777e46d700 1 -- 172.21.15.81:0/1828779625 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77781e9e30 con 0x7f7778151c50 2023-10-25T23:36:15.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.828+0000 7f777e46d700 1 -- 172.21.15.81:0/1828779625 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77780b9260 con 0x7f7778151c50 2023-10-25T23:36:15.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.831+0000 7fe971b6e700 1 --2- 172.21.15.81:0/1998582044 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe95006afa0 0x7fe95006d460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009770 tx=0x7fe95c006cd0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.832+0000 7f92c3fff700 1 --2- 172.21.15.81:0/32340357 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f92ac06afc0 0x7f92ac06d480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f92b4005720 tx=0x7f92b4007ee0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.834+0000 7f7774ff9700 1 -- 172.21.15.81:0/1828779625 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7768003bf0 con 0x7f7778151c50 2023-10-25T23:36:15.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.834+0000 7fe9745d3700 1 -- 172.21.15.81:0/1998582044 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96c0b75d0 con 0x7fe96c0a3510 2023-10-25T23:36:15.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.834+0000 7f7774ff9700 1 --2- 172.21.15.81:0/1828779625 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f776406af20 0x7f776406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.834+0000 7f7774ff9700 1 -- 172.21.15.81:0/1828779625 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77680885b0 con 0x7f7778151c50 2023-10-25T23:36:15.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.835+0000 7f7777fff700 1 --2- 172.21.15.81:0/1828779625 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f776406af20 0x7f776406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.864 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.835+0000 7f8c675e0700 1 -- 172.21.15.81:0/809344431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c600a4290 msgr2=0x7f8c600bbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.835+0000 7f8c675e0700 1 --2- 172.21.15.81:0/809344431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c600a4290 0x7f8c600bbc40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8c600a25f0 tx=0x7f8c5800b330 comp rx=0 tx=0).stop 2023-10-25T23:36:15.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.835+0000 7f8c675e0700 1 -- 172.21.15.81:0/809344431 shutdown_connections 2023-10-25T23:36:15.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.835+0000 7f8c675e0700 1 --2- 172.21.15.81:0/809344431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c600a4290 0x7f8c600bbc40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.865 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.835+0000 7f7777fff700 1 --2- 172.21.15.81:0/1828779625 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f776406af20 0x7f776406d3e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7770009550 tx=0x7f7770004b40 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.835+0000 7f8c675e0700 1 --2- 172.21.15.81:0/809344431 >> v2:172.21.15.81:3300/0 conn(0x7f8c6006bb80 0x7f8c600ba970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.835+0000 7f8c675e0700 1 -- 172.21.15.81:0/809344431 >> 172.21.15.81:0/809344431 conn(0x7f8c600bf7c0 msgr2=0x7f8c600bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.835+0000 7f8c675e0700 1 -- 172.21.15.81:0/809344431 shutdown_connections 2023-10-25T23:36:15.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.835+0000 7f8c675e0700 1 -- 172.21.15.81:0/809344431 wait complete. 2023-10-25T23:36:15.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.837+0000 7f8c675e0700 1 Processor -- start 2023-10-25T23:36:15.867 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.837+0000 7f8c675e0700 1 -- start start 2023-10-25T23:36:15.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.838+0000 7f777e46d700 1 -- 172.21.15.81:0/1828779625 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77580052f0 con 0x7f7778151c50 2023-10-25T23:36:15.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.838+0000 7f90917fa700 1 -- 172.21.15.81:0/1432560762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908801b070 con 0x7f909406bb80 2023-10-25T23:36:15.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.838+0000 7f90917fa700 1 -- 172.21.15.81:0/1432560762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f908800f9e0 con 0x7f909406bb80 2023-10-25T23:36:15.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.838+0000 7f90917fa700 1 -- 172.21.15.81:0/1432560762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908800fdd0 con 0x7f909406bb80 2023-10-25T23:36:15.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.838+0000 7f909adb0700 1 -- 172.21.15.81:0/1432560762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9094158c80 con 0x7f909406bb80 2023-10-25T23:36:15.869 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.838+0000 7f8c675e0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c6006bb80 0x7f8c600702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.838+0000 7f8c675e0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c600a4290 0x7f8c600b9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.838+0000 7f8c675e0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c600bb860 0x7f8c600b96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.838+0000 7f8c675e0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c600713f0 con 0x7f8c600bb860 2023-10-25T23:36:15.870 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.838+0000 7f8c675e0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c600707e0 con 0x7f8c6006bb80 2023-10-25T23:36:15.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.838+0000 7f8c675e0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c601ec5c0 con 0x7f8c600a4290 2023-10-25T23:36:15.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.838+0000 7f8c6537c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c6006bb80 0x7f8c600702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.838+0000 7f8c6537c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c6006bb80 0x7f8c600702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:56582/0 (socket says 172.21.15.81:56582) 2023-10-25T23:36:15.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.838+0000 7f8c6537c700 1 -- 172.21.15.81:0/2091727091 learned_addr learned my addr 172.21.15.81:0/2091727091 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:15.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.838+0000 7f8c65b7d700 1 --2- 172.21.15.81:0/2091727091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c600bb860 0x7f8c600b96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.839+0000 7f8c65b7d700 1 -- 172.21.15.81:0/2091727091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c600a4290 msgr2=0x7f8c600b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.839+0000 7f8c65b7d700 1 --2- 172.21.15.81:0/2091727091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c600a4290 0x7f8c600b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.839+0000 7f8c65b7d700 1 -- 172.21.15.81:0/2091727091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c6006bb80 msgr2=0x7f8c600702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.839+0000 7f8c65b7d700 1 --2- 172.21.15.81:0/2091727091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c6006bb80 0x7f8c600702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.839+0000 7f8c65b7d700 1 -- 172.21.15.81:0/2091727091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c58009c40 con 0x7f8c600bb860 2023-10-25T23:36:15.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.839+0000 7f8c65b7d700 1 --2- 172.21.15.81:0/2091727091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c600bb860 0x7f8c600b96c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8c58014000 tx=0x7f8c5800bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.839+0000 7f8c55ffb700 1 -- 172.21.15.81:0/2091727091 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5800e070 con 0x7f8c600bb860 2023-10-25T23:36:15.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.839+0000 7f8c55ffb700 1 -- 172.21.15.81:0/2091727091 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8c58004610 con 0x7f8c600bb860 2023-10-25T23:36:15.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.839+0000 7f8c675e0700 1 -- 172.21.15.81:0/2091727091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6014dba0 con 0x7f8c600bb860 2023-10-25T23:36:15.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.839+0000 7f8c55ffb700 1 -- 172.21.15.81:0/2091727091 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58007500 con 0x7f8c600bb860 2023-10-25T23:36:15.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.838+0000 7f946cff9700 1 -- 172.21.15.81:0/644020609 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9464055130 con 0x7f9458005410 2023-10-25T23:36:15.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.838+0000 7f909adb0700 1 -- 172.21.15.81:0/1432560762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909415adc0 con 0x7f909406bb80 2023-10-25T23:36:15.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.840+0000 7f909adb0700 1 -- 172.21.15.81:0/1432560762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9094159950 con 0x7f909406bb80 2023-10-25T23:36:15.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.846+0000 7f7774ff9700 1 -- 172.21.15.81:0/1828779625 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f77680537d0 con 0x7f7778151c50 2023-10-25T23:36:15.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.841+0000 7f90917fa700 1 -- 172.21.15.81:0/1432560762 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f908801f070 con 0x7f909406bb80 2023-10-25T23:36:15.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.842+0000 7f90917fa700 1 --2- 172.21.15.81:0/1432560762 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f907806aed0 0x7f907806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.875 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.842+0000 7f90917fa700 1 -- 172.21.15.81:0/1432560762 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f908808ac50 con 0x7f909406bb80 2023-10-25T23:36:15.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.842+0000 7f9093fff700 1 --2- 172.21.15.81:0/1432560762 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f907806aed0 0x7f907806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.842+0000 7f9093fff700 1 --2- 172.21.15.81:0/1432560762 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f907806aed0 0x7f907806d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9094152fd0 tx=0x7f9080009310 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.839+0000 7f8c675e0700 1 -- 172.21.15.81:0/2091727091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6014e160 con 0x7f8c600bb860 2023-10-25T23:36:15.876 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.844+0000 7f8c55ffb700 1 -- 172.21.15.81:0/2091727091 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8c58019040 con 0x7f8c600bb860 2023-10-25T23:36:15.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.844+0000 7f8c55ffb700 1 --2- 172.21.15.81:0/2091727091 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f8c4406aed0 0x7f8c4406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.846+0000 7f8c675e0700 1 -- 172.21.15.81:0/2091727091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6014da00 con 0x7f8c600bb860 2023-10-25T23:36:15.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.840+0000 7fe962ffd700 1 -- 172.21.15.81:0/1998582044 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe9640551f0 con 0x7fe96c0a3510 2023-10-25T23:36:15.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.847+0000 7f8c6537c700 1 --2- 172.21.15.81:0/2091727091 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f8c4406aed0 0x7f8c4406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.847+0000 7f8c6537c700 1 --2- 172.21.15.81:0/2091727091 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f8c4406aed0 0x7f8c4406d390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8c50001a40 tx=0x7f8c50009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.851+0000 7f90917fa700 1 -- 172.21.15.81:0/1432560762 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9088055f90 con 0x7f909406bb80 2023-10-25T23:36:15.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.854+0000 7f8c55ffb700 1 -- 172.21.15.81:0/2091727091 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c58011390 con 0x7f8c600bb860 2023-10-25T23:36:15.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.854+0000 7f8c55ffb700 1 -- 172.21.15.81:0/2091727091 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8c6014da00 con 0x7f8c600bb860 2023-10-25T23:36:15.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.866+0000 7fb5f2afd700 1 -- 172.21.15.81:0/3046548490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5ec0bb860 msgr2=0x7fb5ec0ba970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.866+0000 7fb5f2afd700 1 --2- 172.21.15.81:0/3046548490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5ec0bb860 0x7fb5ec0ba970 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0a2570 tx=0x7fb5e400b380 comp rx=0 tx=0).stop 2023-10-25T23:36:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.867+0000 7fb5f2afd700 1 -- 172.21.15.81:0/3046548490 shutdown_connections 2023-10-25T23:36:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.867+0000 7fb5f2afd700 1 --2- 172.21.15.81:0/3046548490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5ec0bb860 0x7fb5ec0ba970 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.867+0000 7fb5f2afd700 1 --2- 172.21.15.81:0/3046548490 >> v2:172.21.15.89:3300/0 conn(0x7fb5ec06bb80 0x7fb5ec0bbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.867+0000 7fb5f2afd700 1 -- 172.21.15.81:0/3046548490 >> 172.21.15.81:0/3046548490 conn(0x7fb5ec0bf7c0 msgr2=0x7fb5ec0bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.867+0000 7fb5f2afd700 1 -- 172.21.15.81:0/3046548490 shutdown_connections 2023-10-25T23:36:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.867+0000 7fb5f2afd700 1 -- 172.21.15.81:0/3046548490 wait complete. 2023-10-25T23:36:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.869+0000 7fb5f2afd700 1 Processor -- start 2023-10-25T23:36:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.869+0000 7fb5f2afd700 1 -- start start 2023-10-25T23:36:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.870+0000 7fb5f2afd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5ec06bb80 0x7fb5ec097e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.870+0000 7fb5f2afd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5ec0a4290 0x7fb5ec158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.870+0000 7fb5f2afd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5ec0bb860 0x7fb5ec158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.870+0000 7fb5f2afd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec1f1f40 con 0x7fb5ec0bb860 2023-10-25T23:36:15.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.870+0000 7fb5f2afd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec15aca0 con 0x7fb5ec0a4290 2023-10-25T23:36:15.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.870+0000 7fb5f2afd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec1f1c60 con 0x7fb5ec06bb80 2023-10-25T23:36:15.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.871+0000 7fb5f109a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5ec0bb860 0x7fb5ec158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.871+0000 7fb5f109a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5ec0bb860 0x7fb5ec158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36528/0 (socket says 172.21.15.81:36528) 2023-10-25T23:36:15.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.871+0000 7fb5f109a700 1 -- 172.21.15.81:0/171808816 learned_addr learned my addr 172.21.15.81:0/171808816 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:15.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.871+0000 7fb5f109a700 1 -- 172.21.15.81:0/171808816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5ec06bb80 msgr2=0x7fb5ec097e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.871+0000 7fb5f109a700 1 --2- 172.21.15.81:0/171808816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5ec06bb80 0x7fb5ec097e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.871+0000 7fb5f109a700 1 -- 172.21.15.81:0/171808816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5ec0a4290 msgr2=0x7fb5ec158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:15.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.871+0000 7fb5f109a700 1 --2- 172.21.15.81:0/171808816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5ec0a4290 0x7fb5ec158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:15.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.871+0000 7fb5f109a700 1 -- 172.21.15.81:0/171808816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e4009d00 con 0x7fb5ec0bb860 2023-10-25T23:36:15.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.872+0000 7fb5f109a700 1 --2- 172.21.15.81:0/171808816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5ec0bb860 0x7fb5ec158bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00b4a0 tx=0x7fb5dc00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.873+0000 7fb5e97fa700 1 -- 172.21.15.81:0/171808816 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc011830 con 0x7fb5ec0bb860 2023-10-25T23:36:15.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.873+0000 7fb5e97fa700 1 -- 172.21.15.81:0/171808816 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb5dc011aa0 con 0x7fb5ec0bb860 2023-10-25T23:36:15.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.873+0000 7fb5e97fa700 1 -- 172.21.15.81:0/171808816 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc010380 con 0x7fb5ec0bb860 2023-10-25T23:36:15.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.873+0000 7fb5f2afd700 1 -- 172.21.15.81:0/171808816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ec15af40 con 0x7fb5ec0bb860 2023-10-25T23:36:15.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.873+0000 7fb5f2afd700 1 -- 172.21.15.81:0/171808816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ec1577b0 con 0x7fb5ec0bb860 2023-10-25T23:36:15.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.877+0000 7fb5e97fa700 1 -- 172.21.15.81:0/171808816 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb5dc0104e0 con 0x7fb5ec0bb860 2023-10-25T23:36:15.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.877+0000 7fb5e97fa700 1 --2- 172.21.15.81:0/171808816 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fb5d806afa0 0x7fb5d806d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:15.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.878+0000 7fb5e97fa700 1 -- 172.21.15.81:0/171808816 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5dc089970 con 0x7fb5ec0bb860 2023-10-25T23:36:15.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.879+0000 7fb5f0899700 1 --2- 172.21.15.81:0/171808816 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fb5d806afa0 0x7fb5d806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:15.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.880+0000 7fb5f2afd700 1 -- 172.21.15.81:0/171808816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5cc0052f0 con 0x7fb5ec0bb860 2023-10-25T23:36:15.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.886+0000 7fb5f0899700 1 --2- 172.21.15.81:0/171808816 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fb5d806afa0 0x7fb5d806d460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400b070 tx=0x7fb5e4004ad0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:15.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:15.890+0000 7fb5e97fa700 1 -- 172.21.15.81:0/171808816 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb5dc054a00 con 0x7fb5ec0bb860 2023-10-25T23:36:16.224 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.224+0000 7f7441837700 1 -- 172.21.15.81:0/2581538913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f741c005160 con 0x7f743c0bb860 2023-10-25T23:36:16.225 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.224+0000 7f7423fff700 1 -- 172.21.15.81:0/2581538913 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f742c0574f0 con 0x7f743c0bb860 2023-10-25T23:36:16.229 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-25T23:36:16.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.228+0000 7f7441837700 1 -- 172.21.15.81:0/2581538913 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f742806af20 msgr2=0x7f742806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:16.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.228+0000 7f7441837700 1 --2- 172.21.15.81:0/2581538913 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f742806af20 0x7f742806d3e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7434000f80 tx=0x7f7434004b40 comp rx=0 tx=0).stop 2023-10-25T23:36:16.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.228+0000 7f7441837700 1 -- 172.21.15.81:0/2581538913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f743c0bb860 msgr2=0x7f743c1f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:16.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.228+0000 7f7441837700 1 --2- 172.21.15.81:0/2581538913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f743c0bb860 0x7f743c1f2580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f742c00c480 tx=0x7f742c00c840 comp rx=0 tx=0).stop 2023-10-25T23:36:16.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.228+0000 7f7441837700 1 -- 172.21.15.81:0/2581538913 shutdown_connections 2023-10-25T23:36:16.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.228+0000 7f7441837700 1 --2- 172.21.15.81:0/2581538913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f743c0bb860 0x7f743c1f2580 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.228+0000 7f7441837700 1 --2- 172.21.15.81:0/2581538913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f743c06bb80 0x7f743c0b9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.228+0000 7f7441837700 1 --2- 172.21.15.81:0/2581538913 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f742806af20 0x7f742806d3e0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7434000f80 tx=0x7f7434004b40 comp rx=0 tx=0).stop 2023-10-25T23:36:16.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.228+0000 7f7441837700 1 --2- 172.21.15.81:0/2581538913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f743c0a4290 0x7f743c153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.228+0000 7f7441837700 1 -- 172.21.15.81:0/2581538913 >> 172.21.15.81:0/2581538913 conn(0x7f743c0bf7c0 msgr2=0x7f743c0bde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:16.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.229+0000 7f7441837700 1 -- 172.21.15.81:0/2581538913 shutdown_connections 2023-10-25T23:36:16.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.229+0000 7f7441837700 1 -- 172.21.15.81:0/2581538913 wait complete. 2023-10-25T23:36:16.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.231+0000 7f92caa13700 1 -- 172.21.15.81:0/32340357 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f92c406fd50 con 0x7f92c40b6730 2023-10-25T23:36:16.237 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.237+0000 7f92c0ff9700 1 -- 172.21.15.81:0/32340357 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f92c406fd50 con 0x7f92c40b6730 2023-10-25T23:36:16.239 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-25T23:36:16.240 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.239+0000 7f94766d9700 1 -- 172.21.15.81:0/644020609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f947004e4c0 con 0x7f9458005410 2023-10-25T23:36:16.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.240+0000 7f946cff9700 1 -- 172.21.15.81:0/644020609 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9464058750 con 0x7f9458005410 2023-10-25T23:36:16.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.240+0000 7f92caa13700 1 -- 172.21.15.81:0/32340357 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f92ac06afc0 msgr2=0x7f92ac06d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:16.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.240+0000 7f92caa13700 1 --2- 172.21.15.81:0/32340357 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f92ac06afc0 0x7f92ac06d480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f92b4005720 tx=0x7f92b4007ee0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.240+0000 7f92caa13700 1 -- 172.21.15.81:0/32340357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c40b6730 msgr2=0x7f92c4145030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:16.242 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.240+0000 7f92caa13700 1 --2- 172.21.15.81:0/32340357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c40b6730 0x7f92c4145030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009fd0 tx=0x7f92b80176a0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.242 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2023-10-25T23:36:16.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.241+0000 7f92caa13700 1 -- 172.21.15.81:0/32340357 shutdown_connections 2023-10-25T23:36:16.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.241+0000 7f92caa13700 1 --2- 172.21.15.81:0/32340357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92c40bb8b0 0x7f92c41eb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.241+0000 7f92caa13700 1 --2- 172.21.15.81:0/32340357 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f92ac06afc0 0x7f92ac06d480 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.241+0000 7f92caa13700 1 --2- 172.21.15.81:0/32340357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92c40b56d0 0x7f92c4144af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.243 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.241+0000 7f92caa13700 1 --2- 172.21.15.81:0/32340357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92c40b6730 0x7f92c4145030 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.241+0000 7f92caa13700 1 -- 172.21.15.81:0/32340357 >> 172.21.15.81:0/32340357 conn(0x7f92c40bc290 msgr2=0x7f92c414a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:16.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.241+0000 7f92caa13700 1 -- 172.21.15.81:0/32340357 shutdown_connections 2023-10-25T23:36:16.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.241+0000 7f92caa13700 1 -- 172.21.15.81:0/32340357 wait complete. 2023-10-25T23:36:16.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.243+0000 7fe9745d3700 1 -- 172.21.15.81:0/1998582044 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe96c1e98c0 con 0x7fe96c0a3510 2023-10-25T23:36:16.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.244+0000 7f94766d9700 1 -- 172.21.15.81:0/644020609 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f945c06aed0 msgr2=0x7f945c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:16.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.244+0000 7f94766d9700 1 --2- 172.21.15.81:0/644020609 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f945c06aed0 0x7f945c06d390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f94700becf0 tx=0x7f946000b260 comp rx=0 tx=0).stop 2023-10-25T23:36:16.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.244+0000 7f94766d9700 1 -- 172.21.15.81:0/644020609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9458005410 msgr2=0x7f94700b8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:16.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.244+0000 7f94766d9700 1 --2- 172.21.15.81:0/644020609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9458005410 0x7f94700b8e70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9464004e20 tx=0x7f9464001540 comp rx=0 tx=0).stop 2023-10-25T23:36:16.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.244+0000 7fe962ffd700 1 -- 172.21.15.81:0/1998582044 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe964017070 con 0x7fe96c0a3510 2023-10-25T23:36:16.247 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2023-10-25T23:36:16.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.245+0000 7f94766d9700 1 -- 172.21.15.81:0/644020609 shutdown_connections 2023-10-25T23:36:16.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.245+0000 7f94766d9700 1 --2- 172.21.15.81:0/644020609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94701ebc80 0x7f94701ec100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.245+0000 7f94766d9700 1 --2- 172.21.15.81:0/644020609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9458005410 0x7f94700b8e70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.245+0000 7f94766d9700 1 --2- 172.21.15.81:0/644020609 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f945c06aed0 0x7f945c06d390 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.245+0000 7f94766d9700 1 --2- 172.21.15.81:0/644020609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9470147c50 0x7f94701480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.245+0000 7f94766d9700 1 -- 172.21.15.81:0/644020609 >> 172.21.15.81:0/644020609 conn(0x7f94700bf7c0 msgr2=0x7f9470070840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:16.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.246+0000 7f909adb0700 1 -- 172.21.15.81:0/1432560762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f90940670a0 con 0x7f909406bb80 2023-10-25T23:36:16.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.246+0000 7fe9745d3700 1 -- 172.21.15.81:0/1998582044 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe95006afa0 msgr2=0x7fe95006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:16.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.246+0000 7fe9745d3700 1 --2- 172.21.15.81:0/1998582044 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe95006afa0 0x7fe95006d460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009770 tx=0x7fe95c006cd0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.246+0000 7fe9745d3700 1 -- 172.21.15.81:0/1998582044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe96c0a3510 msgr2=0x7fe96c0b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:16.249 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.246+0000 7fe9745d3700 1 --2- 172.21.15.81:0/1998582044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe96c0a3510 0x7fe96c0b3a10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe96400b070 tx=0x7fe96400bf30 comp rx=0 tx=0).stop 2023-10-25T23:36:16.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.247+0000 7f90917fa700 1 -- 172.21.15.81:0/1432560762 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f90880595b0 con 0x7f909406bb80 2023-10-25T23:36:16.250 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.246+0000 7fe9745d3700 1 -- 172.21.15.81:0/1998582044 shutdown_connections 2023-10-25T23:36:16.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.246+0000 7fe9745d3700 1 --2- 172.21.15.81:0/1998582044 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe95006afa0 0x7fe95006d460 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.246+0000 7fe9745d3700 1 --2- 172.21.15.81:0/1998582044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe96c0bf090 0x7fe96c0b7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.246+0000 7fe9745d3700 1 --2- 172.21.15.81:0/1998582044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe96c0a3510 0x7fe96c0b3a10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.246+0000 7fe9745d3700 1 --2- 172.21.15.81:0/1998582044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe96c0bb8a0 0x7fe96c0b7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.251 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.247+0000 7fe9745d3700 1 -- 172.21.15.81:0/1998582044 >> 172.21.15.81:0/1998582044 conn(0x7fe96c0bf7c0 msgr2=0x7fe96c155810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:16.252 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.247+0000 7fe9745d3700 1 -- 172.21.15.81:0/1998582044 shutdown_connections 2023-10-25T23:36:16.252 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2023-10-25T23:36:16.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.247+0000 7f94766d9700 1 -- 172.21.15.81:0/644020609 shutdown_connections 2023-10-25T23:36:16.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.247+0000 7f94766d9700 1 -- 172.21.15.81:0/644020609 wait complete. 2023-10-25T23:36:16.253 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.247+0000 7f777e46d700 1 -- 172.21.15.81:0/1828779625 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7758005160 con 0x7f7778151c50 2023-10-25T23:36:16.254 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.247+0000 7fe9745d3700 1 -- 172.21.15.81:0/1998582044 wait complete. 2023-10-25T23:36:16.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-10-25T23:36:16.255 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.248+0000 7f7774ff9700 1 -- 172.21.15.81:0/1828779625 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7768017090 con 0x7f7778151c50 2023-10-25T23:36:16.255 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2023-10-25T23:36:16.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.251+0000 7f777e46d700 1 -- 172.21.15.81:0/1828779625 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f776406af20 msgr2=0x7f776406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:16.256 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.251+0000 7f777e46d700 1 --2- 172.21.15.81:0/1828779625 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f776406af20 0x7f776406d3e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7770009550 tx=0x7f7770004b40 comp rx=0 tx=0).stop 2023-10-25T23:36:16.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.251+0000 7f777e46d700 1 -- 172.21.15.81:0/1828779625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7778151c50 msgr2=0x7f777814ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:16.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.251+0000 7f777e46d700 1 --2- 172.21.15.81:0/1828779625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7778151c50 0x7f777814ba00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f776800c520 tx=0x7f776800c830 comp rx=0 tx=0).stop 2023-10-25T23:36:16.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.251+0000 7f777e46d700 1 -- 172.21.15.81:0/1828779625 shutdown_connections 2023-10-25T23:36:16.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.251+0000 7f777e46d700 1 --2- 172.21.15.81:0/1828779625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7778156d00 0x7f77781e3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.257 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.251+0000 7f777e46d700 1 --2- 172.21.15.81:0/1828779625 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f776406af20 0x7f776406d3e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.251+0000 7f777e46d700 1 --2- 172.21.15.81:0/1828779625 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f777806bca0 0x7f777814c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.251+0000 7f777e46d700 1 --2- 172.21.15.81:0/1828779625 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7778151c50 0x7f777814ba00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.251+0000 7f777e46d700 1 -- 172.21.15.81:0/1828779625 >> 172.21.15.81:0/1828779625 conn(0x7f77780c3c10 msgr2=0x7f777806c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.251+0000 7f777e46d700 1 -- 172.21.15.81:0/1828779625 shutdown_connections 2023-10-25T23:36:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.251+0000 7f777e46d700 1 -- 172.21.15.81:0/1828779625 wait complete. 2023-10-25T23:36:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.252+0000 7f8c675e0700 1 -- 172.21.15.81:0/2091727091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8c6014c110 con 0x7f8c600bb860 2023-10-25T23:36:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.253+0000 7f909adb0700 1 -- 172.21.15.81:0/1432560762 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f907806aed0 msgr2=0x7f907806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.253+0000 7f909adb0700 1 --2- 172.21.15.81:0/1432560762 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f907806aed0 0x7f907806d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9094152fd0 tx=0x7f9080009310 comp rx=0 tx=0).stop 2023-10-25T23:36:16.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.253+0000 7f909adb0700 1 -- 172.21.15.81:0/1432560762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f909406bb80 msgr2=0x7f9094158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:16.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.253+0000 7f909adb0700 1 --2- 172.21.15.81:0/1432560762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f909406bb80 0x7f9094158740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f90940a4ee0 tx=0x7f908800f740 comp rx=0 tx=0).stop 2023-10-25T23:36:16.260 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.255+0000 7f8c55ffb700 1 -- 172.21.15.81:0/2091727091 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8c6014c110 con 0x7f8c600bb860 2023-10-25T23:36:16.261 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2023-10-25T23:36:16.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.256+0000 7f909adb0700 1 -- 172.21.15.81:0/1432560762 shutdown_connections 2023-10-25T23:36:16.261 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.256+0000 7f909adb0700 1 --2- 172.21.15.81:0/1432560762 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f90940bb860 0x7f9094159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.256+0000 7f909adb0700 1 --2- 172.21.15.81:0/1432560762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f909406bb80 0x7f9094158740 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.256+0000 7f909adb0700 1 --2- 172.21.15.81:0/1432560762 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f907806aed0 0x7f907806d390 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.256+0000 7f909adb0700 1 --2- 172.21.15.81:0/1432560762 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90940a4290 0x7f90941f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.262 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.256+0000 7f909adb0700 1 -- 172.21.15.81:0/1432560762 >> 172.21.15.81:0/1432560762 conn(0x7f90940bf7c0 msgr2=0x7f90940a2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:16.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.256+0000 7f909adb0700 1 -- 172.21.15.81:0/1432560762 shutdown_connections 2023-10-25T23:36:16.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.256+0000 7f909adb0700 1 -- 172.21.15.81:0/1432560762 wait complete. 2023-10-25T23:36:16.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.263+0000 7f8c675e0700 1 -- 172.21.15.81:0/2091727091 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f8c4406aed0 msgr2=0x7f8c4406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:16.263 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.263+0000 7f8c675e0700 1 --2- 172.21.15.81:0/2091727091 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f8c4406aed0 0x7f8c4406d390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8c50001a40 tx=0x7f8c50009040 comp rx=0 tx=0).stop 2023-10-25T23:36:16.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.263+0000 7f8c675e0700 1 -- 172.21.15.81:0/2091727091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c600bb860 msgr2=0x7f8c600b96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:16.264 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.263+0000 7f8c675e0700 1 --2- 172.21.15.81:0/2091727091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c600bb860 0x7f8c600b96c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8c58014000 tx=0x7f8c5800bf20 comp rx=0 tx=0).stop 2023-10-25T23:36:16.265 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.265+0000 7f8c675e0700 1 -- 172.21.15.81:0/2091727091 shutdown_connections 2023-10-25T23:36:16.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.265+0000 7f8c675e0700 1 --2- 172.21.15.81:0/2091727091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c600bb860 0x7f8c600b96c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.265+0000 7f8c675e0700 1 --2- 172.21.15.81:0/2091727091 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f8c4406aed0 0x7f8c4406d390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.265+0000 7f8c675e0700 1 --2- 172.21.15.81:0/2091727091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c6006bb80 0x7f8c600702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.265+0000 7f8c675e0700 1 --2- 172.21.15.81:0/2091727091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8c600a4290 0x7f8c600b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.266 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.265+0000 7f8c675e0700 1 -- 172.21.15.81:0/2091727091 >> 172.21.15.81:0/2091727091 conn(0x7f8c600bf7c0 msgr2=0x7f8c6006a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:16.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2023-10-25T23:36:16.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.267+0000 7f8c675e0700 1 -- 172.21.15.81:0/2091727091 shutdown_connections 2023-10-25T23:36:16.268 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.267+0000 7f8c675e0700 1 -- 172.21.15.81:0/2091727091 wait complete. 2023-10-25T23:36:16.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2023-10-25T23:36:16.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2023-10-25T23:36:16.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-10-25T23:36:16.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.275+0000 7fb5f2afd700 1 -- 172.21.15.81:0/171808816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb5cc0055a0 con 0x7fb5ec0bb860 2023-10-25T23:36:16.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.276+0000 7fb5e97fa700 1 -- 172.21.15.81:0/171808816 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb5dc015070 con 0x7fb5ec0bb860 2023-10-25T23:36:16.277 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2023-10-25T23:36:16.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.278+0000 7fb5f2afd700 1 -- 172.21.15.81:0/171808816 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fb5d806afa0 msgr2=0x7fb5d806d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:16.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.278+0000 7fb5f2afd700 1 --2- 172.21.15.81:0/171808816 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fb5d806afa0 0x7fb5d806d460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400b070 tx=0x7fb5e4004ad0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.278+0000 7fb5f2afd700 1 -- 172.21.15.81:0/171808816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5ec0bb860 msgr2=0x7fb5ec158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:16.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.278+0000 7fb5f2afd700 1 --2- 172.21.15.81:0/171808816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5ec0bb860 0x7fb5ec158bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00b4a0 tx=0x7fb5dc00b860 comp rx=0 tx=0).stop 2023-10-25T23:36:16.280 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-25T23:36:16.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.278+0000 7fb5f2afd700 1 -- 172.21.15.81:0/171808816 shutdown_connections 2023-10-25T23:36:16.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.278+0000 7fb5f2afd700 1 --2- 172.21.15.81:0/171808816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5ec0bb860 0x7fb5ec158bb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.278+0000 7fb5f2afd700 1 --2- 172.21.15.81:0/171808816 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb5ec06bb80 0x7fb5ec097e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.278+0000 7fb5f2afd700 1 --2- 172.21.15.81:0/171808816 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fb5d806afa0 0x7fb5d806d460 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.278+0000 7fb5f2afd700 1 --2- 172.21.15.81:0/171808816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5ec0a4290 0x7fb5ec158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:16.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.278+0000 7fb5f2afd700 1 -- 172.21.15.81:0/171808816 >> 172.21.15.81:0/171808816 conn(0x7fb5ec0bf7c0 msgr2=0x7fb5ec0a2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:16.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.279+0000 7fb5f2afd700 1 -- 172.21.15.81:0/171808816 shutdown_connections 2023-10-25T23:36:16.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:16.279+0000 7fb5f2afd700 1 -- 172.21.15.81:0/171808816 wait complete. 2023-10-25T23:36:16.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2023-10-25T23:36:16.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2023-10-25T23:36:17.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-25T23:36:17.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-25T23:36:17.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-25T23:36:17.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-25T23:36:17.276 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-25T23:36:17.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-25T23:36:17.284 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-25T23:36:17.292 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-25T23:36:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.472+0000 7f687e63a700 1 -- 172.21.15.81:0/64231613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780a4290 msgr2=0x7f68780ba970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.472+0000 7f687e63a700 1 --2- 172.21.15.81:0/64231613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780a4290 0x7f68780ba970 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f68680098c0 tx=0x7f6868009bd0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.472+0000 7f687e63a700 1 -- 172.21.15.81:0/64231613 shutdown_connections 2023-10-25T23:36:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.472+0000 7f687e63a700 1 --2- 172.21.15.81:0/64231613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780a4290 0x7f68780ba970 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.472+0000 7f687e63a700 1 -- 172.21.15.81:0/64231613 >> 172.21.15.81:0/64231613 conn(0x7f68780bf7c0 msgr2=0x7f68780bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.472+0000 7f687e63a700 1 -- 172.21.15.81:0/64231613 shutdown_connections 2023-10-25T23:36:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.472+0000 7f687e63a700 1 -- 172.21.15.81:0/64231613 wait complete. 2023-10-25T23:36:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.474+0000 7f687e63a700 1 Processor -- start 2023-10-25T23:36:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.474+0000 7f687e63a700 1 -- start start 2023-10-25T23:36:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.475+0000 7f687e63a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f687806bb80 0x7f68780b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.475+0000 7f687e63a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68780a4290 0x7f68781ebfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.475+0000 7f687e63a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780bb860 0x7f68781ec500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.475+0000 7f687e63a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68781496b0 con 0x7f68780a4290 2023-10-25T23:36:17.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.475+0000 7f687e63a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68781485a0 con 0x7f68780bb860 2023-10-25T23:36:17.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.475+0000 7f687e63a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68781493d0 con 0x7f687806bb80 2023-10-25T23:36:17.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.476+0000 7f68777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68780a4290 0x7f68781ebfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.476+0000 7f68777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68780a4290 0x7f68781ebfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36542/0 (socket says 172.21.15.81:36542) 2023-10-25T23:36:17.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.476+0000 7f68777fe700 1 -- 172.21.15.81:0/123474248 learned_addr learned my addr 172.21.15.81:0/123474248 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.477+0000 7f6877fff700 1 --2- 172.21.15.81:0/123474248 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f687806bb80 0x7f68780b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.477+0000 7f68777fe700 1 -- 172.21.15.81:0/123474248 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f687806bb80 msgr2=0x7f68780b6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.477+0000 7f68777fe700 1 --2- 172.21.15.81:0/123474248 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f687806bb80 0x7f68780b6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.477+0000 7f68777fe700 1 -- 172.21.15.81:0/123474248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780bb860 msgr2=0x7f68781ec500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.477+0000 7f687cbd7700 1 --2- 172.21.15.81:0/123474248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780bb860 0x7f68781ec500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.477+0000 7f68777fe700 1 --2- 172.21.15.81:0/123474248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780bb860 0x7f68781ec500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.477+0000 7f68777fe700 1 -- 172.21.15.81:0/123474248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6868009520 con 0x7f68780a4290 2023-10-25T23:36:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.477+0000 7f68777fe700 1 --2- 172.21.15.81:0/123474248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68780a4290 0x7f68781ebfc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f686c00c4a0 tx=0x7f686c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.479+0000 7f6874ff9700 1 -- 172.21.15.81:0/123474248 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c0054e0 con 0x7f68780a4290 2023-10-25T23:36:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.479+0000 7f6874ff9700 1 -- 172.21.15.81:0/123474248 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f686c003680 con 0x7f68780a4290 2023-10-25T23:36:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.479+0000 7f6874ff9700 1 -- 172.21.15.81:0/123474248 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c003a70 con 0x7f68780a4290 2023-10-25T23:36:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.479+0000 7f687e63a700 1 -- 172.21.15.81:0/123474248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687814f360 con 0x7f68780a4290 2023-10-25T23:36:17.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.479+0000 7f687e63a700 1 -- 172.21.15.81:0/123474248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68781ecae0 con 0x7f68780a4290 2023-10-25T23:36:17.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.488+0000 7f6874ff9700 1 -- 172.21.15.81:0/123474248 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f686c003bd0 con 0x7f68780a4290 2023-10-25T23:36:17.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.488+0000 7f6874ff9700 1 --2- 172.21.15.81:0/123474248 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f686006b470 0x7f686006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.490 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.489+0000 7f6874ff9700 1 -- 172.21.15.81:0/123474248 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f686c088af0 con 0x7f68780a4290 2023-10-25T23:36:17.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.494+0000 7f687e63a700 1 -- 172.21.15.81:0/123474248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68580052f0 con 0x7f68780a4290 2023-10-25T23:36:17.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.494+0000 7f6877fff700 1 --2- 172.21.15.81:0/123474248 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f686006b470 0x7f686006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.498+0000 7f6877fff700 1 --2- 172.21.15.81:0/123474248 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f686006b470 0x7f686006d930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6870001560 tx=0x7f6870009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:17.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.503+0000 7f6874ff9700 1 -- 172.21.15.81:0/123474248 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f686c017020 con 0x7f68780a4290 2023-10-25T23:36:17.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.518+0000 7f4210a3d700 1 -- 172.21.15.81:0/13363321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420c0bbad0 msgr2=0x7f420c0ba970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.518+0000 7f4210a3d700 1 --2- 172.21.15.81:0/13363321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420c0bbad0 0x7f420c0ba970 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4204005fd0 tx=0x7f4204009c70 comp rx=0 tx=0).stop 2023-10-25T23:36:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.518+0000 7fd917f50700 1 -- 172.21.15.81:0/3443077751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd91006bb80 msgr2=0x7fd9100bbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.518+0000 7fd917f50700 1 --2- 172.21.15.81:0/3443077751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd91006bb80 0x7fd9100bbc40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd9100c0790 tx=0x7fd90c009ba0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.518+0000 7f4210a3d700 1 -- 172.21.15.81:0/13363321 shutdown_connections 2023-10-25T23:36:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.518+0000 7f4210a3d700 1 --2- 172.21.15.81:0/13363321 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420c0bbad0 0x7f420c0ba970 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.518+0000 7f4210a3d700 1 --2- 172.21.15.81:0/13363321 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f420c0a4290 0x7f420c06cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.518+0000 7f4210a3d700 1 -- 172.21.15.81:0/13363321 >> 172.21.15.81:0/13363321 conn(0x7f420c0bf7c0 msgr2=0x7f420c0bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.518+0000 7fd917f50700 1 -- 172.21.15.81:0/3443077751 shutdown_connections 2023-10-25T23:36:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.518+0000 7fd917f50700 1 --2- 172.21.15.81:0/3443077751 >> v2:172.21.15.89:3300/0 conn(0x7fd9100bb860 0x7fd9100ba970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.518+0000 7fd917f50700 1 --2- 172.21.15.81:0/3443077751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd91006bb80 0x7fd9100bbc40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.518+0000 7fd917f50700 1 -- 172.21.15.81:0/3443077751 >> 172.21.15.81:0/3443077751 conn(0x7fd9100bf7c0 msgr2=0x7fd9100bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:17.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.518+0000 7f4210a3d700 1 -- 172.21.15.81:0/13363321 shutdown_connections 2023-10-25T23:36:17.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.518+0000 7fd917f50700 1 -- 172.21.15.81:0/3443077751 shutdown_connections 2023-10-25T23:36:17.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.519+0000 7f8260a23700 1 -- 172.21.15.81:0/3103685650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f825c0bf090 msgr2=0x7f825c0700a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.519+0000 7f8260a23700 1 --2- 172.21.15.81:0/3103685650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f825c0bf090 0x7f825c0700a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f824c009f60 tx=0x7f824c009f90 comp rx=0 tx=0).stop 2023-10-25T23:36:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.519+0000 7f8260a23700 1 -- 172.21.15.81:0/3103685650 shutdown_connections 2023-10-25T23:36:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.519+0000 7f8260a23700 1 --2- 172.21.15.81:0/3103685650 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c0bb8a0 0x7f825c06e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.519+0000 7f8260a23700 1 --2- 172.21.15.81:0/3103685650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f825c0bf090 0x7f825c0700a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.519+0000 7f8260a23700 1 -- 172.21.15.81:0/3103685650 >> 172.21.15.81:0/3103685650 conn(0x7f825c0bf7c0 msgr2=0x7f825c0bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:17.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.519+0000 7f8260a23700 1 -- 172.21.15.81:0/3103685650 shutdown_connections 2023-10-25T23:36:17.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.518+0000 7f4210a3d700 1 -- 172.21.15.81:0/13363321 wait complete. 2023-10-25T23:36:17.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.520+0000 7f4210a3d700 1 Processor -- start 2023-10-25T23:36:17.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.518+0000 7fd917f50700 1 -- 172.21.15.81:0/3443077751 wait complete. 2023-10-25T23:36:17.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.520+0000 7fd917f50700 1 Processor -- start 2023-10-25T23:36:17.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.519+0000 7f8260a23700 1 -- 172.21.15.81:0/3103685650 wait complete. 2023-10-25T23:36:17.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.520+0000 7f4210a3d700 1 -- start start 2023-10-25T23:36:17.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7f4210a3d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f420c06bb80 0x7f420c1f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7f4210a3d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420c0a4290 0x7f420c09df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7f4210a3d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f420c0bbad0 0x7f420c09cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7f4210a3d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c1f3e50 con 0x7f420c06bb80 2023-10-25T23:36:17.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7f4210a3d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0b30c0 con 0x7f420c0a4290 2023-10-25T23:36:17.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7f4210a3d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c0b6490 con 0x7f420c0bbad0 2023-10-25T23:36:17.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.520+0000 7fd917f50700 1 -- start start 2023-10-25T23:36:17.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7fd917f50700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd91006bb80 0x7fd91009d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7f8260a23700 1 Processor -- start 2023-10-25T23:36:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7fd917f50700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9100a4290 0x7fd9101f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7fd917f50700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9100bb860 0x7fd91009c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7fd917f50700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91015ad10 con 0x7fd9100bb860 2023-10-25T23:36:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7fd917f50700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91009d490 con 0x7fd91006bb80 2023-10-25T23:36:17.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7fd917f50700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9101f5400 con 0x7fd9100a4290 2023-10-25T23:36:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7fd9154eb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9100a4290 0x7fd9101f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7fd9154eb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9100a4290 0x7fd9101f46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:59490/0 (socket says 172.21.15.81:59490) 2023-10-25T23:36:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7fd9154eb700 1 -- 172.21.15.81:0/734574303 learned_addr learned my addr 172.21.15.81:0/734574303 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7f420ad9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f420c0bbad0 0x7f420c09cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7f4209d9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420c0a4290 0x7f420c09df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7f420ad9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f420c0bbad0 0x7f420c09cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:59492/0 (socket says 172.21.15.81:59492) 2023-10-25T23:36:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7f420ad9d700 1 -- 172.21.15.81:0/4206040020 learned_addr learned my addr 172.21.15.81:0/4206040020 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7f420a59c700 1 --2- 172.21.15.81:0/4206040020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f420c06bb80 0x7f420c1f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7fd915cec700 1 --2- 172.21.15.81:0/734574303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd91006bb80 0x7fd91009d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7f420ad9d700 1 -- 172.21.15.81:0/4206040020 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420c0a4290 msgr2=0x7f420c09df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7f420ad9d700 1 --2- 172.21.15.81:0/4206040020 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420c0a4290 0x7f420c09df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7f420ad9d700 1 -- 172.21.15.81:0/4206040020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f420c06bb80 msgr2=0x7f420c1f47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7f420ad9d700 1 --2- 172.21.15.81:0/4206040020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f420c06bb80 0x7f420c1f47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7f420ad9d700 1 -- 172.21.15.81:0/4206040020 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42040095f0 con 0x7f420c0bbad0 2023-10-25T23:36:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7f420ad9d700 1 --2- 172.21.15.81:0/4206040020 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f420c0bbad0 0x7f420c09cb00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f41f400e940 tx=0x7f41f400ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7fd9164ed700 1 --2- 172.21.15.81:0/734574303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9100bb860 0x7fd91009c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7fd9154eb700 1 -- 172.21.15.81:0/734574303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd91006bb80 msgr2=0x7fd91009d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7fd9154eb700 1 --2- 172.21.15.81:0/734574303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd91006bb80 0x7fd91009d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7fd9154eb700 1 -- 172.21.15.81:0/734574303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9100bb860 msgr2=0x7fd91009c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7fd9154eb700 1 --2- 172.21.15.81:0/734574303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9100bb860 0x7fd91009c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7fd9154eb700 1 -- 172.21.15.81:0/734574303 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c009520 con 0x7fd9100a4290 2023-10-25T23:36:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7fd9154eb700 1 --2- 172.21.15.81:0/734574303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9100a4290 0x7fd9101f46a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd90c000c00 tx=0x7fd90c00f710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7fd9067fc700 1 -- 172.21.15.81:0/734574303 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c00be90 con 0x7fd9100a4290 2023-10-25T23:36:17.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7fd9067fc700 1 -- 172.21.15.81:0/734574303 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd90c00fb10 con 0x7fd9100a4290 2023-10-25T23:36:17.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7fd9067fc700 1 -- 172.21.15.81:0/734574303 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c017400 con 0x7fd9100a4290 2023-10-25T23:36:17.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7f4202ffd700 1 -- 172.21.15.81:0/4206040020 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f40097b0 con 0x7f420c0bbad0 2023-10-25T23:36:17.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7f4202ffd700 1 -- 172.21.15.81:0/4206040020 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f41f400cbd0 con 0x7f420c0bbad0 2023-10-25T23:36:17.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7f4202ffd700 1 -- 172.21.15.81:0/4206040020 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f400ee90 con 0x7f420c0bbad0 2023-10-25T23:36:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7f4210a3d700 1 -- 172.21.15.81:0/4206040020 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420c1f4320 con 0x7f420c0bbad0 2023-10-25T23:36:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.521+0000 7f8260a23700 1 -- start start 2023-10-25T23:36:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7f8260a23700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f825c0bb8a0 0x7f825c09b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7f8260a23700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f825c0bd670 0x7f825c098680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7f8260a23700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c0bf090 0x7f825c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7f8260a23700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c09bd50 con 0x7f825c0bd670 2023-10-25T23:36:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7f8260a23700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c15c390 con 0x7f825c0bb8a0 2023-10-25T23:36:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7f8260a23700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c071970 con 0x7f825c0bf090 2023-10-25T23:36:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.523+0000 7f8259d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f825c0bd670 0x7f825c098680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.523+0000 7f8259d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f825c0bd670 0x7f825c098680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36584/0 (socket says 172.21.15.81:36584) 2023-10-25T23:36:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.523+0000 7f8259d9b700 1 -- 172.21.15.81:0/105528387 learned_addr learned my addr 172.21.15.81:0/105528387 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.523+0000 7f8259d9b700 1 -- 172.21.15.81:0/105528387 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c0bf090 msgr2=0x7f825c0b8af0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-25T23:36:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.523+0000 7f8259d9b700 1 --2- 172.21.15.81:0/105528387 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c0bf090 0x7f825c0b8af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.523+0000 7f8259d9b700 1 -- 172.21.15.81:0/105528387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f825c0bb8a0 msgr2=0x7f825c09b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.523+0000 7f8259d9b700 1 --2- 172.21.15.81:0/105528387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f825c0bb8a0 0x7f825c09b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.523+0000 7f8259d9b700 1 -- 172.21.15.81:0/105528387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c009c40 con 0x7f825c0bd670 2023-10-25T23:36:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7f4210a3d700 1 -- 172.21.15.81:0/4206040020 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c1f4d10 con 0x7f420c0bbad0 2023-10-25T23:36:17.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.522+0000 7fd917f50700 1 -- 172.21.15.81:0/734574303 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91009e7b0 con 0x7fd9100a4290 2023-10-25T23:36:17.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.523+0000 7fd917f50700 1 -- 172.21.15.81:0/734574303 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91009bb40 con 0x7fd9100a4290 2023-10-25T23:36:17.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.524+0000 7fd917f50700 1 -- 172.21.15.81:0/734574303 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9100670a0 con 0x7fd9100a4290 2023-10-25T23:36:17.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.524+0000 7f4202ffd700 1 -- 172.21.15.81:0/4206040020 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f41f4021430 con 0x7f420c0bbad0 2023-10-25T23:36:17.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.525+0000 7f8259d9b700 1 --2- 172.21.15.81:0/105528387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f825c0bd670 0x7f825c098680 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f824c009040 tx=0x7f824c003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:17.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.525+0000 7f4210a3d700 1 -- 172.21.15.81:0/4206040020 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ec0052f0 con 0x7f420c0bbad0 2023-10-25T23:36:17.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.525+0000 7f8252ffd700 1 -- 172.21.15.81:0/105528387 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c00e040 con 0x7f825c0bd670 2023-10-25T23:36:17.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.525+0000 7f8252ffd700 1 -- 172.21.15.81:0/105528387 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f824c004ca0 con 0x7f825c0bd670 2023-10-25T23:36:17.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.525+0000 7f8252ffd700 1 -- 172.21.15.81:0/105528387 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c0045a0 con 0x7f825c0bd670 2023-10-25T23:36:17.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.525+0000 7f8260a23700 1 -- 172.21.15.81:0/105528387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c1f1840 con 0x7f825c0bd670 2023-10-25T23:36:17.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.525+0000 7f8260a23700 1 -- 172.21.15.81:0/105528387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c097e80 con 0x7f825c0bd670 2023-10-25T23:36:17.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.525+0000 7f4202ffd700 1 --2- 172.21.15.81:0/4206040020 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f41f806b010 0x7f41f806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.525+0000 7f4202ffd700 1 -- 172.21.15.81:0/4206040020 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41f4014070 con 0x7f420c0bbad0 2023-10-25T23:36:17.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.526+0000 7f420a59c700 1 --2- 172.21.15.81:0/4206040020 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f41f806b010 0x7f41f806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.526+0000 7f420a59c700 1 --2- 172.21.15.81:0/4206040020 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f41f806b010 0x7f41f806d4d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4204000c00 tx=0x7f4204019040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:17.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.527+0000 7fb9512e2700 1 -- 172.21.15.81:0/1149571001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb94c0bb860 msgr2=0x7fb94c0ba970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.527+0000 7fb9512e2700 1 --2- 172.21.15.81:0/1149571001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb94c0bb860 0x7fb94c0ba970 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb93c0098c0 tx=0x7fb93c009bd0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.527+0000 7fb9512e2700 1 -- 172.21.15.81:0/1149571001 shutdown_connections 2023-10-25T23:36:17.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.527+0000 7fb9512e2700 1 --2- 172.21.15.81:0/1149571001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb94c0bb860 0x7fb94c0ba970 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.527+0000 7fb9512e2700 1 -- 172.21.15.81:0/1149571001 >> 172.21.15.81:0/1149571001 conn(0x7fb94c0bf7c0 msgr2=0x7fb94c0bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:17.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.527+0000 7fb9512e2700 1 -- 172.21.15.81:0/1149571001 shutdown_connections 2023-10-25T23:36:17.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.528+0000 7fd9067fc700 1 -- 172.21.15.81:0/734574303 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd90c017560 con 0x7fd9100a4290 2023-10-25T23:36:17.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.528+0000 7fd9067fc700 1 --2- 172.21.15.81:0/734574303 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd8fc06b330 0x7fd8fc06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.528+0000 7fd9067fc700 1 -- 172.21.15.81:0/734574303 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd90c08bee0 con 0x7fd9100a4290 2023-10-25T23:36:17.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.528+0000 7fd915cec700 1 --2- 172.21.15.81:0/734574303 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd8fc06b330 0x7fd8fc06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.527+0000 7fb9512e2700 1 -- 172.21.15.81:0/1149571001 wait complete. 2023-10-25T23:36:17.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.529+0000 7fb9512e2700 1 Processor -- start 2023-10-25T23:36:17.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.528+0000 7f8260a23700 1 -- 172.21.15.81:0/105528387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82400052f0 con 0x7f825c0bd670 2023-10-25T23:36:17.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.528+0000 7f8252ffd700 1 -- 172.21.15.81:0/105528387 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f824c019070 con 0x7f825c0bd670 2023-10-25T23:36:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.528+0000 7f8252ffd700 1 --2- 172.21.15.81:0/105528387 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f823c06af00 0x7f823c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.529+0000 7f8252ffd700 1 -- 172.21.15.81:0/105528387 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f824c08a4b0 con 0x7f825c0bd670 2023-10-25T23:36:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.529+0000 7f825a59c700 1 --2- 172.21.15.81:0/105528387 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f823c06af00 0x7f823c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.530+0000 7f825a59c700 1 --2- 172.21.15.81:0/105528387 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f823c06af00 0x7f823c06d3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8244005950 tx=0x7f82440058e0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.529+0000 7fb9512e2700 1 -- start start 2023-10-25T23:36:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.530+0000 7fb9512e2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb94c06bb80 0x7fb94c158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.530+0000 7fb9512e2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb94c0a4290 0x7fb94c0a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.530+0000 7fb9512e2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb94c0bb860 0x7fb94c0a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.530+0000 7fb9512e2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c097ab0 con 0x7fb94c0bb860 2023-10-25T23:36:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.530+0000 7fb9512e2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c159a20 con 0x7fb94c06bb80 2023-10-25T23:36:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.530+0000 7fb9512e2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c159130 con 0x7fb94c0a4290 2023-10-25T23:36:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.529+0000 7fd915cec700 1 --2- 172.21.15.81:0/734574303 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd8fc06b330 0x7fd8fc06d7f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd900009bc0 tx=0x7fd900009260 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.530+0000 7fb94b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb94c0bb860 0x7fb94c0a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.530+0000 7fb94b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb94c0bb860 0x7fb94c0a0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36614/0 (socket says 172.21.15.81:36614) 2023-10-25T23:36:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.530+0000 7fb94b7fe700 1 -- 172.21.15.81:0/135377222 learned_addr learned my addr 172.21.15.81:0/135377222 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.531+0000 7fb94b7fe700 1 -- 172.21.15.81:0/135377222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb94c0a4290 msgr2=0x7fb94c0a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.531+0000 7fb94b7fe700 1 --2- 172.21.15.81:0/135377222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb94c0a4290 0x7fb94c0a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.531+0000 7fb94b7fe700 1 -- 172.21.15.81:0/135377222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb94c06bb80 msgr2=0x7fb94c158bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-25T23:36:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.531+0000 7fb94b7fe700 1 --2- 172.21.15.81:0/135377222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb94c06bb80 0x7fb94c158bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.531+0000 7fb94b7fe700 1 -- 172.21.15.81:0/135377222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c009520 con 0x7fb94c0bb860 2023-10-25T23:36:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.531+0000 7fb94b7fe700 1 --2- 172.21.15.81:0/135377222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb94c0bb860 0x7fb94c0a0920 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb94400c8c0 tx=0x7fb94400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:17.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.532+0000 7fe81246b700 1 -- 172.21.15.81:0/1026066840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7f4005960 msgr2=0x7fe7f4005de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.532+0000 7fe81246b700 1 --2- 172.21.15.81:0/1026066840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7f4005960 0x7fe7f4005de0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe800005fd0 tx=0x7fe7f4006990 comp rx=0 tx=0).stop 2023-10-25T23:36:17.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.532+0000 7fe81246b700 1 -- 172.21.15.81:0/1026066840 shutdown_connections 2023-10-25T23:36:17.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.532+0000 7fe81246b700 1 --2- 172.21.15.81:0/1026066840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7f4005960 0x7fe7f4005de0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.532+0000 7fe81246b700 1 -- 172.21.15.81:0/1026066840 >> 172.21.15.81:0/1026066840 conn(0x7fe80c06d9b0 msgr2=0x7fe80c06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:17.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.532+0000 7fe81246b700 1 -- 172.21.15.81:0/1026066840 shutdown_connections 2023-10-25T23:36:17.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.532+0000 7fe81246b700 1 -- 172.21.15.81:0/1026066840 wait complete. 2023-10-25T23:36:17.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.533+0000 7fe81246b700 1 Processor -- start 2023-10-25T23:36:17.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.533+0000 7fe81246b700 1 -- start start 2023-10-25T23:36:17.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.534+0000 7fd9067fc700 1 -- 172.21.15.81:0/734574303 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd90c057010 con 0x7fd9100a4290 2023-10-25T23:36:17.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.534+0000 7fe81246b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7f4005960 0x7fe80c0a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.534+0000 7fe81246b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe80c13e730 0x7fe80c139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.534+0000 7fe81246b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe80c13ebb0 0x7fe80c1e0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.534+0000 7fe81246b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c13db60 con 0x7fe80c13e730 2023-10-25T23:36:17.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.534+0000 7fe81246b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c13a880 con 0x7fe80c13ebb0 2023-10-25T23:36:17.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.534+0000 7fe81246b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0a4930 con 0x7fe7f4005960 2023-10-25T23:36:17.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.534+0000 7fe80b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe80c13e730 0x7fe80c139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.534+0000 7fe80bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7f4005960 0x7fe80c0a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.534+0000 7fe810a08700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe80c13ebb0 0x7fe80c1e0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.534+0000 7fe80b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe80c13e730 0x7fe80c139e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36622/0 (socket says 172.21.15.81:36622) 2023-10-25T23:36:17.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.534+0000 7fe810a08700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe80c13ebb0 0x7fe80c1e0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.81:56694/0 (socket says 172.21.15.81:56694) 2023-10-25T23:36:17.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.534+0000 7fe80b7fe700 1 -- 172.21.15.81:0/1022705349 learned_addr learned my addr 172.21.15.81:0/1022705349 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:17.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.534+0000 7fe80bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7f4005960 0x7fe80c0a43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.81:59536/0 (socket says 172.21.15.81:59536) 2023-10-25T23:36:17.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.535+0000 7fe80b7fe700 1 -- 172.21.15.81:0/1022705349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7f4005960 msgr2=0x7fe80c0a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.535+0000 7fe80b7fe700 1 --2- 172.21.15.81:0/1022705349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7f4005960 0x7fe80c0a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.535+0000 7fe80b7fe700 1 -- 172.21.15.81:0/1022705349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe80c13ebb0 msgr2=0x7fe80c1e0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.566 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.535+0000 7fe80b7fe700 1 --2- 172.21.15.81:0/1022705349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe80c13ebb0 0x7fe80c1e0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.535+0000 7fe80b7fe700 1 -- 172.21.15.81:0/1022705349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c140440 con 0x7fe80c13e730 2023-10-25T23:36:17.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.535+0000 7fe80b7fe700 1 --2- 172.21.15.81:0/1022705349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe80c13e730 0x7fe80c139e80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400d4d0 tx=0x7fe800003930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:17.567 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.535+0000 7f4202ffd700 1 -- 172.21.15.81:0/4206040020 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41f4058af0 con 0x7f420c0bbad0 2023-10-25T23:36:17.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.536+0000 7f0b10a7f700 1 -- 172.21.15.81:0/1487427906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b0c0a3510 msgr2=0x7f0b0c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.536+0000 7f0b10a7f700 1 --2- 172.21.15.81:0/1487427906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b0c0a3510 0x7f0b0c06e3c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009f90 tx=0x7f0b0400b330 comp rx=0 tx=0).stop 2023-10-25T23:36:17.568 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.536+0000 7f0b10a7f700 1 -- 172.21.15.81:0/1487427906 shutdown_connections 2023-10-25T23:36:17.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.536+0000 7f0b10a7f700 1 --2- 172.21.15.81:0/1487427906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b0c0a3510 0x7f0b0c06e3c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.536+0000 7f0b10a7f700 1 -- 172.21.15.81:0/1487427906 >> 172.21.15.81:0/1487427906 conn(0x7f0b0c0bf7c0 msgr2=0x7f0b0c0bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:17.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.536+0000 7f0b10a7f700 1 -- 172.21.15.81:0/1487427906 shutdown_connections 2023-10-25T23:36:17.569 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.536+0000 7f0b10a7f700 1 -- 172.21.15.81:0/1487427906 wait complete. 2023-10-25T23:36:17.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.538+0000 7fb9337fe700 1 -- 172.21.15.81:0/135377222 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944003e30 con 0x7fb94c0bb860 2023-10-25T23:36:17.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.538+0000 7f8252ffd700 1 -- 172.21.15.81:0/105528387 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f824c0555f0 con 0x7f825c0bd670 2023-10-25T23:36:17.570 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.538+0000 7f0b10a7f700 1 Processor -- start 2023-10-25T23:36:17.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.538+0000 7f0b10a7f700 1 -- start start 2023-10-25T23:36:17.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.538+0000 7fb9337fe700 1 -- 172.21.15.81:0/135377222 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb944005070 con 0x7fb94c0bb860 2023-10-25T23:36:17.571 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.538+0000 7fb9337fe700 1 -- 172.21.15.81:0/135377222 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944005480 con 0x7fb94c0bb860 2023-10-25T23:36:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.539+0000 7fb9512e2700 1 -- 172.21.15.81:0/135377222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94c1f22d0 con 0x7fb94c0bb860 2023-10-25T23:36:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.539+0000 7fb9512e2700 1 -- 172.21.15.81:0/135377222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94c159c70 con 0x7fb94c0bb860 2023-10-25T23:36:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.539+0000 7f0b10a7f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b0c0a3510 0x7f0b0c1d5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.539+0000 7f0b10a7f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b0c0bb8a0 0x7f0b0c097db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.539+0000 7f0b10a7f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b0c0bf090 0x7f0b0c0b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.539+0000 7f0b10a7f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0c1e05c0 con 0x7f0b0c0bf090 2023-10-25T23:36:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.539+0000 7f0b10a7f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0c1e02e0 con 0x7f0b0c0bb8a0 2023-10-25T23:36:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.539+0000 7f0b10a7f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0c0b4610 con 0x7f0b0c0a3510 2023-10-25T23:36:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.540+0000 7f0b09d9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b0c0bb8a0 0x7f0b0c097db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.540+0000 7f0b0ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b0c0bf090 0x7f0b0c0b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.540+0000 7f0b0ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b0c0bf090 0x7f0b0c0b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36626/0 (socket says 172.21.15.81:36626) 2023-10-25T23:36:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.540+0000 7f0b0ad9d700 1 -- 172.21.15.81:0/1762941839 learned_addr learned my addr 172.21.15.81:0/1762941839 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.540+0000 7f0b0ad9d700 1 -- 172.21.15.81:0/1762941839 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b0c0a3510 msgr2=0x7f0b0c1d5d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-25T23:36:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.540+0000 7f0b0ad9d700 1 --2- 172.21.15.81:0/1762941839 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b0c0a3510 0x7f0b0c1d5d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.540+0000 7f0b0ad9d700 1 -- 172.21.15.81:0/1762941839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b0c0bb8a0 msgr2=0x7f0b0c097db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.540+0000 7f0b0ad9d700 1 --2- 172.21.15.81:0/1762941839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b0c0bb8a0 0x7f0b0c097db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.540+0000 7f0b0ad9d700 1 -- 172.21.15.81:0/1762941839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b04009c40 con 0x7f0b0c0bf090 2023-10-25T23:36:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.540+0000 7f0b0ad9d700 1 --2- 172.21.15.81:0/1762941839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b0c0bf090 0x7f0b0c0b50f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0af400c410 tx=0x7f0af400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.541+0000 7f0b02ffd700 1 -- 172.21.15.81:0/1762941839 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af40225a0 con 0x7f0b0c0bf090 2023-10-25T23:36:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.541+0000 7f0b02ffd700 1 -- 172.21.15.81:0/1762941839 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0af40227f0 con 0x7f0b0c0bf090 2023-10-25T23:36:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.541+0000 7f0b02ffd700 1 -- 172.21.15.81:0/1762941839 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4022bc0 con 0x7f0b0c0bf090 2023-10-25T23:36:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.541+0000 7f0b10a7f700 1 -- 172.21.15.81:0/1762941839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b0c0b48f0 con 0x7f0b0c0bf090 2023-10-25T23:36:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.541+0000 7f0b10a7f700 1 -- 172.21.15.81:0/1762941839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b0c0b6270 con 0x7f0b0c0bf090 2023-10-25T23:36:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.542+0000 7f0b10a7f700 1 -- 172.21.15.81:0/1762941839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b0c0b4470 con 0x7f0b0c0bf090 2023-10-25T23:36:17.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.543+0000 7fb9512e2700 1 -- 172.21.15.81:0/135377222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94c0670a0 con 0x7fb94c0bb860 2023-10-25T23:36:17.578 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.543+0000 7f0b02ffd700 1 -- 172.21.15.81:0/1762941839 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0af4022d20 con 0x7f0b0c0bf090 2023-10-25T23:36:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.544+0000 7f56bc203700 1 -- 172.21.15.81:0/2459774839 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56b40a4290 msgr2=0x7f56b40ba970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.544+0000 7f56bc203700 1 --2- 172.21.15.81:0/2459774839 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56b40a4290 0x7f56b40ba970 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009f90 tx=0x7f56ac00b330 comp rx=0 tx=0).stop 2023-10-25T23:36:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.544+0000 7f0b02ffd700 1 --2- 172.21.15.81:0/1762941839 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0aec06aed0 0x7f0aec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.544+0000 7f56bc203700 1 -- 172.21.15.81:0/2459774839 shutdown_connections 2023-10-25T23:36:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.544+0000 7f56bc203700 1 --2- 172.21.15.81:0/2459774839 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56b40a4290 0x7f56b40ba970 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.544+0000 7f56bc203700 1 -- 172.21.15.81:0/2459774839 >> 172.21.15.81:0/2459774839 conn(0x7f56b40bf7c0 msgr2=0x7f56b40bfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.544+0000 7f0b02ffd700 1 -- 172.21.15.81:0/1762941839 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0af409a3e0 con 0x7f0b0c0bf090 2023-10-25T23:36:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.544+0000 7f0b0a59c700 1 --2- 172.21.15.81:0/1762941839 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0aec06aed0 0x7f0aec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.544+0000 7f0b0a59c700 1 --2- 172.21.15.81:0/1762941839 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0aec06aed0 0x7f0aec06d390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0b04000f80 tx=0x7f0b04004b40 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:17.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.548+0000 7fe808ff9700 1 -- 172.21.15.81:0/1022705349 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800010040 con 0x7fe80c13e730 2023-10-25T23:36:17.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.548+0000 7fe808ff9700 1 -- 172.21.15.81:0/1022705349 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe800003d30 con 0x7fe80c13e730 2023-10-25T23:36:17.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.548+0000 7fe808ff9700 1 -- 172.21.15.81:0/1022705349 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe800018040 con 0x7fe80c13e730 2023-10-25T23:36:17.582 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.548+0000 7fe81246b700 1 -- 172.21.15.81:0/1022705349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80c13d780 con 0x7fe80c13e730 2023-10-25T23:36:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.548+0000 7fe81246b700 1 -- 172.21.15.81:0/1022705349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c13adb0 con 0x7fe80c13e730 2023-10-25T23:36:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.548+0000 7f0b02ffd700 1 -- 172.21.15.81:0/1762941839 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0b0c0b4470 con 0x7f0b0c0bf090 2023-10-25T23:36:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.551+0000 7f56bc203700 1 -- 172.21.15.81:0/2459774839 shutdown_connections 2023-10-25T23:36:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.551+0000 7fb9337fe700 1 -- 172.21.15.81:0/135377222 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb9440055e0 con 0x7fb94c0bb860 2023-10-25T23:36:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.551+0000 7fb9337fe700 1 --2- 172.21.15.81:0/135377222 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fb93806aed0 0x7fb93806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.551+0000 7fb9337fe700 1 -- 172.21.15.81:0/135377222 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9440893b0 con 0x7fb94c0bb860 2023-10-25T23:36:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.550+0000 7fe808ff9700 1 -- 172.21.15.81:0/1022705349 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe80000d820 con 0x7fe80c13e730 2023-10-25T23:36:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.551+0000 7fe808ff9700 1 --2- 172.21.15.81:0/1022705349 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe7f806af20 0x7fe7f806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.551+0000 7fe808ff9700 1 -- 172.21.15.81:0/1022705349 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe80008a250 con 0x7fe80c13e730 2023-10-25T23:36:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.551+0000 7fb94affd700 1 --2- 172.21.15.81:0/135377222 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fb93806aed0 0x7fb93806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.552+0000 7fb94affd700 1 --2- 172.21.15.81:0/135377222 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fb93806aed0 0x7fb93806d390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009810 tx=0x7fb93c0047c0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.551+0000 7f56bc203700 1 -- 172.21.15.81:0/2459774839 wait complete. 2023-10-25T23:36:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.552+0000 7f56bc203700 1 Processor -- start 2023-10-25T23:36:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.552+0000 7f56bc203700 1 -- start start 2023-10-25T23:36:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.553+0000 7fe81246b700 1 -- 172.21.15.81:0/1022705349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c067490 con 0x7fe80c13e730 2023-10-25T23:36:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.553+0000 7f56bc203700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b406bb80 0x7f56b409ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.553+0000 7f56bc203700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56b40a4290 0x7f56b409b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.553+0000 7f56bc203700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b41f12a0 0x7f56b4099da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.553+0000 7f56bc203700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b409e050 con 0x7f56b406bb80 2023-10-25T23:36:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.553+0000 7f56bc203700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b41f2790 con 0x7f56b41f12a0 2023-10-25T23:36:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.553+0000 7f56bc203700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b4098d00 con 0x7f56b40a4290 2023-10-25T23:36:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.553+0000 7f56b9f9f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b406bb80 0x7f56b409ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.553+0000 7f56b9f9f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b406bb80 0x7f56b409ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36638/0 (socket says 172.21.15.81:36638) 2023-10-25T23:36:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.553+0000 7f56b9f9f700 1 -- 172.21.15.81:0/3040302445 learned_addr learned my addr 172.21.15.81:0/3040302445 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.554+0000 7f56ba7a0700 1 --2- 172.21.15.81:0/3040302445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b41f12a0 0x7f56b4099da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.554+0000 7f56b979e700 1 --2- 172.21.15.81:0/3040302445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56b40a4290 0x7f56b409b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.554+0000 7f56b9f9f700 1 -- 172.21.15.81:0/3040302445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56b40a4290 msgr2=0x7f56b409b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.554+0000 7f56b9f9f700 1 --2- 172.21.15.81:0/3040302445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56b40a4290 0x7f56b409b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.554+0000 7f56b9f9f700 1 -- 172.21.15.81:0/3040302445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b41f12a0 msgr2=0x7f56b4099da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.554+0000 7f56b9f9f700 1 --2- 172.21.15.81:0/3040302445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b41f12a0 0x7f56b4099da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.554+0000 7f56b9f9f700 1 -- 172.21.15.81:0/3040302445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ac009c40 con 0x7f56b406bb80 2023-10-25T23:36:17.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.554+0000 7f56b9f9f700 1 --2- 172.21.15.81:0/3040302445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b406bb80 0x7f56b409ea50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f56b000c430 tx=0x7f56b000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:17.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.555+0000 7f56ba7a0700 1 --2- 172.21.15.81:0/3040302445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b41f12a0 0x7f56b4099da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:36:17.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.557+0000 7f56b979e700 1 --2- 172.21.15.81:0/3040302445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56b40a4290 0x7f56b409b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:36:17.592 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.558+0000 7fb9337fe700 1 -- 172.21.15.81:0/135377222 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb9440544d0 con 0x7fb94c0bb860 2023-10-25T23:36:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.558+0000 7f56aa7fc700 1 -- 172.21.15.81:0/3040302445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b0011790 con 0x7f56b406bb80 2023-10-25T23:36:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.558+0000 7f56aa7fc700 1 -- 172.21.15.81:0/3040302445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f56b00119e0 con 0x7f56b406bb80 2023-10-25T23:36:17.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.558+0000 7f56aa7fc700 1 -- 172.21.15.81:0/3040302445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b0011db0 con 0x7f56b406bb80 2023-10-25T23:36:17.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.560+0000 7f56bc203700 1 -- 172.21.15.81:0/3040302445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b4098fe0 con 0x7f56b406bb80 2023-10-25T23:36:17.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.560+0000 7f56bc203700 1 -- 172.21.15.81:0/3040302445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b40995a0 con 0x7f56b406bb80 2023-10-25T23:36:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.569+0000 7fe808ff9700 1 -- 172.21.15.81:0/1022705349 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe800055370 con 0x7fe80c13e730 2023-10-25T23:36:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.571+0000 7fe80bfff700 1 --2- 172.21.15.81:0/1022705349 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe7f806af20 0x7fe7f806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.571+0000 7fe80bfff700 1 --2- 172.21.15.81:0/1022705349 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe7f806af20 0x7fe7f806d3e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe80c063ee0 tx=0x7fe7fc006be0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:17.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.574+0000 7f56bc203700 1 -- 172.21.15.81:0/3040302445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b40670a0 con 0x7f56b406bb80 2023-10-25T23:36:17.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.583+0000 7f56aa7fc700 1 -- 172.21.15.81:0/3040302445 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f56b001c460 con 0x7f56b406bb80 2023-10-25T23:36:17.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.583+0000 7f56aa7fc700 1 --2- 172.21.15.81:0/3040302445 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f56a006b130 0x7f56a006d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:17.596 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.583+0000 7f56aa7fc700 1 -- 172.21.15.81:0/3040302445 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56b0089510 con 0x7f56b406bb80 2023-10-25T23:36:17.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.585+0000 7f56b979e700 1 --2- 172.21.15.81:0/3040302445 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f56a006b130 0x7f56a006d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:17.597 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.593+0000 7f56aa7fc700 1 -- 172.21.15.81:0/3040302445 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f56b0054630 con 0x7f56b406bb80 2023-10-25T23:36:17.618 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.618+0000 7f56b979e700 1 --2- 172.21.15.81:0/3040302445 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f56a006b130 0x7f56a006d5f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f56b409aea0 tx=0x7f56a4009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.912+0000 7fd917f50700 1 -- 172.21.15.81:0/734574303 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd91004e4c0 con 0x7fd9100a4290 2023-10-25T23:36:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.912+0000 7fd9067fc700 1 -- 172.21.15.81:0/734574303 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd90c05a630 con 0x7fd9100a4290 2023-10-25T23:36:17.916 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2023-10-25T23:36:17.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.916+0000 7f687e63a700 1 -- 172.21.15.81:0/123474248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f68580055a0 con 0x7f68780a4290 2023-10-25T23:36:17.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.916+0000 7fd917f50700 1 -- 172.21.15.81:0/734574303 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd8fc06b330 msgr2=0x7fd8fc06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.916+0000 7fd917f50700 1 --2- 172.21.15.81:0/734574303 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd8fc06b330 0x7fd8fc06d7f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd900009bc0 tx=0x7fd900009260 comp rx=0 tx=0).stop 2023-10-25T23:36:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.916+0000 7fd917f50700 1 -- 172.21.15.81:0/734574303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9100a4290 msgr2=0x7fd9101f46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.916+0000 7fd917f50700 1 --2- 172.21.15.81:0/734574303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9100a4290 0x7fd9101f46a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd90c000c00 tx=0x7fd90c00f710 comp rx=0 tx=0).stop 2023-10-25T23:36:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.917+0000 7fd917f50700 1 -- 172.21.15.81:0/734574303 shutdown_connections 2023-10-25T23:36:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.917+0000 7fd917f50700 1 --2- 172.21.15.81:0/734574303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9100bb860 0x7fd91009c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.917+0000 7fd917f50700 1 --2- 172.21.15.81:0/734574303 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd8fc06b330 0x7fd8fc06d7f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.917+0000 7fd917f50700 1 --2- 172.21.15.81:0/734574303 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd91006bb80 0x7fd91009d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.917+0000 7fd917f50700 1 --2- 172.21.15.81:0/734574303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9100a4290 0x7fd9101f46a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.917+0000 7fd917f50700 1 -- 172.21.15.81:0/734574303 >> 172.21.15.81:0/734574303 conn(0x7fd9100bf7c0 msgr2=0x7fd9100a0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:17.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.917+0000 7fd917f50700 1 -- 172.21.15.81:0/734574303 shutdown_connections 2023-10-25T23:36:17.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.917+0000 7fd917f50700 1 -- 172.21.15.81:0/734574303 wait complete. 2023-10-25T23:36:17.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.917+0000 7f6874ff9700 1 -- 172.21.15.81:0/123474248 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f686c053cc0 con 0x7f68780a4290 2023-10-25T23:36:17.920 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-25T23:36:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.926+0000 7f687e63a700 1 -- 172.21.15.81:0/123474248 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f686006b470 msgr2=0x7f686006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.926+0000 7f687e63a700 1 --2- 172.21.15.81:0/123474248 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f686006b470 0x7f686006d930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6870001560 tx=0x7f6870009040 comp rx=0 tx=0).stop 2023-10-25T23:36:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.926+0000 7f687e63a700 1 -- 172.21.15.81:0/123474248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68780a4290 msgr2=0x7f68781ebfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.926+0000 7f687e63a700 1 --2- 172.21.15.81:0/123474248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68780a4290 0x7f68781ebfc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f686c00c4a0 tx=0x7f686c00c860 comp rx=0 tx=0).stop 2023-10-25T23:36:17.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.926+0000 7f687e63a700 1 -- 172.21.15.81:0/123474248 shutdown_connections 2023-10-25T23:36:17.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.926+0000 7f687e63a700 1 --2- 172.21.15.81:0/123474248 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f686006b470 0x7f686006d930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.926+0000 7f687e63a700 1 --2- 172.21.15.81:0/123474248 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68780bb860 0x7f68781ec500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.926+0000 7f687e63a700 1 --2- 172.21.15.81:0/123474248 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f687806bb80 0x7f68780b6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.926+0000 7f687e63a700 1 --2- 172.21.15.81:0/123474248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68780a4290 0x7f68781ebfc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.926+0000 7f687e63a700 1 -- 172.21.15.81:0/123474248 >> 172.21.15.81:0/123474248 conn(0x7f68780bf7c0 msgr2=0x7f68780bde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:17.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.927+0000 7f687e63a700 1 -- 172.21.15.81:0/123474248 shutdown_connections 2023-10-25T23:36:17.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.927+0000 7f687e63a700 1 -- 172.21.15.81:0/123474248 wait complete. 2023-10-25T23:36:17.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.1 2023-10-25T23:36:17.937 DEBUG:teuthology.parallel:result is None 2023-10-25T23:36:17.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.944+0000 7f8260a23700 1 -- 172.21.15.81:0/105528387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8240005160 con 0x7f825c0bd670 2023-10-25T23:36:17.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.945+0000 7f8252ffd700 1 -- 172.21.15.81:0/105528387 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f824c021020 con 0x7f825c0bd670 2023-10-25T23:36:17.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.4 2023-10-25T23:36:17.947 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2023-10-25T23:36:17.947 DEBUG:teuthology.parallel:result is None 2023-10-25T23:36:17.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.947+0000 7f4210a3d700 1 -- 172.21.15.81:0/4206040020 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f41ec005870 con 0x7f420c0bbad0 2023-10-25T23:36:17.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.947+0000 7f4202ffd700 1 -- 172.21.15.81:0/4206040020 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f41f4058680 con 0x7f420c0bbad0 2023-10-25T23:36:17.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.948+0000 7f8260a23700 1 -- 172.21.15.81:0/105528387 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f823c06af00 msgr2=0x7f823c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.948+0000 7f8260a23700 1 --2- 172.21.15.81:0/105528387 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f823c06af00 0x7f823c06d3c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8244005950 tx=0x7f82440058e0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.948+0000 7f8260a23700 1 -- 172.21.15.81:0/105528387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f825c0bd670 msgr2=0x7f825c098680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.948+0000 7f8260a23700 1 --2- 172.21.15.81:0/105528387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f825c0bd670 0x7f825c098680 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f824c009040 tx=0x7f824c003f30 comp rx=0 tx=0).stop 2023-10-25T23:36:17.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.948+0000 7f8260a23700 1 -- 172.21.15.81:0/105528387 shutdown_connections 2023-10-25T23:36:17.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.948+0000 7f8260a23700 1 --2- 172.21.15.81:0/105528387 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f825c0bf090 0x7f825c0b8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.948+0000 7f8260a23700 1 --2- 172.21.15.81:0/105528387 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f823c06af00 0x7f823c06d3c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.948+0000 7f8260a23700 1 --2- 172.21.15.81:0/105528387 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f825c0bb8a0 0x7f825c09b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.948+0000 7f8260a23700 1 --2- 172.21.15.81:0/105528387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f825c0bd670 0x7f825c098680 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.948+0000 7f8260a23700 1 -- 172.21.15.81:0/105528387 >> 172.21.15.81:0/105528387 conn(0x7f825c0bf7c0 msgr2=0x7f825c09f270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:17.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.948+0000 7f8260a23700 1 -- 172.21.15.81:0/105528387 shutdown_connections 2023-10-25T23:36:17.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.948+0000 7f8260a23700 1 -- 172.21.15.81:0/105528387 wait complete. 2023-10-25T23:36:17.953 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2023-10-25T23:36:17.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.951+0000 7fb9512e2700 1 -- 172.21.15.81:0/135377222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb94c04e4c0 con 0x7fb94c0bb860 2023-10-25T23:36:17.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.951+0000 7fb9337fe700 1 -- 172.21.15.81:0/135377222 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb944017090 con 0x7fb94c0bb860 2023-10-25T23:36:17.954 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2023-10-25T23:36:17.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.953+0000 7f4210a3d700 1 -- 172.21.15.81:0/4206040020 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f41f806b010 msgr2=0x7f41f806d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.953+0000 7f4210a3d700 1 --2- 172.21.15.81:0/4206040020 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f41f806b010 0x7f41f806d4d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4204000c00 tx=0x7f4204019040 comp rx=0 tx=0).stop 2023-10-25T23:36:17.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.953+0000 7f4210a3d700 1 -- 172.21.15.81:0/4206040020 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f420c0bbad0 msgr2=0x7f420c09cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.953+0000 7f4210a3d700 1 --2- 172.21.15.81:0/4206040020 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f420c0bbad0 0x7f420c09cb00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f41f400e940 tx=0x7f41f400ec50 comp rx=0 tx=0).stop 2023-10-25T23:36:17.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.953+0000 7fb9512e2700 1 -- 172.21.15.81:0/135377222 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fb93806aed0 msgr2=0x7fb93806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.953+0000 7fb9512e2700 1 --2- 172.21.15.81:0/135377222 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fb93806aed0 0x7fb93806d390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009810 tx=0x7fb93c0047c0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.953+0000 7fb9512e2700 1 -- 172.21.15.81:0/135377222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb94c0bb860 msgr2=0x7fb94c0a0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.956 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.953+0000 7fb9512e2700 1 --2- 172.21.15.81:0/135377222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb94c0bb860 0x7fb94c0a0920 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb94400c8c0 tx=0x7fb94400cc80 comp rx=0 tx=0).stop 2023-10-25T23:36:17.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.957+0000 7fb9512e2700 1 -- 172.21.15.81:0/135377222 shutdown_connections 2023-10-25T23:36:17.957 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.957+0000 7fb9512e2700 1 --2- 172.21.15.81:0/135377222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb94c0bb860 0x7fb94c0a0920 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.957+0000 7fb9512e2700 1 --2- 172.21.15.81:0/135377222 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fb93806aed0 0x7fb93806d390 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.957+0000 7fb9512e2700 1 --2- 172.21.15.81:0/135377222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb94c06bb80 0x7fb94c158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.957+0000 7fb9512e2700 1 --2- 172.21.15.81:0/135377222 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb94c0a4290 0x7fb94c0a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.958 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.957+0000 7fb9512e2700 1 -- 172.21.15.81:0/135377222 >> 172.21.15.81:0/135377222 conn(0x7fb94c0bf7c0 msgr2=0x7fb94c0a2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:17.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.957+0000 7f4210a3d700 1 -- 172.21.15.81:0/4206040020 shutdown_connections 2023-10-25T23:36:17.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.957+0000 7f4210a3d700 1 --2- 172.21.15.81:0/4206040020 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f420c0bbad0 0x7f420c09cb00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.957+0000 7f4210a3d700 1 --2- 172.21.15.81:0/4206040020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f420c06bb80 0x7f420c1f47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.959 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.957+0000 7f4210a3d700 1 --2- 172.21.15.81:0/4206040020 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f41f806b010 0x7f41f806d4d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.957+0000 7f4210a3d700 1 --2- 172.21.15.81:0/4206040020 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f420c0a4290 0x7f420c09df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.957+0000 7f4210a3d700 1 -- 172.21.15.81:0/4206040020 >> 172.21.15.81:0/4206040020 conn(0x7f420c0bf7c0 msgr2=0x7f420c06aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:17.960 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.957+0000 7fb9512e2700 1 -- 172.21.15.81:0/135377222 shutdown_connections 2023-10-25T23:36:17.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.957+0000 7f4210a3d700 1 -- 172.21.15.81:0/4206040020 shutdown_connections 2023-10-25T23:36:17.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.957+0000 7f4210a3d700 1 -- 172.21.15.81:0/4206040020 wait complete. 2023-10-25T23:36:17.961 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.957+0000 7fb9512e2700 1 -- 172.21.15.81:0/135377222 wait complete. 2023-10-25T23:36:17.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.958+0000 7f0b10a7f700 1 -- 172.21.15.81:0/1762941839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0b0c0b4e10 con 0x7f0b0c0bf090 2023-10-25T23:36:17.962 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.959+0000 7f0b02ffd700 1 -- 172.21.15.81:0/1762941839 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0b0c0b4e10 con 0x7f0b0c0bf090 2023-10-25T23:36:17.962 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2023-10-25T23:36:17.963 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.962+0000 7f0b10a7f700 1 -- 172.21.15.81:0/1762941839 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0aec06aed0 msgr2=0x7f0aec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.962+0000 7f0b10a7f700 1 --2- 172.21.15.81:0/1762941839 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0aec06aed0 0x7f0aec06d390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0b04000f80 tx=0x7f0b04004b40 comp rx=0 tx=0).stop 2023-10-25T23:36:17.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.962+0000 7f0b10a7f700 1 -- 172.21.15.81:0/1762941839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b0c0bf090 msgr2=0x7f0b0c0b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.962+0000 7f0b10a7f700 1 --2- 172.21.15.81:0/1762941839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b0c0bf090 0x7f0b0c0b50f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0af400c410 tx=0x7f0af400c7d0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.963+0000 7f0b10a7f700 1 -- 172.21.15.81:0/1762941839 shutdown_connections 2023-10-25T23:36:17.964 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.963+0000 7f0b10a7f700 1 --2- 172.21.15.81:0/1762941839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b0c0bf090 0x7f0b0c0b50f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.963+0000 7f0b10a7f700 1 --2- 172.21.15.81:0/1762941839 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b0c0a3510 0x7f0b0c1d5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.963+0000 7f0b10a7f700 1 --2- 172.21.15.81:0/1762941839 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0aec06aed0 0x7f0aec06d390 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.963+0000 7f0b10a7f700 1 --2- 172.21.15.81:0/1762941839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b0c0bb8a0 0x7f0b0c097db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.963+0000 7f0b10a7f700 1 -- 172.21.15.81:0/1762941839 >> 172.21.15.81:0/1762941839 conn(0x7f0b0c0bf7c0 msgr2=0x7f0b0c06aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:17.965 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.963+0000 7f0b10a7f700 1 -- 172.21.15.81:0/1762941839 shutdown_connections 2023-10-25T23:36:17.966 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.963+0000 7f0b10a7f700 1 -- 172.21.15.81:0/1762941839 wait complete. 2023-10-25T23:36:17.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.2 2023-10-25T23:36:17.967 DEBUG:teuthology.parallel:result is None 2023-10-25T23:36:17.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.0 2023-10-25T23:36:17.973 DEBUG:teuthology.parallel:result is None 2023-10-25T23:36:17.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.975+0000 7fe81246b700 1 -- 172.21.15.81:0/1022705349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe80c04e4c0 con 0x7fe80c13e730 2023-10-25T23:36:17.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.976+0000 7fe808ff9700 1 -- 172.21.15.81:0/1022705349 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe800022070 con 0x7fe80c13e730 2023-10-25T23:36:17.977 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2023-10-25T23:36:17.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.3 2023-10-25T23:36:17.980 DEBUG:teuthology.parallel:result is None 2023-10-25T23:36:17.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.979+0000 7fe81246b700 1 -- 172.21.15.81:0/1022705349 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe7f806af20 msgr2=0x7fe7f806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.979+0000 7fe81246b700 1 --2- 172.21.15.81:0/1022705349 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe7f806af20 0x7fe7f806d3e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe80c063ee0 tx=0x7fe7fc006be0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.979+0000 7fe81246b700 1 -- 172.21.15.81:0/1022705349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe80c13e730 msgr2=0x7fe80c139e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.979+0000 7fe81246b700 1 --2- 172.21.15.81:0/1022705349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe80c13e730 0x7fe80c139e80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400d4d0 tx=0x7fe800003930 comp rx=0 tx=0).stop 2023-10-25T23:36:17.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.979+0000 7fe81246b700 1 -- 172.21.15.81:0/1022705349 shutdown_connections 2023-10-25T23:36:17.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.979+0000 7fe81246b700 1 --2- 172.21.15.81:0/1022705349 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe7f806af20 0x7fe7f806d3e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.979+0000 7fe81246b700 1 --2- 172.21.15.81:0/1022705349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe80c13ebb0 0x7fe80c1e0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.979+0000 7fe81246b700 1 --2- 172.21.15.81:0/1022705349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7f4005960 0x7fe80c0a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.979+0000 7fe81246b700 1 --2- 172.21.15.81:0/1022705349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe80c13e730 0x7fe80c139e80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.979+0000 7fe81246b700 1 -- 172.21.15.81:0/1022705349 >> 172.21.15.81:0/1022705349 conn(0x7fe80c06d9b0 msgr2=0x7fe80c13c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:17.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.979+0000 7fe81246b700 1 -- 172.21.15.81:0/1022705349 shutdown_connections 2023-10-25T23:36:17.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.979+0000 7fe81246b700 1 -- 172.21.15.81:0/1022705349 wait complete. 2023-10-25T23:36:17.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.980+0000 7f56bc203700 1 -- 172.21.15.81:0/3040302445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f56b404e4c0 con 0x7f56b406bb80 2023-10-25T23:36:17.984 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.980+0000 7f56aa7fc700 1 -- 172.21.15.81:0/3040302445 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f56b0057c50 con 0x7f56b406bb80 2023-10-25T23:36:17.984 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2023-10-25T23:36:17.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.7 2023-10-25T23:36:17.986 DEBUG:teuthology.parallel:result is None 2023-10-25T23:36:17.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.983+0000 7f56bc203700 1 -- 172.21.15.81:0/3040302445 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f56a006b130 msgr2=0x7f56a006d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.983+0000 7f56bc203700 1 --2- 172.21.15.81:0/3040302445 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f56a006b130 0x7f56a006d5f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f56b409aea0 tx=0x7f56a4009040 comp rx=0 tx=0).stop 2023-10-25T23:36:17.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.983+0000 7f56bc203700 1 -- 172.21.15.81:0/3040302445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b406bb80 msgr2=0x7f56b409ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:17.987 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.983+0000 7f56bc203700 1 --2- 172.21.15.81:0/3040302445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b406bb80 0x7f56b409ea50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f56b000c430 tx=0x7f56b000c7f0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.983+0000 7f56bc203700 1 -- 172.21.15.81:0/3040302445 shutdown_connections 2023-10-25T23:36:17.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.983+0000 7f56bc203700 1 --2- 172.21.15.81:0/3040302445 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f56a006b130 0x7f56a006d5f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.983+0000 7f56bc203700 1 --2- 172.21.15.81:0/3040302445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b41f12a0 0x7f56b4099da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.983+0000 7f56bc203700 1 --2- 172.21.15.81:0/3040302445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56b406bb80 0x7f56b409ea50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.988 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.983+0000 7f56bc203700 1 --2- 172.21.15.81:0/3040302445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56b40a4290 0x7f56b409b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:17.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.983+0000 7f56bc203700 1 -- 172.21.15.81:0/3040302445 >> 172.21.15.81:0/3040302445 conn(0x7f56b40bf7c0 msgr2=0x7f56b40a0460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:17.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.983+0000 7f56bc203700 1 -- 172.21.15.81:0/3040302445 shutdown_connections 2023-10-25T23:36:17.989 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:17.983+0000 7f56bc203700 1 -- 172.21.15.81:0/3040302445 wait complete. 2023-10-25T23:36:17.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.6 2023-10-25T23:36:17.994 DEBUG:teuthology.parallel:result is None 2023-10-25T23:36:17.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.5 2023-10-25T23:36:17.996 DEBUG:teuthology.parallel:result is None 2023-10-25T23:36:17.997 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-25T23:36:17.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T23:36:18.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.158+0000 7f6eb32ef700 1 -- 172.21.15.81:0/446374249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e98004850 msgr2=0x7f6e98004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:18.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.158+0000 7f6eb32ef700 1 --2- 172.21.15.81:0/446374249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e98004850 0x7f6e98004cd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8006f30 tx=0x7f6e98005880 comp rx=0 tx=0).stop 2023-10-25T23:36:18.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.158+0000 7f6eb188c700 1 -- 172.21.15.81:0/446374249 reap_dead start 2023-10-25T23:36:18.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.158+0000 7f6eb32ef700 1 -- 172.21.15.81:0/446374249 shutdown_connections 2023-10-25T23:36:18.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.158+0000 7f6eb32ef700 1 -- 172.21.15.81:0/446374249 >> 172.21.15.81:0/446374249 conn(0x7f6eac0c0a40 msgr2=0x7f6eac0c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:18.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.158+0000 7f6eb32ef700 1 -- 172.21.15.81:0/446374249 shutdown_connections 2023-10-25T23:36:18.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.158+0000 7f6eb32ef700 1 -- 172.21.15.81:0/446374249 wait complete. 2023-10-25T23:36:18.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.159+0000 7f6eb32ef700 1 Processor -- start 2023-10-25T23:36:18.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.159+0000 7f6eb32ef700 1 -- start start 2023-10-25T23:36:18.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.160+0000 7f6eb32ef700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e98004850 0x7f6eac12b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:18.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.160+0000 7f6eb32ef700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6eac1e65b0 0x7f6eac1e23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:18.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.160+0000 7f6eb32ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eac0ba2c0 0x7f6eac0ba770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:18.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.160+0000 7f6eb32ef700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac1d6eb0 con 0x7f6eac0ba2c0 2023-10-25T23:36:18.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.160+0000 7f6eb32ef700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac1e6120 con 0x7f6e98004850 2023-10-25T23:36:18.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.160+0000 7f6eb32ef700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac12bc00 con 0x7f6eac1e65b0 2023-10-25T23:36:18.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.160+0000 7f6eb188c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eac0ba2c0 0x7f6eac0ba770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:18.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.160+0000 7f6eb188c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eac0ba2c0 0x7f6eac0ba770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36664/0 (socket says 172.21.15.81:36664) 2023-10-25T23:36:18.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.160+0000 7f6eb188c700 1 -- 172.21.15.81:0/3177428982 learned_addr learned my addr 172.21.15.81:0/3177428982 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:18.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.161+0000 7f6eb108b700 1 --2- 172.21.15.81:0/3177428982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e98004850 0x7f6eac12b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:18.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.161+0000 7f6eb088a700 1 --2- 172.21.15.81:0/3177428982 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6eac1e65b0 0x7f6eac1e23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:18.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.161+0000 7f6eb188c700 1 -- 172.21.15.81:0/3177428982 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6eac1e65b0 msgr2=0x7f6eac1e23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:18.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.161+0000 7f6eb188c700 1 --2- 172.21.15.81:0/3177428982 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6eac1e65b0 0x7f6eac1e23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.161+0000 7f6eb188c700 1 -- 172.21.15.81:0/3177428982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e98004850 msgr2=0x7f6eac12b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:18.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.161+0000 7f6eb188c700 1 --2- 172.21.15.81:0/3177428982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e98004850 0x7f6eac12b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.161+0000 7f6eb188c700 1 -- 172.21.15.81:0/3177428982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac1d7d40 con 0x7f6eac0ba2c0 2023-10-25T23:36:18.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.161+0000 7f6eb108b700 1 --2- 172.21.15.81:0/3177428982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e98004850 0x7f6eac12b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:36:18.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.161+0000 7f6eb188c700 1 --2- 172.21.15.81:0/3177428982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eac0ba2c0 0x7f6eac0ba770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6eac135c30 tx=0x7f6ea4001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:18.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.161+0000 7f6ea1ffb700 1 -- 172.21.15.81:0/3177428982 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40107d0 con 0x7f6eac0ba2c0 2023-10-25T23:36:18.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.161+0000 7f6ea1ffb700 1 -- 172.21.15.81:0/3177428982 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6ea4010930 con 0x7f6eac0ba2c0 2023-10-25T23:36:18.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.161+0000 7f6eb32ef700 1 -- 172.21.15.81:0/3177428982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac1d6bd0 con 0x7f6eac0ba2c0 2023-10-25T23:36:18.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.161+0000 7f6ea1ffb700 1 -- 172.21.15.81:0/3177428982 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4010d00 con 0x7f6eac0ba2c0 2023-10-25T23:36:18.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.161+0000 7f6eb32ef700 1 -- 172.21.15.81:0/3177428982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac1e5db0 con 0x7f6eac0ba2c0 2023-10-25T23:36:18.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.162+0000 7f6eb32ef700 1 -- 172.21.15.81:0/3177428982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eac1e5930 con 0x7f6eac0ba2c0 2023-10-25T23:36:18.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.162+0000 7f6ea1ffb700 1 -- 172.21.15.81:0/3177428982 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6ea4011460 con 0x7f6eac0ba2c0 2023-10-25T23:36:18.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.163+0000 7f6ea1ffb700 1 --2- 172.21.15.81:0/3177428982 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6e9006aed0 0x7f6e9006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:18.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.163+0000 7f6ea1ffb700 1 -- 172.21.15.81:0/3177428982 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ea4089af0 con 0x7f6eac0ba2c0 2023-10-25T23:36:18.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.163+0000 7f6eb108b700 1 --2- 172.21.15.81:0/3177428982 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6e9006aed0 0x7f6e9006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:18.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.163+0000 7f6eb108b700 1 --2- 172.21.15.81:0/3177428982 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6e9006aed0 0x7f6e9006d390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0045a0 tx=0x7f6e9c009260 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:18.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.167+0000 7f6ea1ffb700 1 -- 172.21.15.81:0/3177428982 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6eac1e5930 con 0x7f6eac0ba2c0 2023-10-25T23:36:18.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.352+0000 7f6eb32ef700 1 -- 172.21.15.81:0/3177428982 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6eac0bb6a0 con 0x7f6e9006aed0 2023-10-25T23:36:18.361 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.360+0000 7f6ea1ffb700 1 -- 172.21.15.81:0/3177428982 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264591 (secure 0 0 0) 0x7f6e9c016070 con 0x7f6e9006aed0 2023-10-25T23:36:18.364 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:18.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.363+0000 7f6eb32ef700 1 -- 172.21.15.81:0/3177428982 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6e9006aed0 msgr2=0x7f6e9006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:18.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.363+0000 7f6eb32ef700 1 --2- 172.21.15.81:0/3177428982 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6e9006aed0 0x7f6e9006d390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0045a0 tx=0x7f6e9c009260 comp rx=0 tx=0).stop 2023-10-25T23:36:18.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.363+0000 7f6eb32ef700 1 -- 172.21.15.81:0/3177428982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eac0ba2c0 msgr2=0x7f6eac0ba770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:18.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.363+0000 7f6eb32ef700 1 --2- 172.21.15.81:0/3177428982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eac0ba2c0 0x7f6eac0ba770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6eac135c30 tx=0x7f6ea4001ab0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.363+0000 7f6eb32ef700 1 -- 172.21.15.81:0/3177428982 shutdown_connections 2023-10-25T23:36:18.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.363+0000 7f6eb32ef700 1 --2- 172.21.15.81:0/3177428982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eac0ba2c0 0x7f6eac0ba770 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.363+0000 7f6eb32ef700 1 --2- 172.21.15.81:0/3177428982 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6e9006aed0 0x7f6e9006d390 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.363+0000 7f6eb32ef700 1 --2- 172.21.15.81:0/3177428982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e98004850 0x7f6eac12b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.363+0000 7f6eb32ef700 1 --2- 172.21.15.81:0/3177428982 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6eac1e65b0 0x7f6eac1e23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.363+0000 7f6eb32ef700 1 -- 172.21.15.81:0/3177428982 >> 172.21.15.81:0/3177428982 conn(0x7f6eac0c0a40 msgr2=0x7f6eac0bbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:18.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.363+0000 7f6eb32ef700 1 -- 172.21.15.81:0/3177428982 shutdown_connections 2023-10-25T23:36:18.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.363+0000 7f6eb32ef700 1 -- 172.21.15.81:0/3177428982 wait complete. 2023-10-25T23:36:18.369 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-25T23:36:18.375 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-25T23:36:16.990986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219116,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755604,"statfs":{"total":773094113280,"available":772869738496,"internally_reserved":0,"allocated":2990080,"data_stored":1790108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001713"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477723+0000","last_change":"2023-10-25T23:36:09.292535+0000","last_active":"2023-10-25T23:36:10.477723+0000","last_peered":"2023-10-25T23:36:10.477723+0000","last_clean":"2023-10-25T23:36:10.477723+0000","last_became_active":"2023-10-25T23:36:09.292007+0000","last_became_peered":"2023-10-25T23:36:09.292007+0000","last_unstale":"2023-10-25T23:36:10.477723+0000","last_undegraded":"2023-10-25T23:36:10.477723+0000","last_fullsized":"2023-10-25T23:36:10.477723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:54:42.179401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475807+0000","last_change":"2023-10-25T23:36:09.282198+0000","last_active":"2023-10-25T23:36:11.475807+0000","last_peered":"2023-10-25T23:36:11.475807+0000","last_clean":"2023-10-25T23:36:11.475807+0000","last_became_active":"2023-10-25T23:36:09.281890+0000","last_became_peered":"2023-10-25T23:36:09.281890+0000","last_unstale":"2023-10-25T23:36:11.475807+0000","last_undegraded":"2023-10-25T23:36:11.475807+0000","last_fullsized":"2023-10-25T23:36:11.475807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:48:33.297905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475325+0000","last_change":"2023-10-25T23:36:09.284367+0000","last_active":"2023-10-25T23:36:11.475325+0000","last_peered":"2023-10-25T23:36:11.475325+0000","last_clean":"2023-10-25T23:36:11.475325+0000","last_became_active":"2023-10-25T23:36:09.284066+0000","last_became_peered":"2023-10-25T23:36:09.284066+0000","last_unstale":"2023-10-25T23:36:11.475325+0000","last_undegraded":"2023-10-25T23:36:11.475325+0000","last_fullsized":"2023-10-25T23:36:11.475325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:21:30.068321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887928+0000","last_change":"2023-10-25T23:36:09.300380+0000","last_active":"2023-10-25T23:36:10.887928+0000","last_peered":"2023-10-25T23:36:10.887928+0000","last_clean":"2023-10-25T23:36:10.887928+0000","last_became_active":"2023-10-25T23:36:09.299585+0000","last_became_peered":"2023-10-25T23:36:09.299585+0000","last_unstale":"2023-10-25T23:36:10.887928+0000","last_undegraded":"2023-10-25T23:36:10.887928+0000","last_fullsized":"2023-10-25T23:36:10.887928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:54.492612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477102+0000","last_change":"2023-10-25T23:36:09.287693+0000","last_active":"2023-10-25T23:36:10.477102+0000","last_peered":"2023-10-25T23:36:10.477102+0000","last_clean":"2023-10-25T23:36:10.477102+0000","last_became_active":"2023-10-25T23:36:09.287403+0000","last_became_peered":"2023-10-25T23:36:09.287403+0000","last_unstale":"2023-10-25T23:36:10.477102+0000","last_undegraded":"2023-10-25T23:36:10.477102+0000","last_fullsized":"2023-10-25T23:36:10.477102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:58:48.401709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887662+0000","last_change":"2023-10-25T23:36:09.301596+0000","last_active":"2023-10-25T23:36:10.887662+0000","last_peered":"2023-10-25T23:36:10.887662+0000","last_clean":"2023-10-25T23:36:10.887662+0000","last_became_active":"2023-10-25T23:36:09.301305+0000","last_became_peered":"2023-10-25T23:36:09.301305+0000","last_unstale":"2023-10-25T23:36:10.887662+0000","last_undegraded":"2023-10-25T23:36:10.887662+0000","last_fullsized":"2023-10-25T23:36:10.887662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:24:52.973821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477210+0000","last_change":"2023-10-25T23:36:09.293643+0000","last_active":"2023-10-25T23:36:10.477210+0000","last_peered":"2023-10-25T23:36:10.477210+0000","last_clean":"2023-10-25T23:36:10.477210+0000","last_became_active":"2023-10-25T23:36:09.293173+0000","last_became_peered":"2023-10-25T23:36:09.293173+0000","last_unstale":"2023-10-25T23:36:10.477210+0000","last_undegraded":"2023-10-25T23:36:10.477210+0000","last_fullsized":"2023-10-25T23:36:10.477210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:54.492612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475218+0000","last_change":"2023-10-25T23:36:09.295727+0000","last_active":"2023-10-25T23:36:11.475218+0000","last_peered":"2023-10-25T23:36:11.475218+0000","last_clean":"2023-10-25T23:36:11.475218+0000","last_became_active":"2023-10-25T23:36:09.295518+0000","last_became_peered":"2023-10-25T23:36:09.295518+0000","last_unstale":"2023-10-25T23:36:11.475218+0000","last_undegraded":"2023-10-25T23:36:11.475218+0000","last_fullsized":"2023-10-25T23:36:11.475218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:38:19.348985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477732+0000","last_change":"2023-10-25T23:36:09.297377+0000","last_active":"2023-10-25T23:36:10.477732+0000","last_peered":"2023-10-25T23:36:10.477732+0000","last_clean":"2023-10-25T23:36:10.477732+0000","last_became_active":"2023-10-25T23:36:09.297036+0000","last_became_peered":"2023-10-25T23:36:09.297036+0000","last_unstale":"2023-10-25T23:36:10.477732+0000","last_undegraded":"2023-10-25T23:36:10.477732+0000","last_fullsized":"2023-10-25T23:36:10.477732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:18:29.087327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285803+0000","last_change":"2023-10-25T23:36:09.298222+0000","last_active":"2023-10-25T23:36:10.285803+0000","last_peered":"2023-10-25T23:36:10.285803+0000","last_clean":"2023-10-25T23:36:10.285803+0000","last_became_active":"2023-10-25T23:36:09.297713+0000","last_became_peered":"2023-10-25T23:36:09.297713+0000","last_unstale":"2023-10-25T23:36:10.285803+0000","last_undegraded":"2023-10-25T23:36:10.285803+0000","last_fullsized":"2023-10-25T23:36:10.285803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:09:27.102927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285557+0000","last_change":"2023-10-25T23:36:09.297392+0000","last_active":"2023-10-25T23:36:10.285557+0000","last_peered":"2023-10-25T23:36:10.285557+0000","last_clean":"2023-10-25T23:36:10.285557+0000","last_became_active":"2023-10-25T23:36:09.297133+0000","last_became_peered":"2023-10-25T23:36:09.297133+0000","last_unstale":"2023-10-25T23:36:10.285557+0000","last_undegraded":"2023-10-25T23:36:10.285557+0000","last_fullsized":"2023-10-25T23:36:10.285557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:28.346439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.287003+0000","last_change":"2023-10-25T23:36:09.291669+0000","last_active":"2023-10-25T23:36:10.287003+0000","last_peered":"2023-10-25T23:36:10.287003+0000","last_clean":"2023-10-25T23:36:10.287003+0000","last_became_active":"2023-10-25T23:36:09.291351+0000","last_became_peered":"2023-10-25T23:36:09.291351+0000","last_unstale":"2023-10-25T23:36:10.287003+0000","last_undegraded":"2023-10-25T23:36:10.287003+0000","last_fullsized":"2023-10-25T23:36:10.287003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:01.440988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476244+0000","last_change":"2023-10-25T23:36:09.290180+0000","last_active":"2023-10-25T23:36:11.476244+0000","last_peered":"2023-10-25T23:36:11.476244+0000","last_clean":"2023-10-25T23:36:11.476244+0000","last_became_active":"2023-10-25T23:36:09.289895+0000","last_became_peered":"2023-10-25T23:36:09.289895+0000","last_unstale":"2023-10-25T23:36:11.476244+0000","last_undegraded":"2023-10-25T23:36:11.476244+0000","last_fullsized":"2023-10-25T23:36:11.476244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:26:04.639901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476188+0000","last_change":"2023-10-25T23:36:09.283494+0000","last_active":"2023-10-25T23:36:11.476188+0000","last_peered":"2023-10-25T23:36:11.476188+0000","last_clean":"2023-10-25T23:36:11.476188+0000","last_became_active":"2023-10-25T23:36:09.283250+0000","last_became_peered":"2023-10-25T23:36:09.283250+0000","last_unstale":"2023-10-25T23:36:11.476188+0000","last_undegraded":"2023-10-25T23:36:11.476188+0000","last_fullsized":"2023-10-25T23:36:11.476188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:11:38.668268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475213+0000","last_change":"2023-10-25T23:36:09.286460+0000","last_active":"2023-10-25T23:36:11.475213+0000","last_peered":"2023-10-25T23:36:11.475213+0000","last_clean":"2023-10-25T23:36:11.475213+0000","last_became_active":"2023-10-25T23:36:09.286191+0000","last_became_peered":"2023-10-25T23:36:09.286191+0000","last_unstale":"2023-10-25T23:36:11.475213+0000","last_undegraded":"2023-10-25T23:36:11.475213+0000","last_fullsized":"2023-10-25T23:36:11.475213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:38:19.348985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887574+0000","last_change":"2023-10-25T23:36:09.301475+0000","last_active":"2023-10-25T23:36:10.887574+0000","last_peered":"2023-10-25T23:36:10.887574+0000","last_clean":"2023-10-25T23:36:10.887574+0000","last_became_active":"2023-10-25T23:36:09.301040+0000","last_became_peered":"2023-10-25T23:36:09.301040+0000","last_unstale":"2023-10-25T23:36:10.887574+0000","last_undegraded":"2023-10-25T23:36:10.887574+0000","last_fullsized":"2023-10-25T23:36:10.887574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:06.986689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888186+0000","last_change":"2023-10-25T23:36:09.298189+0000","last_active":"2023-10-25T23:36:10.888186+0000","last_peered":"2023-10-25T23:36:10.888186+0000","last_clean":"2023-10-25T23:36:10.888186+0000","last_became_active":"2023-10-25T23:36:09.297892+0000","last_became_peered":"2023-10-25T23:36:09.297892+0000","last_unstale":"2023-10-25T23:36:10.888186+0000","last_undegraded":"2023-10-25T23:36:10.888186+0000","last_fullsized":"2023-10-25T23:36:10.888186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:54:42.179401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285710+0000","last_change":"2023-10-25T23:36:09.282631+0000","last_active":"2023-10-25T23:36:10.285710+0000","last_peered":"2023-10-25T23:36:10.285710+0000","last_clean":"2023-10-25T23:36:10.285710+0000","last_became_active":"2023-10-25T23:36:09.282282+0000","last_became_peered":"2023-10-25T23:36:09.282282+0000","last_unstale":"2023-10-25T23:36:10.285710+0000","last_undegraded":"2023-10-25T23:36:10.285710+0000","last_fullsized":"2023-10-25T23:36:10.285710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:27.001592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477144+0000","last_change":"2023-10-25T23:36:09.289744+0000","last_active":"2023-10-25T23:36:10.477144+0000","last_peered":"2023-10-25T23:36:10.477144+0000","last_clean":"2023-10-25T23:36:10.477144+0000","last_became_active":"2023-10-25T23:36:09.289457+0000","last_became_peered":"2023-10-25T23:36:09.289457+0000","last_unstale":"2023-10-25T23:36:10.477144+0000","last_undegraded":"2023-10-25T23:36:10.477144+0000","last_fullsized":"2023-10-25T23:36:10.477144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:25:22.432043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.034696+0000","last_change":"2023-10-25T23:36:08.271164+0000","last_active":"2023-10-25T23:36:11.034696+0000","last_peered":"2023-10-25T23:36:11.034696+0000","last_clean":"2023-10-25T23:36:11.034696+0000","last_became_active":"2023-10-25T23:36:08.270911+0000","last_became_peered":"2023-10-25T23:36:08.270911+0000","last_unstale":"2023-10-25T23:36:11.034696+0000","last_undegraded":"2023-10-25T23:36:11.034696+0000","last_fullsized":"2023-10-25T23:36:11.034696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476832+0000","last_change":"2023-10-25T23:36:09.290526+0000","last_active":"2023-10-25T23:36:11.476832+0000","last_peered":"2023-10-25T23:36:11.476832+0000","last_clean":"2023-10-25T23:36:11.476832+0000","last_became_active":"2023-10-25T23:36:09.290260+0000","last_became_peered":"2023-10-25T23:36:09.290260+0000","last_unstale":"2023-10-25T23:36:11.476832+0000","last_undegraded":"2023-10-25T23:36:11.476832+0000","last_fullsized":"2023-10-25T23:36:11.476832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:28:06.035601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.036228+0000","last_change":"2023-10-25T23:36:08.269993+0000","last_active":"2023-10-25T23:36:11.036228+0000","last_peered":"2023-10-25T23:36:11.036228+0000","last_clean":"2023-10-25T23:36:11.036228+0000","last_became_active":"2023-10-25T23:36:08.269443+0000","last_became_peered":"2023-10-25T23:36:08.269443+0000","last_unstale":"2023-10-25T23:36:11.036228+0000","last_undegraded":"2023-10-25T23:36:11.036228+0000","last_fullsized":"2023-10-25T23:36:11.036228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.477098+0000","last_change":"2023-10-25T23:36:09.300013+0000","last_active":"2023-10-25T23:36:11.477098+0000","last_peered":"2023-10-25T23:36:11.477098+0000","last_clean":"2023-10-25T23:36:11.477098+0000","last_became_active":"2023-10-25T23:36:09.299738+0000","last_became_peered":"2023-10-25T23:36:09.299738+0000","last_unstale":"2023-10-25T23:36:11.477098+0000","last_undegraded":"2023-10-25T23:36:11.477098+0000","last_fullsized":"2023-10-25T23:36:11.477098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:48:33.297905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477442+0000","last_change":"2023-10-25T23:36:08.273879+0000","last_active":"2023-10-25T23:36:10.477442+0000","last_peered":"2023-10-25T23:36:10.477442+0000","last_clean":"2023-10-25T23:36:10.477442+0000","last_became_active":"2023-10-25T23:36:08.273574+0000","last_became_peered":"2023-10-25T23:36:08.273574+0000","last_unstale":"2023-10-25T23:36:10.477442+0000","last_undegraded":"2023-10-25T23:36:10.477442+0000","last_fullsized":"2023-10-25T23:36:10.477442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:27.340205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887909+0000","last_change":"2023-10-25T23:36:09.300549+0000","last_active":"2023-10-25T23:36:10.887909+0000","last_peered":"2023-10-25T23:36:10.887909+0000","last_clean":"2023-10-25T23:36:10.887909+0000","last_became_active":"2023-10-25T23:36:09.299916+0000","last_became_peered":"2023-10-25T23:36:09.299916+0000","last_unstale":"2023-10-25T23:36:10.887909+0000","last_undegraded":"2023-10-25T23:36:10.887909+0000","last_fullsized":"2023-10-25T23:36:10.887909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:25:22.432043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477055+0000","last_change":"2023-10-25T23:36:08.271714+0000","last_active":"2023-10-25T23:36:10.477055+0000","last_peered":"2023-10-25T23:36:10.477055+0000","last_clean":"2023-10-25T23:36:10.477055+0000","last_became_active":"2023-10-25T23:36:08.271442+0000","last_became_peered":"2023-10-25T23:36:08.271442+0000","last_unstale":"2023-10-25T23:36:10.477055+0000","last_undegraded":"2023-10-25T23:36:10.477055+0000","last_fullsized":"2023-10-25T23:36:10.477055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888055+0000","last_change":"2023-10-25T23:36:09.299476+0000","last_active":"2023-10-25T23:36:10.888055+0000","last_peered":"2023-10-25T23:36:10.888055+0000","last_clean":"2023-10-25T23:36:10.888055+0000","last_became_active":"2023-10-25T23:36:09.299130+0000","last_became_peered":"2023-10-25T23:36:09.299130+0000","last_unstale":"2023-10-25T23:36:10.888055+0000","last_undegraded":"2023-10-25T23:36:10.888055+0000","last_fullsized":"2023-10-25T23:36:10.888055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:53:09.911467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.036183+0000","last_change":"2023-10-25T23:36:08.271119+0000","last_active":"2023-10-25T23:36:11.036183+0000","last_peered":"2023-10-25T23:36:11.036183+0000","last_clean":"2023-10-25T23:36:11.036183+0000","last_became_active":"2023-10-25T23:36:08.270138+0000","last_became_peered":"2023-10-25T23:36:08.270138+0000","last_unstale":"2023-10-25T23:36:11.036183+0000","last_undegraded":"2023-10-25T23:36:11.036183+0000","last_fullsized":"2023-10-25T23:36:11.036183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286865+0000","last_change":"2023-10-25T23:36:09.287742+0000","last_active":"2023-10-25T23:36:10.286865+0000","last_peered":"2023-10-25T23:36:10.286865+0000","last_clean":"2023-10-25T23:36:10.286865+0000","last_became_active":"2023-10-25T23:36:09.287455+0000","last_became_peered":"2023-10-25T23:36:09.287455+0000","last_unstale":"2023-10-25T23:36:10.286865+0000","last_undegraded":"2023-10-25T23:36:10.286865+0000","last_fullsized":"2023-10-25T23:36:10.286865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:41.029497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285393+0000","last_change":"2023-10-25T23:36:08.272686+0000","last_active":"2023-10-25T23:36:10.285393+0000","last_peered":"2023-10-25T23:36:10.285393+0000","last_clean":"2023-10-25T23:36:10.285393+0000","last_became_active":"2023-10-25T23:36:08.271974+0000","last_became_peered":"2023-10-25T23:36:08.271974+0000","last_unstale":"2023-10-25T23:36:10.285393+0000","last_undegraded":"2023-10-25T23:36:10.285393+0000","last_fullsized":"2023-10-25T23:36:10.285393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476625+0000","last_change":"2023-10-25T23:36:09.294574+0000","last_active":"2023-10-25T23:36:11.476625+0000","last_peered":"2023-10-25T23:36:11.476625+0000","last_clean":"2023-10-25T23:36:11.476625+0000","last_became_active":"2023-10-25T23:36:09.294176+0000","last_became_peered":"2023-10-25T23:36:09.294176+0000","last_unstale":"2023-10-25T23:36:11.476625+0000","last_undegraded":"2023-10-25T23:36:11.476625+0000","last_fullsized":"2023-10-25T23:36:11.476625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:51:49.011246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.036146+0000","last_change":"2023-10-25T23:36:08.273513+0000","last_active":"2023-10-25T23:36:11.036146+0000","last_peered":"2023-10-25T23:36:11.036146+0000","last_clean":"2023-10-25T23:36:11.036146+0000","last_became_active":"2023-10-25T23:36:08.273035+0000","last_became_peered":"2023-10-25T23:36:08.273035+0000","last_unstale":"2023-10-25T23:36:11.036146+0000","last_undegraded":"2023-10-25T23:36:11.036146+0000","last_fullsized":"2023-10-25T23:36:11.036146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:21:29.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475380+0000","last_change":"2023-10-25T23:36:09.292852+0000","last_active":"2023-10-25T23:36:11.475380+0000","last_peered":"2023-10-25T23:36:11.475380+0000","last_clean":"2023-10-25T23:36:11.475380+0000","last_became_active":"2023-10-25T23:36:09.292546+0000","last_became_peered":"2023-10-25T23:36:09.292546+0000","last_unstale":"2023-10-25T23:36:11.475380+0000","last_undegraded":"2023-10-25T23:36:11.475380+0000","last_fullsized":"2023-10-25T23:36:11.475380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:28.346439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887617+0000","last_change":"2023-10-25T23:36:08.277462+0000","last_active":"2023-10-25T23:36:10.887617+0000","last_peered":"2023-10-25T23:36:10.887617+0000","last_clean":"2023-10-25T23:36:10.887617+0000","last_became_active":"2023-10-25T23:36:08.277138+0000","last_became_peered":"2023-10-25T23:36:08.277138+0000","last_unstale":"2023-10-25T23:36:10.887617+0000","last_undegraded":"2023-10-25T23:36:10.887617+0000","last_fullsized":"2023-10-25T23:36:10.887617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:48:32.291671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475992+0000","last_change":"2023-10-25T23:36:09.290725+0000","last_active":"2023-10-25T23:36:11.475992+0000","last_peered":"2023-10-25T23:36:11.475992+0000","last_clean":"2023-10-25T23:36:11.475992+0000","last_became_active":"2023-10-25T23:36:09.290456+0000","last_became_peered":"2023-10-25T23:36:09.290456+0000","last_unstale":"2023-10-25T23:36:11.475992+0000","last_undegraded":"2023-10-25T23:36:11.475992+0000","last_fullsized":"2023-10-25T23:36:11.475992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:09:27.102927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285660+0000","last_change":"2023-10-25T23:36:08.272869+0000","last_active":"2023-10-25T23:36:10.285660+0000","last_peered":"2023-10-25T23:36:10.285660+0000","last_clean":"2023-10-25T23:36:10.285660+0000","last_became_active":"2023-10-25T23:36:08.272120+0000","last_became_peered":"2023-10-25T23:36:08.272120+0000","last_unstale":"2023-10-25T23:36:10.285660+0000","last_undegraded":"2023-10-25T23:36:10.285660+0000","last_fullsized":"2023-10-25T23:36:10.285660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888137+0000","last_change":"2023-10-25T23:36:09.293442+0000","last_active":"2023-10-25T23:36:10.888137+0000","last_peered":"2023-10-25T23:36:10.888137+0000","last_clean":"2023-10-25T23:36:10.888137+0000","last_became_active":"2023-10-25T23:36:09.293132+0000","last_became_peered":"2023-10-25T23:36:09.293132+0000","last_unstale":"2023-10-25T23:36:10.888137+0000","last_undegraded":"2023-10-25T23:36:10.888137+0000","last_fullsized":"2023-10-25T23:36:10.888137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:11:17.452696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888026+0000","last_change":"2023-10-25T23:36:08.272920+0000","last_active":"2023-10-25T23:36:10.888026+0000","last_peered":"2023-10-25T23:36:10.888026+0000","last_clean":"2023-10-25T23:36:10.888026+0000","last_became_active":"2023-10-25T23:36:08.272596+0000","last_became_peered":"2023-10-25T23:36:08.272596+0000","last_unstale":"2023-10-25T23:36:10.888026+0000","last_undegraded":"2023-10-25T23:36:10.888026+0000","last_fullsized":"2023-10-25T23:36:10.888026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.477236+0000","last_change":"2023-10-25T23:36:09.300238+0000","last_active":"2023-10-25T23:36:11.477236+0000","last_peered":"2023-10-25T23:36:11.477236+0000","last_clean":"2023-10-25T23:36:11.477236+0000","last_became_active":"2023-10-25T23:36:09.299938+0000","last_became_peered":"2023-10-25T23:36:09.299938+0000","last_unstale":"2023-10-25T23:36:11.477236+0000","last_undegraded":"2023-10-25T23:36:11.477236+0000","last_fullsized":"2023-10-25T23:36:11.477236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:09:27.102927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.034678+0000","last_change":"2023-10-25T23:36:08.279751+0000","last_active":"2023-10-25T23:36:11.034678+0000","last_peered":"2023-10-25T23:36:11.034678+0000","last_clean":"2023-10-25T23:36:11.034678+0000","last_became_active":"2023-10-25T23:36:08.279509+0000","last_became_peered":"2023-10-25T23:36:08.279509+0000","last_unstale":"2023-10-25T23:36:11.034678+0000","last_undegraded":"2023-10-25T23:36:11.034678+0000","last_fullsized":"2023-10-25T23:36:11.034678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286903+0000","last_change":"2023-10-25T23:36:09.285566+0000","last_active":"2023-10-25T23:36:10.286903+0000","last_peered":"2023-10-25T23:36:10.286903+0000","last_clean":"2023-10-25T23:36:10.286903+0000","last_became_active":"2023-10-25T23:36:09.285196+0000","last_became_peered":"2023-10-25T23:36:09.285196+0000","last_unstale":"2023-10-25T23:36:10.286903+0000","last_undegraded":"2023-10-25T23:36:10.286903+0000","last_fullsized":"2023-10-25T23:36:10.286903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:27.001592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285737+0000","last_change":"2023-10-25T23:36:08.272911+0000","last_active":"2023-10-25T23:36:10.285737+0000","last_peered":"2023-10-25T23:36:10.285737+0000","last_clean":"2023-10-25T23:36:10.285737+0000","last_became_active":"2023-10-25T23:36:08.272248+0000","last_became_peered":"2023-10-25T23:36:08.272248+0000","last_unstale":"2023-10-25T23:36:10.285737+0000","last_undegraded":"2023-10-25T23:36:10.285737+0000","last_fullsized":"2023-10-25T23:36:10.285737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477155+0000","last_change":"2023-10-25T23:36:09.292562+0000","last_active":"2023-10-25T23:36:10.477155+0000","last_peered":"2023-10-25T23:36:10.477155+0000","last_clean":"2023-10-25T23:36:10.477155+0000","last_became_active":"2023-10-25T23:36:09.292300+0000","last_became_peered":"2023-10-25T23:36:09.292300+0000","last_unstale":"2023-10-25T23:36:10.477155+0000","last_undegraded":"2023-10-25T23:36:10.477155+0000","last_fullsized":"2023-10-25T23:36:10.477155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:46:03.954978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.034648+0000","last_change":"2023-10-25T23:36:08.274407+0000","last_active":"2023-10-25T23:36:11.034648+0000","last_peered":"2023-10-25T23:36:11.034648+0000","last_clean":"2023-10-25T23:36:11.034648+0000","last_became_active":"2023-10-25T23:36:08.274162+0000","last_became_peered":"2023-10-25T23:36:08.274162+0000","last_unstale":"2023-10-25T23:36:11.034648+0000","last_undegraded":"2023-10-25T23:36:11.034648+0000","last_fullsized":"2023-10-25T23:36:11.034648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476045+0000","last_change":"2023-10-25T23:36:09.284635+0000","last_active":"2023-10-25T23:36:11.476045+0000","last_peered":"2023-10-25T23:36:11.476045+0000","last_clean":"2023-10-25T23:36:11.476045+0000","last_became_active":"2023-10-25T23:36:09.284386+0000","last_became_peered":"2023-10-25T23:36:09.284386+0000","last_unstale":"2023-10-25T23:36:11.476045+0000","last_undegraded":"2023-10-25T23:36:11.476045+0000","last_fullsized":"2023-10-25T23:36:11.476045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:26.427642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887950+0000","last_change":"2023-10-25T23:36:08.271565+0000","last_active":"2023-10-25T23:36:10.887950+0000","last_peered":"2023-10-25T23:36:10.887950+0000","last_clean":"2023-10-25T23:36:10.887950+0000","last_became_active":"2023-10-25T23:36:08.271188+0000","last_became_peered":"2023-10-25T23:36:08.271188+0000","last_unstale":"2023-10-25T23:36:10.887950+0000","last_undegraded":"2023-10-25T23:36:10.887950+0000","last_fullsized":"2023-10-25T23:36:10.887950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:51:48.005011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477103+0000","last_change":"2023-10-25T23:36:09.294928+0000","last_active":"2023-10-25T23:36:10.477103+0000","last_peered":"2023-10-25T23:36:10.477103+0000","last_clean":"2023-10-25T23:36:10.477103+0000","last_became_active":"2023-10-25T23:36:09.294200+0000","last_became_peered":"2023-10-25T23:36:09.294200+0000","last_unstale":"2023-10-25T23:36:10.477103+0000","last_undegraded":"2023-10-25T23:36:10.477103+0000","last_fullsized":"2023-10-25T23:36:10.477103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:29:19.996286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285380+0000","last_change":"2023-10-25T23:36:08.273427+0000","last_active":"2023-10-25T23:36:10.285380+0000","last_peered":"2023-10-25T23:36:10.285380+0000","last_clean":"2023-10-25T23:36:10.285380+0000","last_became_active":"2023-10-25T23:36:08.272301+0000","last_became_peered":"2023-10-25T23:36:08.272301+0000","last_unstale":"2023-10-25T23:36:10.285380+0000","last_undegraded":"2023-10-25T23:36:10.285380+0000","last_fullsized":"2023-10-25T23:36:10.285380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285377+0000","last_change":"2023-10-25T23:36:09.291952+0000","last_active":"2023-10-25T23:36:10.285377+0000","last_peered":"2023-10-25T23:36:10.285377+0000","last_clean":"2023-10-25T23:36:10.285377+0000","last_became_active":"2023-10-25T23:36:09.291305+0000","last_became_peered":"2023-10-25T23:36:09.291305+0000","last_unstale":"2023-10-25T23:36:10.285377+0000","last_undegraded":"2023-10-25T23:36:10.285377+0000","last_fullsized":"2023-10-25T23:36:10.285377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:38:19.348985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285555+0000","last_change":"2023-10-25T23:36:08.277621+0000","last_active":"2023-10-25T23:36:10.285555+0000","last_peered":"2023-10-25T23:36:10.285555+0000","last_clean":"2023-10-25T23:36:10.285555+0000","last_became_active":"2023-10-25T23:36:08.277327+0000","last_became_peered":"2023-10-25T23:36:08.277327+0000","last_unstale":"2023-10-25T23:36:10.285555+0000","last_undegraded":"2023-10-25T23:36:10.285555+0000","last_fullsized":"2023-10-25T23:36:10.285555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:04.918703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.476928+0000","last_change":"2023-10-25T23:36:09.295493+0000","last_active":"2023-10-25T23:36:10.476928+0000","last_peered":"2023-10-25T23:36:10.476928+0000","last_clean":"2023-10-25T23:36:10.476928+0000","last_became_active":"2023-10-25T23:36:09.295231+0000","last_became_peered":"2023-10-25T23:36:09.295231+0000","last_unstale":"2023-10-25T23:36:10.476928+0000","last_undegraded":"2023-10-25T23:36:10.476928+0000","last_fullsized":"2023-10-25T23:36:10.476928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:28:06.035601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286981+0000","last_change":"2023-10-25T23:36:08.263573+0000","last_active":"2023-10-25T23:36:10.286981+0000","last_peered":"2023-10-25T23:36:10.286981+0000","last_clean":"2023-10-25T23:36:10.286981+0000","last_became_active":"2023-10-25T23:36:08.263264+0000","last_became_peered":"2023-10-25T23:36:08.263264+0000","last_unstale":"2023-10-25T23:36:10.286981+0000","last_undegraded":"2023-10-25T23:36:10.286981+0000","last_fullsized":"2023-10-25T23:36:10.286981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477258+0000","last_change":"2023-10-25T23:36:09.294572+0000","last_active":"2023-10-25T23:36:10.477258+0000","last_peered":"2023-10-25T23:36:10.477258+0000","last_clean":"2023-10-25T23:36:10.477258+0000","last_became_active":"2023-10-25T23:36:09.294298+0000","last_became_peered":"2023-10-25T23:36:09.294298+0000","last_unstale":"2023-10-25T23:36:10.477258+0000","last_undegraded":"2023-10-25T23:36:10.477258+0000","last_fullsized":"2023-10-25T23:36:10.477258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:53:09.911467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.034639+0000","last_change":"2023-10-25T23:36:08.277383+0000","last_active":"2023-10-25T23:36:11.034639+0000","last_peered":"2023-10-25T23:36:11.034639+0000","last_clean":"2023-10-25T23:36:11.034639+0000","last_became_active":"2023-10-25T23:36:08.277087+0000","last_became_peered":"2023-10-25T23:36:08.277087+0000","last_unstale":"2023-10-25T23:36:11.034639+0000","last_undegraded":"2023-10-25T23:36:11.034639+0000","last_fullsized":"2023-10-25T23:36:11.034639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888072+0000","last_change":"2023-10-25T23:36:09.299356+0000","last_active":"2023-10-25T23:36:10.888072+0000","last_peered":"2023-10-25T23:36:10.888072+0000","last_clean":"2023-10-25T23:36:10.888072+0000","last_became_active":"2023-10-25T23:36:09.298782+0000","last_became_peered":"2023-10-25T23:36:09.298782+0000","last_unstale":"2023-10-25T23:36:10.888072+0000","last_undegraded":"2023-10-25T23:36:10.888072+0000","last_fullsized":"2023-10-25T23:36:10.888072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:26:02.311707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887844+0000","last_change":"2023-10-25T23:36:08.279568+0000","last_active":"2023-10-25T23:36:10.887844+0000","last_peered":"2023-10-25T23:36:10.887844+0000","last_clean":"2023-10-25T23:36:10.887844+0000","last_became_active":"2023-10-25T23:36:08.279302+0000","last_became_peered":"2023-10-25T23:36:08.279302+0000","last_unstale":"2023-10-25T23:36:10.887844+0000","last_undegraded":"2023-10-25T23:36:10.887844+0000","last_fullsized":"2023-10-25T23:36:10.887844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:27.340205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286808+0000","last_change":"2023-10-25T23:36:09.293019+0000","last_active":"2023-10-25T23:36:10.286808+0000","last_peered":"2023-10-25T23:36:10.286808+0000","last_clean":"2023-10-25T23:36:10.286808+0000","last_became_active":"2023-10-25T23:36:09.292670+0000","last_became_peered":"2023-10-25T23:36:09.292670+0000","last_unstale":"2023-10-25T23:36:10.286808+0000","last_undegraded":"2023-10-25T23:36:10.286808+0000","last_fullsized":"2023-10-25T23:36:10.286808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:05.924938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475218+0000","last_change":"2023-10-25T23:36:09.284019+0000","last_active":"2023-10-25T23:36:11.475218+0000","last_peered":"2023-10-25T23:36:11.475218+0000","last_clean":"2023-10-25T23:36:11.475218+0000","last_became_active":"2023-10-25T23:36:09.283766+0000","last_became_peered":"2023-10-25T23:36:09.283766+0000","last_unstale":"2023-10-25T23:36:11.475218+0000","last_undegraded":"2023-10-25T23:36:11.475218+0000","last_fullsized":"2023-10-25T23:36:11.475218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:28.346439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285551+0000","last_change":"2023-10-25T23:36:08.264050+0000","last_active":"2023-10-25T23:36:10.285551+0000","last_peered":"2023-10-25T23:36:10.285551+0000","last_clean":"2023-10-25T23:36:10.285551+0000","last_became_active":"2023-10-25T23:36:08.263842+0000","last_became_peered":"2023-10-25T23:36:08.263842+0000","last_unstale":"2023-10-25T23:36:10.285551+0000","last_undegraded":"2023-10-25T23:36:10.285551+0000","last_fullsized":"2023-10-25T23:36:10.285551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:31.130445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476350+0000","last_change":"2023-10-25T23:36:09.295865+0000","last_active":"2023-10-25T23:36:11.476350+0000","last_peered":"2023-10-25T23:36:11.476350+0000","last_clean":"2023-10-25T23:36:11.476350+0000","last_became_active":"2023-10-25T23:36:09.295595+0000","last_became_peered":"2023-10-25T23:36:09.295595+0000","last_unstale":"2023-10-25T23:36:11.476350+0000","last_undegraded":"2023-10-25T23:36:11.476350+0000","last_fullsized":"2023-10-25T23:36:11.476350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:09:27.102927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887944+0000","last_change":"2023-10-25T23:36:08.272009+0000","last_active":"2023-10-25T23:36:10.887944+0000","last_peered":"2023-10-25T23:36:10.887944+0000","last_clean":"2023-10-25T23:36:10.887944+0000","last_became_active":"2023-10-25T23:36:08.271640+0000","last_became_peered":"2023-10-25T23:36:08.271640+0000","last_unstale":"2023-10-25T23:36:10.887944+0000","last_undegraded":"2023-10-25T23:36:10.887944+0000","last_fullsized":"2023-10-25T23:36:10.887944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:40.023263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.281002+0000","last_change":"2023-10-25T23:35:58.277542+0000","last_active":"2023-10-25T23:36:09.281002+0000","last_peered":"2023-10-25T23:36:09.281002+0000","last_clean":"2023-10-25T23:36:09.281002+0000","last_became_active":"2023-10-25T23:35:58.276606+0000","last_became_peered":"2023-10-25T23:35:58.276606+0000","last_unstale":"2023-10-25T23:36:09.281002+0000","last_undegraded":"2023-10-25T23:36:09.281002+0000","last_fullsized":"2023-10-25T23:36:09.281002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:35:57.197265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:35:57.197265+0000","last_clean_scrub_stamp":"2023-10-25T23:35:57.197265+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:53:55.116662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475819+0000","last_change":"2023-10-25T23:36:09.291404+0000","last_active":"2023-10-25T23:36:11.475819+0000","last_peered":"2023-10-25T23:36:11.475819+0000","last_clean":"2023-10-25T23:36:11.475819+0000","last_became_active":"2023-10-25T23:36:09.291072+0000","last_became_peered":"2023-10-25T23:36:09.291072+0000","last_unstale":"2023-10-25T23:36:11.475819+0000","last_undegraded":"2023-10-25T23:36:11.475819+0000","last_fullsized":"2023-10-25T23:36:11.475819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:20.497336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.476857+0000","last_change":"2023-10-25T23:36:08.277937+0000","last_active":"2023-10-25T23:36:10.476857+0000","last_peered":"2023-10-25T23:36:10.476857+0000","last_clean":"2023-10-25T23:36:10.476857+0000","last_became_active":"2023-10-25T23:36:08.277663+0000","last_became_peered":"2023-10-25T23:36:08.277663+0000","last_unstale":"2023-10-25T23:36:10.476857+0000","last_undegraded":"2023-10-25T23:36:10.476857+0000","last_fullsized":"2023-10-25T23:36:10.476857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:04.918703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477388+0000","last_change":"2023-10-25T23:36:08.270783+0000","last_active":"2023-10-25T23:36:10.477388+0000","last_peered":"2023-10-25T23:36:10.477388+0000","last_clean":"2023-10-25T23:36:10.477388+0000","last_became_active":"2023-10-25T23:36:08.269896+0000","last_became_peered":"2023-10-25T23:36:08.269896+0000","last_unstale":"2023-10-25T23:36:10.477388+0000","last_undegraded":"2023-10-25T23:36:10.477388+0000","last_fullsized":"2023-10-25T23:36:10.477388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475541+0000","last_change":"2023-10-25T23:36:09.279236+0000","last_active":"2023-10-25T23:36:11.475541+0000","last_peered":"2023-10-25T23:36:11.475541+0000","last_clean":"2023-10-25T23:36:11.475541+0000","last_became_active":"2023-10-25T23:36:09.278967+0000","last_became_peered":"2023-10-25T23:36:09.278967+0000","last_unstale":"2023-10-25T23:36:11.475541+0000","last_undegraded":"2023-10-25T23:36:11.475541+0000","last_fullsized":"2023-10-25T23:36:11.475541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:26:04.639901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475648+0000","last_change":"2023-10-25T23:36:08.279363+0000","last_active":"2023-10-25T23:36:11.475648+0000","last_peered":"2023-10-25T23:36:11.475648+0000","last_clean":"2023-10-25T23:36:11.475648+0000","last_became_active":"2023-10-25T23:36:08.279082+0000","last_became_peered":"2023-10-25T23:36:08.279082+0000","last_unstale":"2023-10-25T23:36:11.475648+0000","last_undegraded":"2023-10-25T23:36:11.475648+0000","last_fullsized":"2023-10-25T23:36:11.475648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476877+0000","last_change":"2023-10-25T23:36:09.290430+0000","last_active":"2023-10-25T23:36:11.476877+0000","last_peered":"2023-10-25T23:36:11.476877+0000","last_clean":"2023-10-25T23:36:11.476877+0000","last_became_active":"2023-10-25T23:36:09.289751+0000","last_became_peered":"2023-10-25T23:36:09.289751+0000","last_unstale":"2023-10-25T23:36:11.476877+0000","last_undegraded":"2023-10-25T23:36:11.476877+0000","last_fullsized":"2023-10-25T23:36:11.476877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:29:19.996286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285500+0000","last_change":"2023-10-25T23:36:08.274349+0000","last_active":"2023-10-25T23:36:10.285500+0000","last_peered":"2023-10-25T23:36:10.285500+0000","last_clean":"2023-10-25T23:36:10.285500+0000","last_became_active":"2023-10-25T23:36:08.273029+0000","last_became_peered":"2023-10-25T23:36:08.273029+0000","last_unstale":"2023-10-25T23:36:10.285500+0000","last_undegraded":"2023-10-25T23:36:10.285500+0000","last_fullsized":"2023-10-25T23:36:10.285500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.477101+0000","last_change":"2023-10-25T23:36:09.287779+0000","last_active":"2023-10-25T23:36:11.477101+0000","last_peered":"2023-10-25T23:36:11.477101+0000","last_clean":"2023-10-25T23:36:11.477101+0000","last_became_active":"2023-10-25T23:36:09.287532+0000","last_became_peered":"2023-10-25T23:36:09.287532+0000","last_unstale":"2023-10-25T23:36:11.477101+0000","last_undegraded":"2023-10-25T23:36:11.477101+0000","last_fullsized":"2023-10-25T23:36:11.477101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:26:04.639901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.476756+0000","last_change":"2023-10-25T23:36:08.266963+0000","last_active":"2023-10-25T23:36:10.476756+0000","last_peered":"2023-10-25T23:36:10.476756+0000","last_clean":"2023-10-25T23:36:10.476756+0000","last_became_active":"2023-10-25T23:36:08.266648+0000","last_became_peered":"2023-10-25T23:36:08.266648+0000","last_unstale":"2023-10-25T23:36:10.476756+0000","last_undegraded":"2023-10-25T23:36:10.476756+0000","last_fullsized":"2023-10-25T23:36:10.476756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:31.130445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286767+0000","last_change":"2023-10-25T23:36:09.285305+0000","last_active":"2023-10-25T23:36:10.286767+0000","last_peered":"2023-10-25T23:36:10.286767+0000","last_clean":"2023-10-25T23:36:10.286767+0000","last_became_active":"2023-10-25T23:36:09.284666+0000","last_became_peered":"2023-10-25T23:36:09.284666+0000","last_unstale":"2023-10-25T23:36:10.286767+0000","last_undegraded":"2023-10-25T23:36:10.286767+0000","last_fullsized":"2023-10-25T23:36:10.286767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:32.136680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.034599+0000","last_change":"2023-10-25T23:36:08.278162+0000","last_active":"2023-10-25T23:36:11.034599+0000","last_peered":"2023-10-25T23:36:11.034599+0000","last_clean":"2023-10-25T23:36:11.034599+0000","last_became_active":"2023-10-25T23:36:08.277873+0000","last_became_peered":"2023-10-25T23:36:08.277873+0000","last_unstale":"2023-10-25T23:36:11.034599+0000","last_undegraded":"2023-10-25T23:36:11.034599+0000","last_fullsized":"2023-10-25T23:36:11.034599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476175+0000","last_change":"2023-10-25T23:36:09.289615+0000","last_active":"2023-10-25T23:36:11.476175+0000","last_peered":"2023-10-25T23:36:11.476175+0000","last_clean":"2023-10-25T23:36:11.476175+0000","last_became_active":"2023-10-25T23:36:09.289320+0000","last_became_peered":"2023-10-25T23:36:09.289320+0000","last_unstale":"2023-10-25T23:36:11.476175+0000","last_undegraded":"2023-10-25T23:36:11.476175+0000","last_fullsized":"2023-10-25T23:36:11.476175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:51:49.011246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.034620+0000","last_change":"2023-10-25T23:36:08.278921+0000","last_active":"2023-10-25T23:36:11.034620+0000","last_peered":"2023-10-25T23:36:11.034620+0000","last_clean":"2023-10-25T23:36:11.034620+0000","last_became_active":"2023-10-25T23:36:08.278656+0000","last_became_peered":"2023-10-25T23:36:08.278656+0000","last_unstale":"2023-10-25T23:36:11.034620+0000","last_undegraded":"2023-10-25T23:36:11.034620+0000","last_fullsized":"2023-10-25T23:36:11.034620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476671+0000","last_change":"2023-10-25T23:36:09.293076+0000","last_active":"2023-10-25T23:36:11.476671+0000","last_peered":"2023-10-25T23:36:11.476671+0000","last_clean":"2023-10-25T23:36:11.476671+0000","last_became_active":"2023-10-25T23:36:09.292345+0000","last_became_peered":"2023-10-25T23:36:09.292345+0000","last_unstale":"2023-10-25T23:36:11.476671+0000","last_undegraded":"2023-10-25T23:36:11.476671+0000","last_fullsized":"2023-10-25T23:36:11.476671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:06.986689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477225+0000","last_change":"2023-10-25T23:36:08.270589+0000","last_active":"2023-10-25T23:36:10.477225+0000","last_peered":"2023-10-25T23:36:10.477225+0000","last_clean":"2023-10-25T23:36:10.477225+0000","last_became_active":"2023-10-25T23:36:08.268753+0000","last_became_peered":"2023-10-25T23:36:08.268753+0000","last_unstale":"2023-10-25T23:36:10.477225+0000","last_undegraded":"2023-10-25T23:36:10.477225+0000","last_fullsized":"2023-10-25T23:36:10.477225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285622+0000","last_change":"2023-10-25T23:36:09.290423+0000","last_active":"2023-10-25T23:36:10.285622+0000","last_peered":"2023-10-25T23:36:10.285622+0000","last_clean":"2023-10-25T23:36:10.285622+0000","last_became_active":"2023-10-25T23:36:09.290151+0000","last_became_peered":"2023-10-25T23:36:09.290151+0000","last_unstale":"2023-10-25T23:36:10.285622+0000","last_undegraded":"2023-10-25T23:36:10.285622+0000","last_fullsized":"2023-10-25T23:36:10.285622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:51:49.011246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285753+0000","last_change":"2023-10-25T23:36:08.272161+0000","last_active":"2023-10-25T23:36:10.285753+0000","last_peered":"2023-10-25T23:36:10.285753+0000","last_clean":"2023-10-25T23:36:10.285753+0000","last_became_active":"2023-10-25T23:36:08.271846+0000","last_became_peered":"2023-10-25T23:36:08.271846+0000","last_unstale":"2023-10-25T23:36:10.285753+0000","last_undegraded":"2023-10-25T23:36:10.285753+0000","last_fullsized":"2023-10-25T23:36:10.285753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:39.512919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477335+0000","last_change":"2023-10-25T23:36:09.295948+0000","last_active":"2023-10-25T23:36:10.477335+0000","last_peered":"2023-10-25T23:36:10.477335+0000","last_clean":"2023-10-25T23:36:10.477335+0000","last_became_active":"2023-10-25T23:36:09.295635+0000","last_became_peered":"2023-10-25T23:36:09.295635+0000","last_unstale":"2023-10-25T23:36:10.477335+0000","last_undegraded":"2023-10-25T23:36:10.477335+0000","last_fullsized":"2023-10-25T23:36:10.477335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:26:02.311707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.034665+0000","last_change":"2023-10-25T23:36:08.277618+0000","last_active":"2023-10-25T23:36:11.034665+0000","last_peered":"2023-10-25T23:36:11.034665+0000","last_clean":"2023-10-25T23:36:11.034665+0000","last_became_active":"2023-10-25T23:36:08.277344+0000","last_became_peered":"2023-10-25T23:36:08.277344+0000","last_unstale":"2023-10-25T23:36:11.034665+0000","last_undegraded":"2023-10-25T23:36:11.034665+0000","last_fullsized":"2023-10-25T23:36:11.034665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:21:29.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887766+0000","last_change":"2023-10-25T23:36:09.300169+0000","last_active":"2023-10-25T23:36:10.887766+0000","last_peered":"2023-10-25T23:36:10.887766+0000","last_clean":"2023-10-25T23:36:10.887766+0000","last_became_active":"2023-10-25T23:36:09.299234+0000","last_became_peered":"2023-10-25T23:36:09.299234+0000","last_unstale":"2023-10-25T23:36:10.887766+0000","last_undegraded":"2023-10-25T23:36:10.887766+0000","last_fullsized":"2023-10-25T23:36:10.887766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:29:19.996286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285721+0000","last_change":"2023-10-25T23:36:08.269389+0000","last_active":"2023-10-25T23:36:10.285721+0000","last_peered":"2023-10-25T23:36:10.285721+0000","last_clean":"2023-10-25T23:36:10.285721+0000","last_became_active":"2023-10-25T23:36:08.269065+0000","last_became_peered":"2023-10-25T23:36:08.269065+0000","last_unstale":"2023-10-25T23:36:10.285721+0000","last_undegraded":"2023-10-25T23:36:10.285721+0000","last_fullsized":"2023-10-25T23:36:10.285721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477633+0000","last_change":"2023-10-25T23:36:09.294804+0000","last_active":"2023-10-25T23:36:10.477633+0000","last_peered":"2023-10-25T23:36:10.477633+0000","last_clean":"2023-10-25T23:36:10.477633+0000","last_became_active":"2023-10-25T23:36:09.294494+0000","last_became_peered":"2023-10-25T23:36:09.294494+0000","last_unstale":"2023-10-25T23:36:10.477633+0000","last_undegraded":"2023-10-25T23:36:10.477633+0000","last_fullsized":"2023-10-25T23:36:10.477633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:11:17.452696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285801+0000","last_change":"2023-10-25T23:36:09.292116+0000","last_active":"2023-10-25T23:36:10.285801+0000","last_peered":"2023-10-25T23:36:10.285801+0000","last_clean":"2023-10-25T23:36:10.285801+0000","last_became_active":"2023-10-25T23:36:09.291665+0000","last_became_peered":"2023-10-25T23:36:09.291665+0000","last_unstale":"2023-10-25T23:36:10.285801+0000","last_undegraded":"2023-10-25T23:36:10.285801+0000","last_fullsized":"2023-10-25T23:36:10.285801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:48:33.297905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285669+0000","last_change":"2023-10-25T23:36:09.296271+0000","last_active":"2023-10-25T23:36:10.285669+0000","last_peered":"2023-10-25T23:36:10.285669+0000","last_clean":"2023-10-25T23:36:10.285669+0000","last_became_active":"2023-10-25T23:36:09.295817+0000","last_became_peered":"2023-10-25T23:36:09.295817+0000","last_unstale":"2023-10-25T23:36:10.285669+0000","last_undegraded":"2023-10-25T23:36:10.285669+0000","last_fullsized":"2023-10-25T23:36:10.285669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:41.029497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887836+0000","last_change":"2023-10-25T23:36:09.299282+0000","last_active":"2023-10-25T23:36:10.887836+0000","last_peered":"2023-10-25T23:36:10.887836+0000","last_clean":"2023-10-25T23:36:10.887836+0000","last_became_active":"2023-10-25T23:36:09.299024+0000","last_became_peered":"2023-10-25T23:36:09.299024+0000","last_unstale":"2023-10-25T23:36:10.887836+0000","last_undegraded":"2023-10-25T23:36:10.887836+0000","last_fullsized":"2023-10-25T23:36:10.887836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:46:03.954978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476512+0000","last_change":"2023-10-25T23:36:09.292598+0000","last_active":"2023-10-25T23:36:11.476512+0000","last_peered":"2023-10-25T23:36:11.476512+0000","last_clean":"2023-10-25T23:36:11.476512+0000","last_became_active":"2023-10-25T23:36:09.292344+0000","last_became_peered":"2023-10-25T23:36:09.292344+0000","last_unstale":"2023-10-25T23:36:11.476512+0000","last_undegraded":"2023-10-25T23:36:11.476512+0000","last_fullsized":"2023-10-25T23:36:11.476512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:28.346439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476706+0000","last_change":"2023-10-25T23:36:09.297451+0000","last_active":"2023-10-25T23:36:11.476706+0000","last_peered":"2023-10-25T23:36:11.476706+0000","last_clean":"2023-10-25T23:36:11.476706+0000","last_became_active":"2023-10-25T23:36:09.297202+0000","last_became_peered":"2023-10-25T23:36:09.297202+0000","last_unstale":"2023-10-25T23:36:11.476706+0000","last_undegraded":"2023-10-25T23:36:11.476706+0000","last_fullsized":"2023-10-25T23:36:11.476706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:24:52.973821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475540+0000","last_change":"2023-10-25T23:36:09.293431+0000","last_active":"2023-10-25T23:36:11.475540+0000","last_peered":"2023-10-25T23:36:11.475540+0000","last_clean":"2023-10-25T23:36:11.475540+0000","last_became_active":"2023-10-25T23:36:09.293157+0000","last_became_peered":"2023-10-25T23:36:09.293157+0000","last_unstale":"2023-10-25T23:36:11.475540+0000","last_undegraded":"2023-10-25T23:36:11.475540+0000","last_fullsized":"2023-10-25T23:36:11.475540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:51:49.011246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285934+0000","last_change":"2023-10-25T23:36:09.288432+0000","last_active":"2023-10-25T23:36:10.285934+0000","last_peered":"2023-10-25T23:36:10.285934+0000","last_clean":"2023-10-25T23:36:10.285934+0000","last_became_active":"2023-10-25T23:36:09.288127+0000","last_became_peered":"2023-10-25T23:36:09.288127+0000","last_unstale":"2023-10-25T23:36:10.285934+0000","last_undegraded":"2023-10-25T23:36:10.285934+0000","last_fullsized":"2023-10-25T23:36:10.285934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:06.986689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.477001+0000","last_change":"2023-10-25T23:36:09.290608+0000","last_active":"2023-10-25T23:36:11.477001+0000","last_peered":"2023-10-25T23:36:11.477001+0000","last_clean":"2023-10-25T23:36:11.477001+0000","last_became_active":"2023-10-25T23:36:09.290160+0000","last_became_peered":"2023-10-25T23:36:09.290160+0000","last_unstale":"2023-10-25T23:36:11.477001+0000","last_undegraded":"2023-10-25T23:36:11.477001+0000","last_fullsized":"2023-10-25T23:36:11.477001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:58:48.401709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887814+0000","last_change":"2023-10-25T23:36:09.298886+0000","last_active":"2023-10-25T23:36:10.887814+0000","last_peered":"2023-10-25T23:36:10.887814+0000","last_clean":"2023-10-25T23:36:10.887814+0000","last_became_active":"2023-10-25T23:36:09.298637+0000","last_became_peered":"2023-10-25T23:36:09.298637+0000","last_unstale":"2023-10-25T23:36:10.887814+0000","last_undegraded":"2023-10-25T23:36:10.887814+0000","last_fullsized":"2023-10-25T23:36:10.887814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:58:48.401709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476265+0000","last_change":"2023-10-25T23:36:09.290809+0000","last_active":"2023-10-25T23:36:11.476265+0000","last_peered":"2023-10-25T23:36:11.476265+0000","last_clean":"2023-10-25T23:36:11.476265+0000","last_became_active":"2023-10-25T23:36:09.290546+0000","last_became_peered":"2023-10-25T23:36:09.290546+0000","last_unstale":"2023-10-25T23:36:11.476265+0000","last_undegraded":"2023-10-25T23:36:11.476265+0000","last_fullsized":"2023-10-25T23:36:11.476265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:48:33.297905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887720+0000","last_change":"2023-10-25T23:36:09.296735+0000","last_active":"2023-10-25T23:36:10.887720+0000","last_peered":"2023-10-25T23:36:10.887720+0000","last_clean":"2023-10-25T23:36:10.887720+0000","last_became_active":"2023-10-25T23:36:09.296280+0000","last_became_peered":"2023-10-25T23:36:09.296280+0000","last_unstale":"2023-10-25T23:36:10.887720+0000","last_undegraded":"2023-10-25T23:36:10.887720+0000","last_fullsized":"2023-10-25T23:36:10.887720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:28:06.035601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476395+0000","last_change":"2023-10-25T23:36:09.285887+0000","last_active":"2023-10-25T23:36:11.476395+0000","last_peered":"2023-10-25T23:36:11.476395+0000","last_clean":"2023-10-25T23:36:11.476395+0000","last_became_active":"2023-10-25T23:36:09.285610+0000","last_became_peered":"2023-10-25T23:36:09.285610+0000","last_unstale":"2023-10-25T23:36:11.476395+0000","last_undegraded":"2023-10-25T23:36:11.476395+0000","last_fullsized":"2023-10-25T23:36:11.476395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:38:19.348985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285693+0000","last_change":"2023-10-25T23:36:09.291838+0000","last_active":"2023-10-25T23:36:10.285693+0000","last_peered":"2023-10-25T23:36:10.285693+0000","last_clean":"2023-10-25T23:36:10.285693+0000","last_became_active":"2023-10-25T23:36:09.291566+0000","last_became_peered":"2023-10-25T23:36:09.291566+0000","last_unstale":"2023-10-25T23:36:10.285693+0000","last_undegraded":"2023-10-25T23:36:10.285693+0000","last_fullsized":"2023-10-25T23:36:10.285693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:26:04.639901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.052}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.175000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.236000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.0510000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.206}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-25T23:36:18.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T23:36:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.536+0000 7f883c54d700 1 -- 172.21.15.81:0/1295446940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88341454f0 msgr2=0x7f883414ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.536+0000 7f883c54d700 1 --2- 172.21.15.81:0/1295446940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88341454f0 0x7f883414ec20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f88340b7b80 tx=0x7f8824009c70 comp rx=0 tx=0).stop 2023-10-25T23:36:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.537+0000 7f883c54d700 1 -- 172.21.15.81:0/1295446940 shutdown_connections 2023-10-25T23:36:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.537+0000 7f883c54d700 1 --2- 172.21.15.81:0/1295446940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f883414b220 0x7f883414b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.537+0000 7f883c54d700 1 --2- 172.21.15.81:0/1295446940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88341454f0 0x7f883414ec20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.537+0000 7f883c54d700 1 --2- 172.21.15.81:0/1295446940 >> v2:172.21.15.89:3300/0 conn(0x7f883406cd80 0x7f883414f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.537+0000 7f883c54d700 1 -- 172.21.15.81:0/1295446940 >> 172.21.15.81:0/1295446940 conn(0x7f88340c0a40 msgr2=0x7f88340c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.537+0000 7f883c54d700 1 -- 172.21.15.81:0/1295446940 shutdown_connections 2023-10-25T23:36:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.537+0000 7f883c54d700 1 -- 172.21.15.81:0/1295446940 wait complete. 2023-10-25T23:36:18.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.538+0000 7f883c54d700 1 Processor -- start 2023-10-25T23:36:18.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.538+0000 7f883c54d700 1 -- start start 2023-10-25T23:36:18.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.538+0000 7f883c54d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f883406cd80 0x7f88341e29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:18.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.538+0000 7f883c54d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88341454f0 0x7f88340bbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:18.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.538+0000 7f883c54d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f883414b220 0x7f8834143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:18.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.538+0000 7f883c54d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834134c50 con 0x7f883414b220 2023-10-25T23:36:18.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.538+0000 7f883c54d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883406a210 con 0x7f883406cd80 2023-10-25T23:36:18.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.538+0000 7f883c54d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88341341e0 con 0x7f88341454f0 2023-10-25T23:36:18.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.538+0000 7f883aaea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f883414b220 0x7f8834143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:18.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.539+0000 7f883aaea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f883414b220 0x7f8834143cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36678/0 (socket says 172.21.15.81:36678) 2023-10-25T23:36:18.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.539+0000 7f883aaea700 1 -- 172.21.15.81:0/4239259924 learned_addr learned my addr 172.21.15.81:0/4239259924 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:18.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.539+0000 7f883a2e9700 1 --2- 172.21.15.81:0/4239259924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f883406cd80 0x7f88341e29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:18.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.539+0000 7f8839ae8700 1 --2- 172.21.15.81:0/4239259924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88341454f0 0x7f88340bbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:18.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.539+0000 7f883aaea700 1 -- 172.21.15.81:0/4239259924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88341454f0 msgr2=0x7f88340bbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:18.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.539+0000 7f883aaea700 1 --2- 172.21.15.81:0/4239259924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88341454f0 0x7f88340bbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.539+0000 7f883aaea700 1 -- 172.21.15.81:0/4239259924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f883406cd80 msgr2=0x7f88341e29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:18.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.539+0000 7f883aaea700 1 --2- 172.21.15.81:0/4239259924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f883406cd80 0x7f88341e29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.539+0000 7f883aaea700 1 -- 172.21.15.81:0/4239259924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88240095f0 con 0x7f883414b220 2023-10-25T23:36:18.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.539+0000 7f883aaea700 1 --2- 172.21.15.81:0/4239259924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f883414b220 0x7f8834143cc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f882c00b970 tx=0x7f882c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:18.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.539+0000 7f882affd700 1 -- 172.21.15.81:0/4239259924 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c00d860 con 0x7f883414b220 2023-10-25T23:36:18.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.539+0000 7f882affd700 1 -- 172.21.15.81:0/4239259924 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f882c00dad0 con 0x7f883414b220 2023-10-25T23:36:18.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.539+0000 7f883c54d700 1 -- 172.21.15.81:0/4239259924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88341344c0 con 0x7f883414b220 2023-10-25T23:36:18.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.539+0000 7f882affd700 1 -- 172.21.15.81:0/4239259924 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c00e430 con 0x7f883414b220 2023-10-25T23:36:18.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.539+0000 7f883c54d700 1 -- 172.21.15.81:0/4239259924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88340bc2e0 con 0x7f883414b220 2023-10-25T23:36:18.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.540+0000 7f883c54d700 1 -- 172.21.15.81:0/4239259924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8834134650 con 0x7f883414b220 2023-10-25T23:36:18.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.541+0000 7f882affd700 1 -- 172.21.15.81:0/4239259924 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f882c00e590 con 0x7f883414b220 2023-10-25T23:36:18.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.541+0000 7f882affd700 1 --2- 172.21.15.81:0/4239259924 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f881806aed0 0x7f881806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:18.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.541+0000 7f882affd700 1 -- 172.21.15.81:0/4239259924 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f882c089a10 con 0x7f883414b220 2023-10-25T23:36:18.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.541+0000 7f883a2e9700 1 --2- 172.21.15.81:0/4239259924 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f881806aed0 0x7f881806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:18.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.541+0000 7f883a2e9700 1 --2- 172.21.15.81:0/4239259924 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f881806aed0 0x7f881806d390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88240098e0 tx=0x7f88240047c0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.545+0000 7f882affd700 1 -- 172.21.15.81:0/4239259924 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f882c054a40 con 0x7f883414b220 2023-10-25T23:36:18.730 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.730+0000 7f883c54d700 1 -- 172.21.15.81:0/4239259924 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88340bd140 con 0x7f881806aed0 2023-10-25T23:36:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.738+0000 7f882affd700 1 -- 172.21.15.81:0/4239259924 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264591 (secure 0 0 0) 0x7f882401e040 con 0x7f881806aed0 2023-10-25T23:36:18.742 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:18.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.741+0000 7f883c54d700 1 -- 172.21.15.81:0/4239259924 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f881806aed0 msgr2=0x7f881806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:18.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.741+0000 7f883c54d700 1 --2- 172.21.15.81:0/4239259924 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f881806aed0 0x7f881806d390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88240098e0 tx=0x7f88240047c0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.741+0000 7f883c54d700 1 -- 172.21.15.81:0/4239259924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f883414b220 msgr2=0x7f8834143cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:18.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.741+0000 7f883c54d700 1 --2- 172.21.15.81:0/4239259924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f883414b220 0x7f8834143cc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f882c00b970 tx=0x7f882c00bc80 comp rx=0 tx=0).stop 2023-10-25T23:36:18.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.741+0000 7f883c54d700 1 -- 172.21.15.81:0/4239259924 shutdown_connections 2023-10-25T23:36:18.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.741+0000 7f883c54d700 1 --2- 172.21.15.81:0/4239259924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f883414b220 0x7f8834143cc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.741+0000 7f883c54d700 1 --2- 172.21.15.81:0/4239259924 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f881806aed0 0x7f881806d390 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.741+0000 7f883c54d700 1 --2- 172.21.15.81:0/4239259924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f883406cd80 0x7f88341e29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.741+0000 7f883c54d700 1 --2- 172.21.15.81:0/4239259924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88341454f0 0x7f88340bbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.741+0000 7f883c54d700 1 -- 172.21.15.81:0/4239259924 >> 172.21.15.81:0/4239259924 conn(0x7f88340c0a40 msgr2=0x7f883414aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:18.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.741+0000 7f883c54d700 1 -- 172.21.15.81:0/4239259924 shutdown_connections 2023-10-25T23:36:18.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.741+0000 7f883c54d700 1 -- 172.21.15.81:0/4239259924 wait complete. 2023-10-25T23:36:18.746 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-25T23:36:18.754 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-25T23:36:16.990986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219116,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755604,"statfs":{"total":773094113280,"available":772869738496,"internally_reserved":0,"allocated":2990080,"data_stored":1790108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":221236792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001713"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477723+0000","last_change":"2023-10-25T23:36:09.292535+0000","last_active":"2023-10-25T23:36:10.477723+0000","last_peered":"2023-10-25T23:36:10.477723+0000","last_clean":"2023-10-25T23:36:10.477723+0000","last_became_active":"2023-10-25T23:36:09.292007+0000","last_became_peered":"2023-10-25T23:36:09.292007+0000","last_unstale":"2023-10-25T23:36:10.477723+0000","last_undegraded":"2023-10-25T23:36:10.477723+0000","last_fullsized":"2023-10-25T23:36:10.477723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:54:42.179401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475807+0000","last_change":"2023-10-25T23:36:09.282198+0000","last_active":"2023-10-25T23:36:11.475807+0000","last_peered":"2023-10-25T23:36:11.475807+0000","last_clean":"2023-10-25T23:36:11.475807+0000","last_became_active":"2023-10-25T23:36:09.281890+0000","last_became_peered":"2023-10-25T23:36:09.281890+0000","last_unstale":"2023-10-25T23:36:11.475807+0000","last_undegraded":"2023-10-25T23:36:11.475807+0000","last_fullsized":"2023-10-25T23:36:11.475807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:48:33.297905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475325+0000","last_change":"2023-10-25T23:36:09.284367+0000","last_active":"2023-10-25T23:36:11.475325+0000","last_peered":"2023-10-25T23:36:11.475325+0000","last_clean":"2023-10-25T23:36:11.475325+0000","last_became_active":"2023-10-25T23:36:09.284066+0000","last_became_peered":"2023-10-25T23:36:09.284066+0000","last_unstale":"2023-10-25T23:36:11.475325+0000","last_undegraded":"2023-10-25T23:36:11.475325+0000","last_fullsized":"2023-10-25T23:36:11.475325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:21:30.068321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887928+0000","last_change":"2023-10-25T23:36:09.300380+0000","last_active":"2023-10-25T23:36:10.887928+0000","last_peered":"2023-10-25T23:36:10.887928+0000","last_clean":"2023-10-25T23:36:10.887928+0000","last_became_active":"2023-10-25T23:36:09.299585+0000","last_became_peered":"2023-10-25T23:36:09.299585+0000","last_unstale":"2023-10-25T23:36:10.887928+0000","last_undegraded":"2023-10-25T23:36:10.887928+0000","last_fullsized":"2023-10-25T23:36:10.887928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:54.492612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477102+0000","last_change":"2023-10-25T23:36:09.287693+0000","last_active":"2023-10-25T23:36:10.477102+0000","last_peered":"2023-10-25T23:36:10.477102+0000","last_clean":"2023-10-25T23:36:10.477102+0000","last_became_active":"2023-10-25T23:36:09.287403+0000","last_became_peered":"2023-10-25T23:36:09.287403+0000","last_unstale":"2023-10-25T23:36:10.477102+0000","last_undegraded":"2023-10-25T23:36:10.477102+0000","last_fullsized":"2023-10-25T23:36:10.477102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:58:48.401709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887662+0000","last_change":"2023-10-25T23:36:09.301596+0000","last_active":"2023-10-25T23:36:10.887662+0000","last_peered":"2023-10-25T23:36:10.887662+0000","last_clean":"2023-10-25T23:36:10.887662+0000","last_became_active":"2023-10-25T23:36:09.301305+0000","last_became_peered":"2023-10-25T23:36:09.301305+0000","last_unstale":"2023-10-25T23:36:10.887662+0000","last_undegraded":"2023-10-25T23:36:10.887662+0000","last_fullsized":"2023-10-25T23:36:10.887662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:24:52.973821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477210+0000","last_change":"2023-10-25T23:36:09.293643+0000","last_active":"2023-10-25T23:36:10.477210+0000","last_peered":"2023-10-25T23:36:10.477210+0000","last_clean":"2023-10-25T23:36:10.477210+0000","last_became_active":"2023-10-25T23:36:09.293173+0000","last_became_peered":"2023-10-25T23:36:09.293173+0000","last_unstale":"2023-10-25T23:36:10.477210+0000","last_undegraded":"2023-10-25T23:36:10.477210+0000","last_fullsized":"2023-10-25T23:36:10.477210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:54.492612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475218+0000","last_change":"2023-10-25T23:36:09.295727+0000","last_active":"2023-10-25T23:36:11.475218+0000","last_peered":"2023-10-25T23:36:11.475218+0000","last_clean":"2023-10-25T23:36:11.475218+0000","last_became_active":"2023-10-25T23:36:09.295518+0000","last_became_peered":"2023-10-25T23:36:09.295518+0000","last_unstale":"2023-10-25T23:36:11.475218+0000","last_undegraded":"2023-10-25T23:36:11.475218+0000","last_fullsized":"2023-10-25T23:36:11.475218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:38:19.348985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477732+0000","last_change":"2023-10-25T23:36:09.297377+0000","last_active":"2023-10-25T23:36:10.477732+0000","last_peered":"2023-10-25T23:36:10.477732+0000","last_clean":"2023-10-25T23:36:10.477732+0000","last_became_active":"2023-10-25T23:36:09.297036+0000","last_became_peered":"2023-10-25T23:36:09.297036+0000","last_unstale":"2023-10-25T23:36:10.477732+0000","last_undegraded":"2023-10-25T23:36:10.477732+0000","last_fullsized":"2023-10-25T23:36:10.477732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:18:29.087327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285803+0000","last_change":"2023-10-25T23:36:09.298222+0000","last_active":"2023-10-25T23:36:10.285803+0000","last_peered":"2023-10-25T23:36:10.285803+0000","last_clean":"2023-10-25T23:36:10.285803+0000","last_became_active":"2023-10-25T23:36:09.297713+0000","last_became_peered":"2023-10-25T23:36:09.297713+0000","last_unstale":"2023-10-25T23:36:10.285803+0000","last_undegraded":"2023-10-25T23:36:10.285803+0000","last_fullsized":"2023-10-25T23:36:10.285803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:09:27.102927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285557+0000","last_change":"2023-10-25T23:36:09.297392+0000","last_active":"2023-10-25T23:36:10.285557+0000","last_peered":"2023-10-25T23:36:10.285557+0000","last_clean":"2023-10-25T23:36:10.285557+0000","last_became_active":"2023-10-25T23:36:09.297133+0000","last_became_peered":"2023-10-25T23:36:09.297133+0000","last_unstale":"2023-10-25T23:36:10.285557+0000","last_undegraded":"2023-10-25T23:36:10.285557+0000","last_fullsized":"2023-10-25T23:36:10.285557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:28.346439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.287003+0000","last_change":"2023-10-25T23:36:09.291669+0000","last_active":"2023-10-25T23:36:10.287003+0000","last_peered":"2023-10-25T23:36:10.287003+0000","last_clean":"2023-10-25T23:36:10.287003+0000","last_became_active":"2023-10-25T23:36:09.291351+0000","last_became_peered":"2023-10-25T23:36:09.291351+0000","last_unstale":"2023-10-25T23:36:10.287003+0000","last_undegraded":"2023-10-25T23:36:10.287003+0000","last_fullsized":"2023-10-25T23:36:10.287003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:01.440988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476244+0000","last_change":"2023-10-25T23:36:09.290180+0000","last_active":"2023-10-25T23:36:11.476244+0000","last_peered":"2023-10-25T23:36:11.476244+0000","last_clean":"2023-10-25T23:36:11.476244+0000","last_became_active":"2023-10-25T23:36:09.289895+0000","last_became_peered":"2023-10-25T23:36:09.289895+0000","last_unstale":"2023-10-25T23:36:11.476244+0000","last_undegraded":"2023-10-25T23:36:11.476244+0000","last_fullsized":"2023-10-25T23:36:11.476244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:26:04.639901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476188+0000","last_change":"2023-10-25T23:36:09.283494+0000","last_active":"2023-10-25T23:36:11.476188+0000","last_peered":"2023-10-25T23:36:11.476188+0000","last_clean":"2023-10-25T23:36:11.476188+0000","last_became_active":"2023-10-25T23:36:09.283250+0000","last_became_peered":"2023-10-25T23:36:09.283250+0000","last_unstale":"2023-10-25T23:36:11.476188+0000","last_undegraded":"2023-10-25T23:36:11.476188+0000","last_fullsized":"2023-10-25T23:36:11.476188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:11:38.668268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475213+0000","last_change":"2023-10-25T23:36:09.286460+0000","last_active":"2023-10-25T23:36:11.475213+0000","last_peered":"2023-10-25T23:36:11.475213+0000","last_clean":"2023-10-25T23:36:11.475213+0000","last_became_active":"2023-10-25T23:36:09.286191+0000","last_became_peered":"2023-10-25T23:36:09.286191+0000","last_unstale":"2023-10-25T23:36:11.475213+0000","last_undegraded":"2023-10-25T23:36:11.475213+0000","last_fullsized":"2023-10-25T23:36:11.475213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:38:19.348985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887574+0000","last_change":"2023-10-25T23:36:09.301475+0000","last_active":"2023-10-25T23:36:10.887574+0000","last_peered":"2023-10-25T23:36:10.887574+0000","last_clean":"2023-10-25T23:36:10.887574+0000","last_became_active":"2023-10-25T23:36:09.301040+0000","last_became_peered":"2023-10-25T23:36:09.301040+0000","last_unstale":"2023-10-25T23:36:10.887574+0000","last_undegraded":"2023-10-25T23:36:10.887574+0000","last_fullsized":"2023-10-25T23:36:10.887574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:06.986689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888186+0000","last_change":"2023-10-25T23:36:09.298189+0000","last_active":"2023-10-25T23:36:10.888186+0000","last_peered":"2023-10-25T23:36:10.888186+0000","last_clean":"2023-10-25T23:36:10.888186+0000","last_became_active":"2023-10-25T23:36:09.297892+0000","last_became_peered":"2023-10-25T23:36:09.297892+0000","last_unstale":"2023-10-25T23:36:10.888186+0000","last_undegraded":"2023-10-25T23:36:10.888186+0000","last_fullsized":"2023-10-25T23:36:10.888186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:54:42.179401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285710+0000","last_change":"2023-10-25T23:36:09.282631+0000","last_active":"2023-10-25T23:36:10.285710+0000","last_peered":"2023-10-25T23:36:10.285710+0000","last_clean":"2023-10-25T23:36:10.285710+0000","last_became_active":"2023-10-25T23:36:09.282282+0000","last_became_peered":"2023-10-25T23:36:09.282282+0000","last_unstale":"2023-10-25T23:36:10.285710+0000","last_undegraded":"2023-10-25T23:36:10.285710+0000","last_fullsized":"2023-10-25T23:36:10.285710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:27.001592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477144+0000","last_change":"2023-10-25T23:36:09.289744+0000","last_active":"2023-10-25T23:36:10.477144+0000","last_peered":"2023-10-25T23:36:10.477144+0000","last_clean":"2023-10-25T23:36:10.477144+0000","last_became_active":"2023-10-25T23:36:09.289457+0000","last_became_peered":"2023-10-25T23:36:09.289457+0000","last_unstale":"2023-10-25T23:36:10.477144+0000","last_undegraded":"2023-10-25T23:36:10.477144+0000","last_fullsized":"2023-10-25T23:36:10.477144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:25:22.432043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.034696+0000","last_change":"2023-10-25T23:36:08.271164+0000","last_active":"2023-10-25T23:36:11.034696+0000","last_peered":"2023-10-25T23:36:11.034696+0000","last_clean":"2023-10-25T23:36:11.034696+0000","last_became_active":"2023-10-25T23:36:08.270911+0000","last_became_peered":"2023-10-25T23:36:08.270911+0000","last_unstale":"2023-10-25T23:36:11.034696+0000","last_undegraded":"2023-10-25T23:36:11.034696+0000","last_fullsized":"2023-10-25T23:36:11.034696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476832+0000","last_change":"2023-10-25T23:36:09.290526+0000","last_active":"2023-10-25T23:36:11.476832+0000","last_peered":"2023-10-25T23:36:11.476832+0000","last_clean":"2023-10-25T23:36:11.476832+0000","last_became_active":"2023-10-25T23:36:09.290260+0000","last_became_peered":"2023-10-25T23:36:09.290260+0000","last_unstale":"2023-10-25T23:36:11.476832+0000","last_undegraded":"2023-10-25T23:36:11.476832+0000","last_fullsized":"2023-10-25T23:36:11.476832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:28:06.035601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.036228+0000","last_change":"2023-10-25T23:36:08.269993+0000","last_active":"2023-10-25T23:36:11.036228+0000","last_peered":"2023-10-25T23:36:11.036228+0000","last_clean":"2023-10-25T23:36:11.036228+0000","last_became_active":"2023-10-25T23:36:08.269443+0000","last_became_peered":"2023-10-25T23:36:08.269443+0000","last_unstale":"2023-10-25T23:36:11.036228+0000","last_undegraded":"2023-10-25T23:36:11.036228+0000","last_fullsized":"2023-10-25T23:36:11.036228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.477098+0000","last_change":"2023-10-25T23:36:09.300013+0000","last_active":"2023-10-25T23:36:11.477098+0000","last_peered":"2023-10-25T23:36:11.477098+0000","last_clean":"2023-10-25T23:36:11.477098+0000","last_became_active":"2023-10-25T23:36:09.299738+0000","last_became_peered":"2023-10-25T23:36:09.299738+0000","last_unstale":"2023-10-25T23:36:11.477098+0000","last_undegraded":"2023-10-25T23:36:11.477098+0000","last_fullsized":"2023-10-25T23:36:11.477098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:48:33.297905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477442+0000","last_change":"2023-10-25T23:36:08.273879+0000","last_active":"2023-10-25T23:36:10.477442+0000","last_peered":"2023-10-25T23:36:10.477442+0000","last_clean":"2023-10-25T23:36:10.477442+0000","last_became_active":"2023-10-25T23:36:08.273574+0000","last_became_peered":"2023-10-25T23:36:08.273574+0000","last_unstale":"2023-10-25T23:36:10.477442+0000","last_undegraded":"2023-10-25T23:36:10.477442+0000","last_fullsized":"2023-10-25T23:36:10.477442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:27.340205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887909+0000","last_change":"2023-10-25T23:36:09.300549+0000","last_active":"2023-10-25T23:36:10.887909+0000","last_peered":"2023-10-25T23:36:10.887909+0000","last_clean":"2023-10-25T23:36:10.887909+0000","last_became_active":"2023-10-25T23:36:09.299916+0000","last_became_peered":"2023-10-25T23:36:09.299916+0000","last_unstale":"2023-10-25T23:36:10.887909+0000","last_undegraded":"2023-10-25T23:36:10.887909+0000","last_fullsized":"2023-10-25T23:36:10.887909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:25:22.432043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477055+0000","last_change":"2023-10-25T23:36:08.271714+0000","last_active":"2023-10-25T23:36:10.477055+0000","last_peered":"2023-10-25T23:36:10.477055+0000","last_clean":"2023-10-25T23:36:10.477055+0000","last_became_active":"2023-10-25T23:36:08.271442+0000","last_became_peered":"2023-10-25T23:36:08.271442+0000","last_unstale":"2023-10-25T23:36:10.477055+0000","last_undegraded":"2023-10-25T23:36:10.477055+0000","last_fullsized":"2023-10-25T23:36:10.477055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888055+0000","last_change":"2023-10-25T23:36:09.299476+0000","last_active":"2023-10-25T23:36:10.888055+0000","last_peered":"2023-10-25T23:36:10.888055+0000","last_clean":"2023-10-25T23:36:10.888055+0000","last_became_active":"2023-10-25T23:36:09.299130+0000","last_became_peered":"2023-10-25T23:36:09.299130+0000","last_unstale":"2023-10-25T23:36:10.888055+0000","last_undegraded":"2023-10-25T23:36:10.888055+0000","last_fullsized":"2023-10-25T23:36:10.888055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:53:09.911467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.036183+0000","last_change":"2023-10-25T23:36:08.271119+0000","last_active":"2023-10-25T23:36:11.036183+0000","last_peered":"2023-10-25T23:36:11.036183+0000","last_clean":"2023-10-25T23:36:11.036183+0000","last_became_active":"2023-10-25T23:36:08.270138+0000","last_became_peered":"2023-10-25T23:36:08.270138+0000","last_unstale":"2023-10-25T23:36:11.036183+0000","last_undegraded":"2023-10-25T23:36:11.036183+0000","last_fullsized":"2023-10-25T23:36:11.036183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286865+0000","last_change":"2023-10-25T23:36:09.287742+0000","last_active":"2023-10-25T23:36:10.286865+0000","last_peered":"2023-10-25T23:36:10.286865+0000","last_clean":"2023-10-25T23:36:10.286865+0000","last_became_active":"2023-10-25T23:36:09.287455+0000","last_became_peered":"2023-10-25T23:36:09.287455+0000","last_unstale":"2023-10-25T23:36:10.286865+0000","last_undegraded":"2023-10-25T23:36:10.286865+0000","last_fullsized":"2023-10-25T23:36:10.286865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:41.029497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285393+0000","last_change":"2023-10-25T23:36:08.272686+0000","last_active":"2023-10-25T23:36:10.285393+0000","last_peered":"2023-10-25T23:36:10.285393+0000","last_clean":"2023-10-25T23:36:10.285393+0000","last_became_active":"2023-10-25T23:36:08.271974+0000","last_became_peered":"2023-10-25T23:36:08.271974+0000","last_unstale":"2023-10-25T23:36:10.285393+0000","last_undegraded":"2023-10-25T23:36:10.285393+0000","last_fullsized":"2023-10-25T23:36:10.285393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476625+0000","last_change":"2023-10-25T23:36:09.294574+0000","last_active":"2023-10-25T23:36:11.476625+0000","last_peered":"2023-10-25T23:36:11.476625+0000","last_clean":"2023-10-25T23:36:11.476625+0000","last_became_active":"2023-10-25T23:36:09.294176+0000","last_became_peered":"2023-10-25T23:36:09.294176+0000","last_unstale":"2023-10-25T23:36:11.476625+0000","last_undegraded":"2023-10-25T23:36:11.476625+0000","last_fullsized":"2023-10-25T23:36:11.476625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:51:49.011246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.036146+0000","last_change":"2023-10-25T23:36:08.273513+0000","last_active":"2023-10-25T23:36:11.036146+0000","last_peered":"2023-10-25T23:36:11.036146+0000","last_clean":"2023-10-25T23:36:11.036146+0000","last_became_active":"2023-10-25T23:36:08.273035+0000","last_became_peered":"2023-10-25T23:36:08.273035+0000","last_unstale":"2023-10-25T23:36:11.036146+0000","last_undegraded":"2023-10-25T23:36:11.036146+0000","last_fullsized":"2023-10-25T23:36:11.036146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:21:29.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475380+0000","last_change":"2023-10-25T23:36:09.292852+0000","last_active":"2023-10-25T23:36:11.475380+0000","last_peered":"2023-10-25T23:36:11.475380+0000","last_clean":"2023-10-25T23:36:11.475380+0000","last_became_active":"2023-10-25T23:36:09.292546+0000","last_became_peered":"2023-10-25T23:36:09.292546+0000","last_unstale":"2023-10-25T23:36:11.475380+0000","last_undegraded":"2023-10-25T23:36:11.475380+0000","last_fullsized":"2023-10-25T23:36:11.475380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:28.346439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887617+0000","last_change":"2023-10-25T23:36:08.277462+0000","last_active":"2023-10-25T23:36:10.887617+0000","last_peered":"2023-10-25T23:36:10.887617+0000","last_clean":"2023-10-25T23:36:10.887617+0000","last_became_active":"2023-10-25T23:36:08.277138+0000","last_became_peered":"2023-10-25T23:36:08.277138+0000","last_unstale":"2023-10-25T23:36:10.887617+0000","last_undegraded":"2023-10-25T23:36:10.887617+0000","last_fullsized":"2023-10-25T23:36:10.887617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:48:32.291671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475992+0000","last_change":"2023-10-25T23:36:09.290725+0000","last_active":"2023-10-25T23:36:11.475992+0000","last_peered":"2023-10-25T23:36:11.475992+0000","last_clean":"2023-10-25T23:36:11.475992+0000","last_became_active":"2023-10-25T23:36:09.290456+0000","last_became_peered":"2023-10-25T23:36:09.290456+0000","last_unstale":"2023-10-25T23:36:11.475992+0000","last_undegraded":"2023-10-25T23:36:11.475992+0000","last_fullsized":"2023-10-25T23:36:11.475992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:09:27.102927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285660+0000","last_change":"2023-10-25T23:36:08.272869+0000","last_active":"2023-10-25T23:36:10.285660+0000","last_peered":"2023-10-25T23:36:10.285660+0000","last_clean":"2023-10-25T23:36:10.285660+0000","last_became_active":"2023-10-25T23:36:08.272120+0000","last_became_peered":"2023-10-25T23:36:08.272120+0000","last_unstale":"2023-10-25T23:36:10.285660+0000","last_undegraded":"2023-10-25T23:36:10.285660+0000","last_fullsized":"2023-10-25T23:36:10.285660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888137+0000","last_change":"2023-10-25T23:36:09.293442+0000","last_active":"2023-10-25T23:36:10.888137+0000","last_peered":"2023-10-25T23:36:10.888137+0000","last_clean":"2023-10-25T23:36:10.888137+0000","last_became_active":"2023-10-25T23:36:09.293132+0000","last_became_peered":"2023-10-25T23:36:09.293132+0000","last_unstale":"2023-10-25T23:36:10.888137+0000","last_undegraded":"2023-10-25T23:36:10.888137+0000","last_fullsized":"2023-10-25T23:36:10.888137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:11:17.452696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888026+0000","last_change":"2023-10-25T23:36:08.272920+0000","last_active":"2023-10-25T23:36:10.888026+0000","last_peered":"2023-10-25T23:36:10.888026+0000","last_clean":"2023-10-25T23:36:10.888026+0000","last_became_active":"2023-10-25T23:36:08.272596+0000","last_became_peered":"2023-10-25T23:36:08.272596+0000","last_unstale":"2023-10-25T23:36:10.888026+0000","last_undegraded":"2023-10-25T23:36:10.888026+0000","last_fullsized":"2023-10-25T23:36:10.888026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.477236+0000","last_change":"2023-10-25T23:36:09.300238+0000","last_active":"2023-10-25T23:36:11.477236+0000","last_peered":"2023-10-25T23:36:11.477236+0000","last_clean":"2023-10-25T23:36:11.477236+0000","last_became_active":"2023-10-25T23:36:09.299938+0000","last_became_peered":"2023-10-25T23:36:09.299938+0000","last_unstale":"2023-10-25T23:36:11.477236+0000","last_undegraded":"2023-10-25T23:36:11.477236+0000","last_fullsized":"2023-10-25T23:36:11.477236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:09:27.102927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.034678+0000","last_change":"2023-10-25T23:36:08.279751+0000","last_active":"2023-10-25T23:36:11.034678+0000","last_peered":"2023-10-25T23:36:11.034678+0000","last_clean":"2023-10-25T23:36:11.034678+0000","last_became_active":"2023-10-25T23:36:08.279509+0000","last_became_peered":"2023-10-25T23:36:08.279509+0000","last_unstale":"2023-10-25T23:36:11.034678+0000","last_undegraded":"2023-10-25T23:36:11.034678+0000","last_fullsized":"2023-10-25T23:36:11.034678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286903+0000","last_change":"2023-10-25T23:36:09.285566+0000","last_active":"2023-10-25T23:36:10.286903+0000","last_peered":"2023-10-25T23:36:10.286903+0000","last_clean":"2023-10-25T23:36:10.286903+0000","last_became_active":"2023-10-25T23:36:09.285196+0000","last_became_peered":"2023-10-25T23:36:09.285196+0000","last_unstale":"2023-10-25T23:36:10.286903+0000","last_undegraded":"2023-10-25T23:36:10.286903+0000","last_fullsized":"2023-10-25T23:36:10.286903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:27.001592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285737+0000","last_change":"2023-10-25T23:36:08.272911+0000","last_active":"2023-10-25T23:36:10.285737+0000","last_peered":"2023-10-25T23:36:10.285737+0000","last_clean":"2023-10-25T23:36:10.285737+0000","last_became_active":"2023-10-25T23:36:08.272248+0000","last_became_peered":"2023-10-25T23:36:08.272248+0000","last_unstale":"2023-10-25T23:36:10.285737+0000","last_undegraded":"2023-10-25T23:36:10.285737+0000","last_fullsized":"2023-10-25T23:36:10.285737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477155+0000","last_change":"2023-10-25T23:36:09.292562+0000","last_active":"2023-10-25T23:36:10.477155+0000","last_peered":"2023-10-25T23:36:10.477155+0000","last_clean":"2023-10-25T23:36:10.477155+0000","last_became_active":"2023-10-25T23:36:09.292300+0000","last_became_peered":"2023-10-25T23:36:09.292300+0000","last_unstale":"2023-10-25T23:36:10.477155+0000","last_undegraded":"2023-10-25T23:36:10.477155+0000","last_fullsized":"2023-10-25T23:36:10.477155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:46:03.954978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.034648+0000","last_change":"2023-10-25T23:36:08.274407+0000","last_active":"2023-10-25T23:36:11.034648+0000","last_peered":"2023-10-25T23:36:11.034648+0000","last_clean":"2023-10-25T23:36:11.034648+0000","last_became_active":"2023-10-25T23:36:08.274162+0000","last_became_peered":"2023-10-25T23:36:08.274162+0000","last_unstale":"2023-10-25T23:36:11.034648+0000","last_undegraded":"2023-10-25T23:36:11.034648+0000","last_fullsized":"2023-10-25T23:36:11.034648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476045+0000","last_change":"2023-10-25T23:36:09.284635+0000","last_active":"2023-10-25T23:36:11.476045+0000","last_peered":"2023-10-25T23:36:11.476045+0000","last_clean":"2023-10-25T23:36:11.476045+0000","last_became_active":"2023-10-25T23:36:09.284386+0000","last_became_peered":"2023-10-25T23:36:09.284386+0000","last_unstale":"2023-10-25T23:36:11.476045+0000","last_undegraded":"2023-10-25T23:36:11.476045+0000","last_fullsized":"2023-10-25T23:36:11.476045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:26.427642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887950+0000","last_change":"2023-10-25T23:36:08.271565+0000","last_active":"2023-10-25T23:36:10.887950+0000","last_peered":"2023-10-25T23:36:10.887950+0000","last_clean":"2023-10-25T23:36:10.887950+0000","last_became_active":"2023-10-25T23:36:08.271188+0000","last_became_peered":"2023-10-25T23:36:08.271188+0000","last_unstale":"2023-10-25T23:36:10.887950+0000","last_undegraded":"2023-10-25T23:36:10.887950+0000","last_fullsized":"2023-10-25T23:36:10.887950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:51:48.005011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477103+0000","last_change":"2023-10-25T23:36:09.294928+0000","last_active":"2023-10-25T23:36:10.477103+0000","last_peered":"2023-10-25T23:36:10.477103+0000","last_clean":"2023-10-25T23:36:10.477103+0000","last_became_active":"2023-10-25T23:36:09.294200+0000","last_became_peered":"2023-10-25T23:36:09.294200+0000","last_unstale":"2023-10-25T23:36:10.477103+0000","last_undegraded":"2023-10-25T23:36:10.477103+0000","last_fullsized":"2023-10-25T23:36:10.477103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:29:19.996286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285380+0000","last_change":"2023-10-25T23:36:08.273427+0000","last_active":"2023-10-25T23:36:10.285380+0000","last_peered":"2023-10-25T23:36:10.285380+0000","last_clean":"2023-10-25T23:36:10.285380+0000","last_became_active":"2023-10-25T23:36:08.272301+0000","last_became_peered":"2023-10-25T23:36:08.272301+0000","last_unstale":"2023-10-25T23:36:10.285380+0000","last_undegraded":"2023-10-25T23:36:10.285380+0000","last_fullsized":"2023-10-25T23:36:10.285380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285377+0000","last_change":"2023-10-25T23:36:09.291952+0000","last_active":"2023-10-25T23:36:10.285377+0000","last_peered":"2023-10-25T23:36:10.285377+0000","last_clean":"2023-10-25T23:36:10.285377+0000","last_became_active":"2023-10-25T23:36:09.291305+0000","last_became_peered":"2023-10-25T23:36:09.291305+0000","last_unstale":"2023-10-25T23:36:10.285377+0000","last_undegraded":"2023-10-25T23:36:10.285377+0000","last_fullsized":"2023-10-25T23:36:10.285377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:38:19.348985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285555+0000","last_change":"2023-10-25T23:36:08.277621+0000","last_active":"2023-10-25T23:36:10.285555+0000","last_peered":"2023-10-25T23:36:10.285555+0000","last_clean":"2023-10-25T23:36:10.285555+0000","last_became_active":"2023-10-25T23:36:08.277327+0000","last_became_peered":"2023-10-25T23:36:08.277327+0000","last_unstale":"2023-10-25T23:36:10.285555+0000","last_undegraded":"2023-10-25T23:36:10.285555+0000","last_fullsized":"2023-10-25T23:36:10.285555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:04.918703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.476928+0000","last_change":"2023-10-25T23:36:09.295493+0000","last_active":"2023-10-25T23:36:10.476928+0000","last_peered":"2023-10-25T23:36:10.476928+0000","last_clean":"2023-10-25T23:36:10.476928+0000","last_became_active":"2023-10-25T23:36:09.295231+0000","last_became_peered":"2023-10-25T23:36:09.295231+0000","last_unstale":"2023-10-25T23:36:10.476928+0000","last_undegraded":"2023-10-25T23:36:10.476928+0000","last_fullsized":"2023-10-25T23:36:10.476928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:28:06.035601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286981+0000","last_change":"2023-10-25T23:36:08.263573+0000","last_active":"2023-10-25T23:36:10.286981+0000","last_peered":"2023-10-25T23:36:10.286981+0000","last_clean":"2023-10-25T23:36:10.286981+0000","last_became_active":"2023-10-25T23:36:08.263264+0000","last_became_peered":"2023-10-25T23:36:08.263264+0000","last_unstale":"2023-10-25T23:36:10.286981+0000","last_undegraded":"2023-10-25T23:36:10.286981+0000","last_fullsized":"2023-10-25T23:36:10.286981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477258+0000","last_change":"2023-10-25T23:36:09.294572+0000","last_active":"2023-10-25T23:36:10.477258+0000","last_peered":"2023-10-25T23:36:10.477258+0000","last_clean":"2023-10-25T23:36:10.477258+0000","last_became_active":"2023-10-25T23:36:09.294298+0000","last_became_peered":"2023-10-25T23:36:09.294298+0000","last_unstale":"2023-10-25T23:36:10.477258+0000","last_undegraded":"2023-10-25T23:36:10.477258+0000","last_fullsized":"2023-10-25T23:36:10.477258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:53:09.911467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.034639+0000","last_change":"2023-10-25T23:36:08.277383+0000","last_active":"2023-10-25T23:36:11.034639+0000","last_peered":"2023-10-25T23:36:11.034639+0000","last_clean":"2023-10-25T23:36:11.034639+0000","last_became_active":"2023-10-25T23:36:08.277087+0000","last_became_peered":"2023-10-25T23:36:08.277087+0000","last_unstale":"2023-10-25T23:36:11.034639+0000","last_undegraded":"2023-10-25T23:36:11.034639+0000","last_fullsized":"2023-10-25T23:36:11.034639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.888072+0000","last_change":"2023-10-25T23:36:09.299356+0000","last_active":"2023-10-25T23:36:10.888072+0000","last_peered":"2023-10-25T23:36:10.888072+0000","last_clean":"2023-10-25T23:36:10.888072+0000","last_became_active":"2023-10-25T23:36:09.298782+0000","last_became_peered":"2023-10-25T23:36:09.298782+0000","last_unstale":"2023-10-25T23:36:10.888072+0000","last_undegraded":"2023-10-25T23:36:10.888072+0000","last_fullsized":"2023-10-25T23:36:10.888072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:26:02.311707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887844+0000","last_change":"2023-10-25T23:36:08.279568+0000","last_active":"2023-10-25T23:36:10.887844+0000","last_peered":"2023-10-25T23:36:10.887844+0000","last_clean":"2023-10-25T23:36:10.887844+0000","last_became_active":"2023-10-25T23:36:08.279302+0000","last_became_peered":"2023-10-25T23:36:08.279302+0000","last_unstale":"2023-10-25T23:36:10.887844+0000","last_undegraded":"2023-10-25T23:36:10.887844+0000","last_fullsized":"2023-10-25T23:36:10.887844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:27.340205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286808+0000","last_change":"2023-10-25T23:36:09.293019+0000","last_active":"2023-10-25T23:36:10.286808+0000","last_peered":"2023-10-25T23:36:10.286808+0000","last_clean":"2023-10-25T23:36:10.286808+0000","last_became_active":"2023-10-25T23:36:09.292670+0000","last_became_peered":"2023-10-25T23:36:09.292670+0000","last_unstale":"2023-10-25T23:36:10.286808+0000","last_undegraded":"2023-10-25T23:36:10.286808+0000","last_fullsized":"2023-10-25T23:36:10.286808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:05.924938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475218+0000","last_change":"2023-10-25T23:36:09.284019+0000","last_active":"2023-10-25T23:36:11.475218+0000","last_peered":"2023-10-25T23:36:11.475218+0000","last_clean":"2023-10-25T23:36:11.475218+0000","last_became_active":"2023-10-25T23:36:09.283766+0000","last_became_peered":"2023-10-25T23:36:09.283766+0000","last_unstale":"2023-10-25T23:36:11.475218+0000","last_undegraded":"2023-10-25T23:36:11.475218+0000","last_fullsized":"2023-10-25T23:36:11.475218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:28.346439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285551+0000","last_change":"2023-10-25T23:36:08.264050+0000","last_active":"2023-10-25T23:36:10.285551+0000","last_peered":"2023-10-25T23:36:10.285551+0000","last_clean":"2023-10-25T23:36:10.285551+0000","last_became_active":"2023-10-25T23:36:08.263842+0000","last_became_peered":"2023-10-25T23:36:08.263842+0000","last_unstale":"2023-10-25T23:36:10.285551+0000","last_undegraded":"2023-10-25T23:36:10.285551+0000","last_fullsized":"2023-10-25T23:36:10.285551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:31.130445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476350+0000","last_change":"2023-10-25T23:36:09.295865+0000","last_active":"2023-10-25T23:36:11.476350+0000","last_peered":"2023-10-25T23:36:11.476350+0000","last_clean":"2023-10-25T23:36:11.476350+0000","last_became_active":"2023-10-25T23:36:09.295595+0000","last_became_peered":"2023-10-25T23:36:09.295595+0000","last_unstale":"2023-10-25T23:36:11.476350+0000","last_undegraded":"2023-10-25T23:36:11.476350+0000","last_fullsized":"2023-10-25T23:36:11.476350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:09:27.102927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887944+0000","last_change":"2023-10-25T23:36:08.272009+0000","last_active":"2023-10-25T23:36:10.887944+0000","last_peered":"2023-10-25T23:36:10.887944+0000","last_clean":"2023-10-25T23:36:10.887944+0000","last_became_active":"2023-10-25T23:36:08.271640+0000","last_became_peered":"2023-10-25T23:36:08.271640+0000","last_unstale":"2023-10-25T23:36:10.887944+0000","last_undegraded":"2023-10-25T23:36:10.887944+0000","last_fullsized":"2023-10-25T23:36:10.887944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:40.023263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:09.281002+0000","last_change":"2023-10-25T23:35:58.277542+0000","last_active":"2023-10-25T23:36:09.281002+0000","last_peered":"2023-10-25T23:36:09.281002+0000","last_clean":"2023-10-25T23:36:09.281002+0000","last_became_active":"2023-10-25T23:35:58.276606+0000","last_became_peered":"2023-10-25T23:35:58.276606+0000","last_unstale":"2023-10-25T23:36:09.281002+0000","last_undegraded":"2023-10-25T23:36:09.281002+0000","last_fullsized":"2023-10-25T23:36:09.281002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:35:57.197265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:35:57.197265+0000","last_clean_scrub_stamp":"2023-10-25T23:35:57.197265+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:53:55.116662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475819+0000","last_change":"2023-10-25T23:36:09.291404+0000","last_active":"2023-10-25T23:36:11.475819+0000","last_peered":"2023-10-25T23:36:11.475819+0000","last_clean":"2023-10-25T23:36:11.475819+0000","last_became_active":"2023-10-25T23:36:09.291072+0000","last_became_peered":"2023-10-25T23:36:09.291072+0000","last_unstale":"2023-10-25T23:36:11.475819+0000","last_undegraded":"2023-10-25T23:36:11.475819+0000","last_fullsized":"2023-10-25T23:36:11.475819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:20.497336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.476857+0000","last_change":"2023-10-25T23:36:08.277937+0000","last_active":"2023-10-25T23:36:10.476857+0000","last_peered":"2023-10-25T23:36:10.476857+0000","last_clean":"2023-10-25T23:36:10.476857+0000","last_became_active":"2023-10-25T23:36:08.277663+0000","last_became_peered":"2023-10-25T23:36:08.277663+0000","last_unstale":"2023-10-25T23:36:10.476857+0000","last_undegraded":"2023-10-25T23:36:10.476857+0000","last_fullsized":"2023-10-25T23:36:10.476857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:04.918703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477388+0000","last_change":"2023-10-25T23:36:08.270783+0000","last_active":"2023-10-25T23:36:10.477388+0000","last_peered":"2023-10-25T23:36:10.477388+0000","last_clean":"2023-10-25T23:36:10.477388+0000","last_became_active":"2023-10-25T23:36:08.269896+0000","last_became_peered":"2023-10-25T23:36:08.269896+0000","last_unstale":"2023-10-25T23:36:10.477388+0000","last_undegraded":"2023-10-25T23:36:10.477388+0000","last_fullsized":"2023-10-25T23:36:10.477388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475541+0000","last_change":"2023-10-25T23:36:09.279236+0000","last_active":"2023-10-25T23:36:11.475541+0000","last_peered":"2023-10-25T23:36:11.475541+0000","last_clean":"2023-10-25T23:36:11.475541+0000","last_became_active":"2023-10-25T23:36:09.278967+0000","last_became_peered":"2023-10-25T23:36:09.278967+0000","last_unstale":"2023-10-25T23:36:11.475541+0000","last_undegraded":"2023-10-25T23:36:11.475541+0000","last_fullsized":"2023-10-25T23:36:11.475541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:26:04.639901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475648+0000","last_change":"2023-10-25T23:36:08.279363+0000","last_active":"2023-10-25T23:36:11.475648+0000","last_peered":"2023-10-25T23:36:11.475648+0000","last_clean":"2023-10-25T23:36:11.475648+0000","last_became_active":"2023-10-25T23:36:08.279082+0000","last_became_peered":"2023-10-25T23:36:08.279082+0000","last_unstale":"2023-10-25T23:36:11.475648+0000","last_undegraded":"2023-10-25T23:36:11.475648+0000","last_fullsized":"2023-10-25T23:36:11.475648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476877+0000","last_change":"2023-10-25T23:36:09.290430+0000","last_active":"2023-10-25T23:36:11.476877+0000","last_peered":"2023-10-25T23:36:11.476877+0000","last_clean":"2023-10-25T23:36:11.476877+0000","last_became_active":"2023-10-25T23:36:09.289751+0000","last_became_peered":"2023-10-25T23:36:09.289751+0000","last_unstale":"2023-10-25T23:36:11.476877+0000","last_undegraded":"2023-10-25T23:36:11.476877+0000","last_fullsized":"2023-10-25T23:36:11.476877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:29:19.996286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285500+0000","last_change":"2023-10-25T23:36:08.274349+0000","last_active":"2023-10-25T23:36:10.285500+0000","last_peered":"2023-10-25T23:36:10.285500+0000","last_clean":"2023-10-25T23:36:10.285500+0000","last_became_active":"2023-10-25T23:36:08.273029+0000","last_became_peered":"2023-10-25T23:36:08.273029+0000","last_unstale":"2023-10-25T23:36:10.285500+0000","last_undegraded":"2023-10-25T23:36:10.285500+0000","last_fullsized":"2023-10-25T23:36:10.285500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.477101+0000","last_change":"2023-10-25T23:36:09.287779+0000","last_active":"2023-10-25T23:36:11.477101+0000","last_peered":"2023-10-25T23:36:11.477101+0000","last_clean":"2023-10-25T23:36:11.477101+0000","last_became_active":"2023-10-25T23:36:09.287532+0000","last_became_peered":"2023-10-25T23:36:09.287532+0000","last_unstale":"2023-10-25T23:36:11.477101+0000","last_undegraded":"2023-10-25T23:36:11.477101+0000","last_fullsized":"2023-10-25T23:36:11.477101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:26:04.639901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.476756+0000","last_change":"2023-10-25T23:36:08.266963+0000","last_active":"2023-10-25T23:36:10.476756+0000","last_peered":"2023-10-25T23:36:10.476756+0000","last_clean":"2023-10-25T23:36:10.476756+0000","last_became_active":"2023-10-25T23:36:08.266648+0000","last_became_peered":"2023-10-25T23:36:08.266648+0000","last_unstale":"2023-10-25T23:36:10.476756+0000","last_undegraded":"2023-10-25T23:36:10.476756+0000","last_fullsized":"2023-10-25T23:36:10.476756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:31.130445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.286767+0000","last_change":"2023-10-25T23:36:09.285305+0000","last_active":"2023-10-25T23:36:10.286767+0000","last_peered":"2023-10-25T23:36:10.286767+0000","last_clean":"2023-10-25T23:36:10.286767+0000","last_became_active":"2023-10-25T23:36:09.284666+0000","last_became_peered":"2023-10-25T23:36:09.284666+0000","last_unstale":"2023-10-25T23:36:10.286767+0000","last_undegraded":"2023-10-25T23:36:10.286767+0000","last_fullsized":"2023-10-25T23:36:10.286767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:32.136680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.034599+0000","last_change":"2023-10-25T23:36:08.278162+0000","last_active":"2023-10-25T23:36:11.034599+0000","last_peered":"2023-10-25T23:36:11.034599+0000","last_clean":"2023-10-25T23:36:11.034599+0000","last_became_active":"2023-10-25T23:36:08.277873+0000","last_became_peered":"2023-10-25T23:36:08.277873+0000","last_unstale":"2023-10-25T23:36:11.034599+0000","last_undegraded":"2023-10-25T23:36:11.034599+0000","last_fullsized":"2023-10-25T23:36:11.034599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476175+0000","last_change":"2023-10-25T23:36:09.289615+0000","last_active":"2023-10-25T23:36:11.476175+0000","last_peered":"2023-10-25T23:36:11.476175+0000","last_clean":"2023-10-25T23:36:11.476175+0000","last_became_active":"2023-10-25T23:36:09.289320+0000","last_became_peered":"2023-10-25T23:36:09.289320+0000","last_unstale":"2023-10-25T23:36:11.476175+0000","last_undegraded":"2023-10-25T23:36:11.476175+0000","last_fullsized":"2023-10-25T23:36:11.476175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:51:49.011246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.034620+0000","last_change":"2023-10-25T23:36:08.278921+0000","last_active":"2023-10-25T23:36:11.034620+0000","last_peered":"2023-10-25T23:36:11.034620+0000","last_clean":"2023-10-25T23:36:11.034620+0000","last_became_active":"2023-10-25T23:36:08.278656+0000","last_became_peered":"2023-10-25T23:36:08.278656+0000","last_unstale":"2023-10-25T23:36:11.034620+0000","last_undegraded":"2023-10-25T23:36:11.034620+0000","last_fullsized":"2023-10-25T23:36:11.034620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476671+0000","last_change":"2023-10-25T23:36:09.293076+0000","last_active":"2023-10-25T23:36:11.476671+0000","last_peered":"2023-10-25T23:36:11.476671+0000","last_clean":"2023-10-25T23:36:11.476671+0000","last_became_active":"2023-10-25T23:36:09.292345+0000","last_became_peered":"2023-10-25T23:36:09.292345+0000","last_unstale":"2023-10-25T23:36:11.476671+0000","last_undegraded":"2023-10-25T23:36:11.476671+0000","last_fullsized":"2023-10-25T23:36:11.476671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:06.986689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477225+0000","last_change":"2023-10-25T23:36:08.270589+0000","last_active":"2023-10-25T23:36:10.477225+0000","last_peered":"2023-10-25T23:36:10.477225+0000","last_clean":"2023-10-25T23:36:10.477225+0000","last_became_active":"2023-10-25T23:36:08.268753+0000","last_became_peered":"2023-10-25T23:36:08.268753+0000","last_unstale":"2023-10-25T23:36:10.477225+0000","last_undegraded":"2023-10-25T23:36:10.477225+0000","last_fullsized":"2023-10-25T23:36:10.477225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285622+0000","last_change":"2023-10-25T23:36:09.290423+0000","last_active":"2023-10-25T23:36:10.285622+0000","last_peered":"2023-10-25T23:36:10.285622+0000","last_clean":"2023-10-25T23:36:10.285622+0000","last_became_active":"2023-10-25T23:36:09.290151+0000","last_became_peered":"2023-10-25T23:36:09.290151+0000","last_unstale":"2023-10-25T23:36:10.285622+0000","last_undegraded":"2023-10-25T23:36:10.285622+0000","last_fullsized":"2023-10-25T23:36:10.285622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:51:49.011246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285753+0000","last_change":"2023-10-25T23:36:08.272161+0000","last_active":"2023-10-25T23:36:10.285753+0000","last_peered":"2023-10-25T23:36:10.285753+0000","last_clean":"2023-10-25T23:36:10.285753+0000","last_became_active":"2023-10-25T23:36:08.271846+0000","last_became_peered":"2023-10-25T23:36:08.271846+0000","last_unstale":"2023-10-25T23:36:10.285753+0000","last_undegraded":"2023-10-25T23:36:10.285753+0000","last_fullsized":"2023-10-25T23:36:10.285753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:39.512919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477335+0000","last_change":"2023-10-25T23:36:09.295948+0000","last_active":"2023-10-25T23:36:10.477335+0000","last_peered":"2023-10-25T23:36:10.477335+0000","last_clean":"2023-10-25T23:36:10.477335+0000","last_became_active":"2023-10-25T23:36:09.295635+0000","last_became_peered":"2023-10-25T23:36:09.295635+0000","last_unstale":"2023-10-25T23:36:10.477335+0000","last_undegraded":"2023-10-25T23:36:10.477335+0000","last_fullsized":"2023-10-25T23:36:10.477335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:26:02.311707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.034665+0000","last_change":"2023-10-25T23:36:08.277618+0000","last_active":"2023-10-25T23:36:11.034665+0000","last_peered":"2023-10-25T23:36:11.034665+0000","last_clean":"2023-10-25T23:36:11.034665+0000","last_became_active":"2023-10-25T23:36:08.277344+0000","last_became_peered":"2023-10-25T23:36:08.277344+0000","last_unstale":"2023-10-25T23:36:11.034665+0000","last_undegraded":"2023-10-25T23:36:11.034665+0000","last_fullsized":"2023-10-25T23:36:11.034665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:21:29.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887766+0000","last_change":"2023-10-25T23:36:09.300169+0000","last_active":"2023-10-25T23:36:10.887766+0000","last_peered":"2023-10-25T23:36:10.887766+0000","last_clean":"2023-10-25T23:36:10.887766+0000","last_became_active":"2023-10-25T23:36:09.299234+0000","last_became_peered":"2023-10-25T23:36:09.299234+0000","last_unstale":"2023-10-25T23:36:10.887766+0000","last_undegraded":"2023-10-25T23:36:10.887766+0000","last_fullsized":"2023-10-25T23:36:10.887766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:29:19.996286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285721+0000","last_change":"2023-10-25T23:36:08.269389+0000","last_active":"2023-10-25T23:36:10.285721+0000","last_peered":"2023-10-25T23:36:10.285721+0000","last_clean":"2023-10-25T23:36:10.285721+0000","last_became_active":"2023-10-25T23:36:08.269065+0000","last_became_peered":"2023-10-25T23:36:08.269065+0000","last_unstale":"2023-10-25T23:36:10.285721+0000","last_undegraded":"2023-10-25T23:36:10.285721+0000","last_fullsized":"2023-10-25T23:36:10.285721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.477633+0000","last_change":"2023-10-25T23:36:09.294804+0000","last_active":"2023-10-25T23:36:10.477633+0000","last_peered":"2023-10-25T23:36:10.477633+0000","last_clean":"2023-10-25T23:36:10.477633+0000","last_became_active":"2023-10-25T23:36:09.294494+0000","last_became_peered":"2023-10-25T23:36:09.294494+0000","last_unstale":"2023-10-25T23:36:10.477633+0000","last_undegraded":"2023-10-25T23:36:10.477633+0000","last_fullsized":"2023-10-25T23:36:10.477633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:11:17.452696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285801+0000","last_change":"2023-10-25T23:36:09.292116+0000","last_active":"2023-10-25T23:36:10.285801+0000","last_peered":"2023-10-25T23:36:10.285801+0000","last_clean":"2023-10-25T23:36:10.285801+0000","last_became_active":"2023-10-25T23:36:09.291665+0000","last_became_peered":"2023-10-25T23:36:09.291665+0000","last_unstale":"2023-10-25T23:36:10.285801+0000","last_undegraded":"2023-10-25T23:36:10.285801+0000","last_fullsized":"2023-10-25T23:36:10.285801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:48:33.297905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285669+0000","last_change":"2023-10-25T23:36:09.296271+0000","last_active":"2023-10-25T23:36:10.285669+0000","last_peered":"2023-10-25T23:36:10.285669+0000","last_clean":"2023-10-25T23:36:10.285669+0000","last_became_active":"2023-10-25T23:36:09.295817+0000","last_became_peered":"2023-10-25T23:36:09.295817+0000","last_unstale":"2023-10-25T23:36:10.285669+0000","last_undegraded":"2023-10-25T23:36:10.285669+0000","last_fullsized":"2023-10-25T23:36:10.285669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:41.029497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887836+0000","last_change":"2023-10-25T23:36:09.299282+0000","last_active":"2023-10-25T23:36:10.887836+0000","last_peered":"2023-10-25T23:36:10.887836+0000","last_clean":"2023-10-25T23:36:10.887836+0000","last_became_active":"2023-10-25T23:36:09.299024+0000","last_became_peered":"2023-10-25T23:36:09.299024+0000","last_unstale":"2023-10-25T23:36:10.887836+0000","last_undegraded":"2023-10-25T23:36:10.887836+0000","last_fullsized":"2023-10-25T23:36:10.887836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:46:03.954978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476512+0000","last_change":"2023-10-25T23:36:09.292598+0000","last_active":"2023-10-25T23:36:11.476512+0000","last_peered":"2023-10-25T23:36:11.476512+0000","last_clean":"2023-10-25T23:36:11.476512+0000","last_became_active":"2023-10-25T23:36:09.292344+0000","last_became_peered":"2023-10-25T23:36:09.292344+0000","last_unstale":"2023-10-25T23:36:11.476512+0000","last_undegraded":"2023-10-25T23:36:11.476512+0000","last_fullsized":"2023-10-25T23:36:11.476512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:28.346439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476706+0000","last_change":"2023-10-25T23:36:09.297451+0000","last_active":"2023-10-25T23:36:11.476706+0000","last_peered":"2023-10-25T23:36:11.476706+0000","last_clean":"2023-10-25T23:36:11.476706+0000","last_became_active":"2023-10-25T23:36:09.297202+0000","last_became_peered":"2023-10-25T23:36:09.297202+0000","last_unstale":"2023-10-25T23:36:11.476706+0000","last_undegraded":"2023-10-25T23:36:11.476706+0000","last_fullsized":"2023-10-25T23:36:11.476706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:24:52.973821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.475540+0000","last_change":"2023-10-25T23:36:09.293431+0000","last_active":"2023-10-25T23:36:11.475540+0000","last_peered":"2023-10-25T23:36:11.475540+0000","last_clean":"2023-10-25T23:36:11.475540+0000","last_became_active":"2023-10-25T23:36:09.293157+0000","last_became_peered":"2023-10-25T23:36:09.293157+0000","last_unstale":"2023-10-25T23:36:11.475540+0000","last_undegraded":"2023-10-25T23:36:11.475540+0000","last_fullsized":"2023-10-25T23:36:11.475540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:51:49.011246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285934+0000","last_change":"2023-10-25T23:36:09.288432+0000","last_active":"2023-10-25T23:36:10.285934+0000","last_peered":"2023-10-25T23:36:10.285934+0000","last_clean":"2023-10-25T23:36:10.285934+0000","last_became_active":"2023-10-25T23:36:09.288127+0000","last_became_peered":"2023-10-25T23:36:09.288127+0000","last_unstale":"2023-10-25T23:36:10.285934+0000","last_undegraded":"2023-10-25T23:36:10.285934+0000","last_fullsized":"2023-10-25T23:36:10.285934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:28:06.986689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.477001+0000","last_change":"2023-10-25T23:36:09.290608+0000","last_active":"2023-10-25T23:36:11.477001+0000","last_peered":"2023-10-25T23:36:11.477001+0000","last_clean":"2023-10-25T23:36:11.477001+0000","last_became_active":"2023-10-25T23:36:09.290160+0000","last_became_peered":"2023-10-25T23:36:09.290160+0000","last_unstale":"2023-10-25T23:36:11.477001+0000","last_undegraded":"2023-10-25T23:36:11.477001+0000","last_fullsized":"2023-10-25T23:36:11.477001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:58:48.401709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887814+0000","last_change":"2023-10-25T23:36:09.298886+0000","last_active":"2023-10-25T23:36:10.887814+0000","last_peered":"2023-10-25T23:36:10.887814+0000","last_clean":"2023-10-25T23:36:10.887814+0000","last_became_active":"2023-10-25T23:36:09.298637+0000","last_became_peered":"2023-10-25T23:36:09.298637+0000","last_unstale":"2023-10-25T23:36:10.887814+0000","last_undegraded":"2023-10-25T23:36:10.887814+0000","last_fullsized":"2023-10-25T23:36:10.887814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:58:48.401709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476265+0000","last_change":"2023-10-25T23:36:09.290809+0000","last_active":"2023-10-25T23:36:11.476265+0000","last_peered":"2023-10-25T23:36:11.476265+0000","last_clean":"2023-10-25T23:36:11.476265+0000","last_became_active":"2023-10-25T23:36:09.290546+0000","last_became_peered":"2023-10-25T23:36:09.290546+0000","last_unstale":"2023-10-25T23:36:11.476265+0000","last_undegraded":"2023-10-25T23:36:11.476265+0000","last_fullsized":"2023-10-25T23:36:11.476265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:48:33.297905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.887720+0000","last_change":"2023-10-25T23:36:09.296735+0000","last_active":"2023-10-25T23:36:10.887720+0000","last_peered":"2023-10-25T23:36:10.887720+0000","last_clean":"2023-10-25T23:36:10.887720+0000","last_became_active":"2023-10-25T23:36:09.296280+0000","last_became_peered":"2023-10-25T23:36:09.296280+0000","last_unstale":"2023-10-25T23:36:10.887720+0000","last_undegraded":"2023-10-25T23:36:10.887720+0000","last_fullsized":"2023-10-25T23:36:10.887720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:28:06.035601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:11.476395+0000","last_change":"2023-10-25T23:36:09.285887+0000","last_active":"2023-10-25T23:36:11.476395+0000","last_peered":"2023-10-25T23:36:11.476395+0000","last_clean":"2023-10-25T23:36:11.476395+0000","last_became_active":"2023-10-25T23:36:09.285610+0000","last_became_peered":"2023-10-25T23:36:09.285610+0000","last_unstale":"2023-10-25T23:36:11.476395+0000","last_undegraded":"2023-10-25T23:36:11.476395+0000","last_fullsized":"2023-10-25T23:36:11.476395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:38:19.348985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-25T23:36:10.285693+0000","last_change":"2023-10-25T23:36:09.291838+0000","last_active":"2023-10-25T23:36:10.285693+0000","last_peered":"2023-10-25T23:36:10.285693+0000","last_clean":"2023-10-25T23:36:10.285693+0000","last_became_active":"2023-10-25T23:36:09.291566+0000","last_became_peered":"2023-10-25T23:36:09.291566+0000","last_unstale":"2023-10-25T23:36:10.285693+0000","last_undegraded":"2023-10-25T23:36:10.285693+0000","last_fullsized":"2023-10-25T23:36:10.285693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:26:04.639901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.052}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.175000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.236000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.0510000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.206}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-25T23:36:18.759 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-25T23:36:18.759 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-25T23:36:18.760 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-25T23:36:18.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-25T23:36:18.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.914+0000 7fa57698e700 1 -- 172.21.15.81:0/804249857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57014f330 msgr2=0x7fa57014b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:18.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.914+0000 7fa57698e700 1 --2- 172.21.15.81:0/804249857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57014f330 0x7fa57014b220 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa5700c1ac0 tx=0x7fa558009c70 comp rx=0 tx=0).stop 2023-10-25T23:36:18.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.914+0000 7fa57698e700 1 -- 172.21.15.81:0/804249857 shutdown_connections 2023-10-25T23:36:18.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.914+0000 7fa57698e700 1 --2- 172.21.15.81:0/804249857 >> v2:172.21.15.89:3300/0 conn(0x7fa57006cd80 0x7fa57014b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.914+0000 7fa57698e700 1 --2- 172.21.15.81:0/804249857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57014f330 0x7fa57014b220 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.914+0000 7fa57698e700 1 -- 172.21.15.81:0/804249857 >> 172.21.15.81:0/804249857 conn(0x7fa5700c0a40 msgr2=0x7fa5700c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:18.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.914+0000 7fa57698e700 1 -- 172.21.15.81:0/804249857 shutdown_connections 2023-10-25T23:36:18.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.914+0000 7fa57698e700 1 -- 172.21.15.81:0/804249857 wait complete. 2023-10-25T23:36:18.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.915+0000 7fa57698e700 1 Processor -- start 2023-10-25T23:36:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.916+0000 7fa57698e700 1 -- start start 2023-10-25T23:36:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.916+0000 7fa57698e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57006cd80 0x7fa570144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.916+0000 7fa57698e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5701454f0 0x7fa57014c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.916+0000 7fa57698e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa57014f330 0x7fa57014cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:18.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.916+0000 7fa57698e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa570144dc0 con 0x7fa57006cd80 2023-10-25T23:36:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.916+0000 7fa57698e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa570133520 con 0x7fa57014f330 2023-10-25T23:36:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.916+0000 7fa57698e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5701337c0 con 0x7fa5701454f0 2023-10-25T23:36:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.916+0000 7fa56ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57006cd80 0x7fa570144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.916+0000 7fa56ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57006cd80 0x7fa570144880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36688/0 (socket says 172.21.15.81:36688) 2023-10-25T23:36:18.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.916+0000 7fa56ffff700 1 -- 172.21.15.81:0/3367660401 learned_addr learned my addr 172.21.15.81:0/3367660401 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.917+0000 7fa56f7fe700 1 --2- 172.21.15.81:0/3367660401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5701454f0 0x7fa57014c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.917+0000 7fa574f2b700 1 --2- 172.21.15.81:0/3367660401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa57014f330 0x7fa57014cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.917+0000 7fa56ffff700 1 -- 172.21.15.81:0/3367660401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5701454f0 msgr2=0x7fa57014c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.917+0000 7fa56ffff700 1 --2- 172.21.15.81:0/3367660401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5701454f0 0x7fa57014c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.917+0000 7fa56ffff700 1 -- 172.21.15.81:0/3367660401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa57014f330 msgr2=0x7fa57014cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.917+0000 7fa56ffff700 1 --2- 172.21.15.81:0/3367660401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa57014f330 0x7fa57014cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.917+0000 7fa56ffff700 1 -- 172.21.15.81:0/3367660401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5580095f0 con 0x7fa57006cd80 2023-10-25T23:36:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.917+0000 7fa56ffff700 1 --2- 172.21.15.81:0/3367660401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57006cd80 0x7fa570144880 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa56000c490 tx=0x7fa56000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.917+0000 7fa56cff9700 1 -- 172.21.15.81:0/3367660401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5600052d0 con 0x7fa57006cd80 2023-10-25T23:36:18.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.917+0000 7fa56cff9700 1 -- 172.21.15.81:0/3367660401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa560005540 con 0x7fa57006cd80 2023-10-25T23:36:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.917+0000 7fa57698e700 1 -- 172.21.15.81:0/3367660401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5700b6410 con 0x7fa57006cd80 2023-10-25T23:36:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.917+0000 7fa56cff9700 1 -- 172.21.15.81:0/3367660401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa560006aa0 con 0x7fa57006cd80 2023-10-25T23:36:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.917+0000 7fa57698e700 1 -- 172.21.15.81:0/3367660401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa57014c380 con 0x7fa57006cd80 2023-10-25T23:36:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.918+0000 7fa57698e700 1 -- 172.21.15.81:0/3367660401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa57014c570 con 0x7fa57006cd80 2023-10-25T23:36:18.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.918+0000 7fa56cff9700 1 -- 172.21.15.81:0/3367660401 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa560003680 con 0x7fa57006cd80 2023-10-25T23:36:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.919+0000 7fa56cff9700 1 --2- 172.21.15.81:0/3367660401 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa55006af00 0x7fa55006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.919+0000 7fa56cff9700 1 -- 172.21.15.81:0/3367660401 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa56008afe0 con 0x7fa57006cd80 2023-10-25T23:36:18.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.919+0000 7fa56f7fe700 1 --2- 172.21.15.81:0/3367660401 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa55006af00 0x7fa55006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:18.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.919+0000 7fa56f7fe700 1 --2- 172.21.15.81:0/3367660401 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa55006af00 0x7fa55006d3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa5700c1ac0 tx=0x7fa558011040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:18.923+0000 7fa56cff9700 1 -- 172.21.15.81:0/3367660401 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5600560a0 con 0x7fa57006cd80 2023-10-25T23:36:19.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.155+0000 7fa57698e700 1 -- 172.21.15.81:0/3367660401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa57004e4c0 con 0x7fa57006cd80 2023-10-25T23:36:19.156 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.155+0000 7fa56cff9700 1 -- 172.21.15.81:0/3367660401 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa5600596c0 con 0x7fa57006cd80 2023-10-25T23:36:19.156 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:19.157 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-25T23:36:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.157+0000 7fa57698e700 1 -- 172.21.15.81:0/3367660401 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa55006af00 msgr2=0x7fa55006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.157+0000 7fa57698e700 1 --2- 172.21.15.81:0/3367660401 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa55006af00 0x7fa55006d3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa5700c1ac0 tx=0x7fa558011040 comp rx=0 tx=0).stop 2023-10-25T23:36:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.157+0000 7fa57698e700 1 -- 172.21.15.81:0/3367660401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57006cd80 msgr2=0x7fa570144880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.157+0000 7fa57698e700 1 --2- 172.21.15.81:0/3367660401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57006cd80 0x7fa570144880 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa56000c490 tx=0x7fa56000c850 comp rx=0 tx=0).stop 2023-10-25T23:36:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.157+0000 7fa57698e700 1 -- 172.21.15.81:0/3367660401 shutdown_connections 2023-10-25T23:36:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.157+0000 7fa57698e700 1 --2- 172.21.15.81:0/3367660401 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa55006af00 0x7fa55006d3c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.157+0000 7fa57698e700 1 --2- 172.21.15.81:0/3367660401 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa57014f330 0x7fa57014cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.157+0000 7fa57698e700 1 --2- 172.21.15.81:0/3367660401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57006cd80 0x7fa570144880 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.157+0000 7fa57698e700 1 --2- 172.21.15.81:0/3367660401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5701454f0 0x7fa57014c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.157+0000 7fa57698e700 1 -- 172.21.15.81:0/3367660401 >> 172.21.15.81:0/3367660401 conn(0x7fa5700c0a40 msgr2=0x7fa5700c0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:19.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.157+0000 7fa57698e700 1 -- 172.21.15.81:0/3367660401 shutdown_connections 2023-10-25T23:36:19.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.157+0000 7fa57698e700 1 -- 172.21.15.81:0/3367660401 wait complete. 2023-10-25T23:36:19.170 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-25T23:36:19.170 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T23:36:19.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.291+0000 7f031afc7700 1 -- 172.21.15.81:0/906514096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03140bef30 msgr2=0x7f0314070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:19.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.291+0000 7f031afc7700 1 --2- 172.21.15.81:0/906514096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03140bef30 0x7f0314070e60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f031406f9e0 tx=0x7f0300009c70 comp rx=0 tx=0).stop 2023-10-25T23:36:19.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.291+0000 7f031afc7700 1 -- 172.21.15.81:0/906514096 shutdown_connections 2023-10-25T23:36:19.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.291+0000 7f031afc7700 1 --2- 172.21.15.81:0/906514096 >> v2:172.21.15.89:3300/0 conn(0x7f03140b40d0 0x7f0314155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.291+0000 7f031afc7700 1 --2- 172.21.15.81:0/906514096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03140bef30 0x7f0314070e60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.291+0000 7f031afc7700 1 -- 172.21.15.81:0/906514096 >> 172.21.15.81:0/906514096 conn(0x7f03140bd4c0 msgr2=0x7f03140bd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:19.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.291+0000 7f031afc7700 1 -- 172.21.15.81:0/906514096 shutdown_connections 2023-10-25T23:36:19.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.291+0000 7f031afc7700 1 -- 172.21.15.81:0/906514096 wait complete. 2023-10-25T23:36:19.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.292+0000 7f031afc7700 1 Processor -- start 2023-10-25T23:36:19.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.292+0000 7f031afc7700 1 -- start start 2023-10-25T23:36:19.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.293+0000 7f031afc7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03140b40d0 0x7f03140a3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:19.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.293+0000 7f031afc7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03140bce70 0x7f03140a5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:19.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.293+0000 7f031afc7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03140bef30 0x7f03140a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:19.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.293+0000 7f031afc7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03140baa60 con 0x7f03140bef30 2023-10-25T23:36:19.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.293+0000 7f031afc7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031406ef90 con 0x7f03140b40d0 2023-10-25T23:36:19.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.293+0000 7f031afc7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03140ba780 con 0x7f03140bce70 2023-10-25T23:36:19.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.293+0000 7f0319564700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03140bef30 0x7f03140a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:19.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.293+0000 7f0319564700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03140bef30 0x7f03140a61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36706/0 (socket says 172.21.15.81:36706) 2023-10-25T23:36:19.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.293+0000 7f0319564700 1 -- 172.21.15.81:0/1309109047 learned_addr learned my addr 172.21.15.81:0/1309109047 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:19.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.293+0000 7f0313fff700 1 --2- 172.21.15.81:0/1309109047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03140bce70 0x7f03140a5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:19.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.293+0000 7f0318d63700 1 --2- 172.21.15.81:0/1309109047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03140b40d0 0x7f03140a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:19.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.293+0000 7f0319564700 1 -- 172.21.15.81:0/1309109047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03140bce70 msgr2=0x7f03140a5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:19.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.293+0000 7f0319564700 1 --2- 172.21.15.81:0/1309109047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03140bce70 0x7f03140a5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.294+0000 7f0319564700 1 -- 172.21.15.81:0/1309109047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03140b40d0 msgr2=0x7f03140a3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:19.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.294+0000 7f0319564700 1 --2- 172.21.15.81:0/1309109047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03140b40d0 0x7f03140a3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.294+0000 7f0319564700 1 -- 172.21.15.81:0/1309109047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03000095f0 con 0x7f03140bef30 2023-10-25T23:36:19.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.294+0000 7f0319564700 1 --2- 172.21.15.81:0/1309109047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03140bef30 0x7f03140a61f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f030c00ada0 tx=0x7f030c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:19.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.294+0000 7f03117fa700 1 -- 172.21.15.81:0/1309109047 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c00f070 con 0x7f03140bef30 2023-10-25T23:36:19.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.294+0000 7f03117fa700 1 -- 172.21.15.81:0/1309109047 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f030c00a0d0 con 0x7f03140bef30 2023-10-25T23:36:19.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.294+0000 7f031afc7700 1 -- 172.21.15.81:0/1309109047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03141e31e0 con 0x7f03140bef30 2023-10-25T23:36:19.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.294+0000 7f03117fa700 1 -- 172.21.15.81:0/1309109047 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c004e10 con 0x7f03140bef30 2023-10-25T23:36:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.294+0000 7f031afc7700 1 -- 172.21.15.81:0/1309109047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03140a57b0 con 0x7f03140bef30 2023-10-25T23:36:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.295+0000 7f031afc7700 1 -- 172.21.15.81:0/1309109047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f031414bfb0 con 0x7f03140bef30 2023-10-25T23:36:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.295+0000 7f03117fa700 1 -- 172.21.15.81:0/1309109047 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f030c00c8d0 con 0x7f03140bef30 2023-10-25T23:36:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.296+0000 7f03117fa700 1 --2- 172.21.15.81:0/1309109047 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f02f806aed0 0x7f02f806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.296+0000 7f03117fa700 1 -- 172.21.15.81:0/1309109047 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f030c0891a0 con 0x7f03140bef30 2023-10-25T23:36:19.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.296+0000 7f0318d63700 1 --2- 172.21.15.81:0/1309109047 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f02f806aed0 0x7f02f806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:19.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.296+0000 7f0318d63700 1 --2- 172.21.15.81:0/1309109047 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f02f806aed0 0x7f02f806d390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0308007fd0 tx=0x7f0308009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:19.302 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.300+0000 7f03117fa700 1 -- 172.21.15.81:0/1309109047 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f031414bfb0 con 0x7f03140bef30 2023-10-25T23:36:19.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.487+0000 7f031afc7700 1 -- 172.21.15.81:0/1309109047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03140b7160 con 0x7f03140bef30 2023-10-25T23:36:19.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.488+0000 7f03117fa700 1 -- 172.21.15.81:0/1309109047 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f03140b7160 con 0x7f03140bef30 2023-10-25T23:36:19.489 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:19.490 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf","created":"2023-10-25T23:35:42.986840+0000","modified":"2023-10-25T23:36:10.277991+0000","last_up_change":"2023-10-25T23:35:55.052199+0000","last_in_change":"2023-10-25T23:35:46.443490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T23:35:57.031170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T23:36:06.841771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T23:36:07.613269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48415836-8f22-4dcd-baa3-1d09c90c9a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6809","nonce":1045657984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6811","nonce":1045657984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6815","nonce":1045657984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6813","nonce":1045657984}]},"public_addr":"172.21.15.81:6809/1045657984","cluster_addr":"172.21.15.81:6811/1045657984","heartbeat_back_addr":"172.21.15.81:6815/1045657984","heartbeat_front_addr":"172.21.15.81:6813/1045657984","state":["exists","up"]},{"osd":1,"uuid":"19a4f6b5-e75c-45ae-aa08-b3467e69eed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6801","nonce":725386907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6803","nonce":725386907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6807","nonce":725386907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6805","nonce":725386907}]},"public_addr":"172.21.15.81:6801/725386907","cluster_addr":"172.21.15.81:6803/725386907","heartbeat_back_addr":"172.21.15.81:6807/725386907","heartbeat_front_addr":"172.21.15.81:6805/725386907","state":["exists","up"]},{"osd":2,"uuid":"60645312-54f5-4a74-ae52-68d17ff2d6e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6825","nonce":1744054610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6827","nonce":1744054610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6831","nonce":1744054610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6829","nonce":1744054610}]},"public_addr":"172.21.15.81:6825/1744054610","cluster_addr":"172.21.15.81:6827/1744054610","heartbeat_back_addr":"172.21.15.81:6831/1744054610","heartbeat_front_addr":"172.21.15.81:6829/1744054610","state":["exists","up"]},{"osd":3,"uuid":"c636a4a2-c1e8-4306-a78b-fe37eebab526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6817","nonce":1391123341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6819","nonce":1391123341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6823","nonce":1391123341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6821","nonce":1391123341}]},"public_addr":"172.21.15.81:6817/1391123341","cluster_addr":"172.21.15.81:6819/1391123341","heartbeat_back_addr":"172.21.15.81:6823/1391123341","heartbeat_front_addr":"172.21.15.81:6821/1391123341","state":["exists","up"]},{"osd":4,"uuid":"3cafc826-e531-4aa7-8b2a-b592f318f138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6817","nonce":1232781703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6819","nonce":1232781703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6823","nonce":1232781703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6821","nonce":1232781703}]},"public_addr":"172.21.15.89:6817/1232781703","cluster_addr":"172.21.15.89:6819/1232781703","heartbeat_back_addr":"172.21.15.89:6823/1232781703","heartbeat_front_addr":"172.21.15.89:6821/1232781703","state":["exists","up"]},{"osd":5,"uuid":"6098deb2-258e-47e1-b283-9a24c9dddf27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6801","nonce":2255820086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6803","nonce":2255820086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6807","nonce":2255820086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6805","nonce":2255820086}]},"public_addr":"172.21.15.89:6801/2255820086","cluster_addr":"172.21.15.89:6803/2255820086","heartbeat_back_addr":"172.21.15.89:6807/2255820086","heartbeat_front_addr":"172.21.15.89:6805/2255820086","state":["exists","up"]},{"osd":6,"uuid":"d79f68de-3c19-4f68-bbd1-59c8484dfaa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6809","nonce":2561967165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6811","nonce":2561967165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6815","nonce":2561967165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6813","nonce":2561967165}]},"public_addr":"172.21.15.89:6809/2561967165","cluster_addr":"172.21.15.89:6811/2561967165","heartbeat_back_addr":"172.21.15.89:6815/2561967165","heartbeat_front_addr":"172.21.15.89:6813/2561967165","state":["exists","up"]},{"osd":7,"uuid":"f1f7002e-4de9-4a08-97a1-fb52a116687f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6825","nonce":2647243500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6827","nonce":2647243500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6831","nonce":2647243500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6829","nonce":2647243500}]},"public_addr":"172.21.15.89:6825/2647243500","cluster_addr":"172.21.15.89:6827/2647243500","heartbeat_back_addr":"172.21.15.89:6831/2647243500","heartbeat_front_addr":"172.21.15.89:6829/2647243500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.613750+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.593515+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.713198+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.725623+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.686409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.596728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.670930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.676762+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T23:36:19.491 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.490+0000 7f031afc7700 1 -- 172.21.15.81:0/1309109047 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f02f806aed0 msgr2=0x7f02f806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.490+0000 7f031afc7700 1 --2- 172.21.15.81:0/1309109047 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f02f806aed0 0x7f02f806d390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0308007fd0 tx=0x7f0308009040 comp rx=0 tx=0).stop 2023-10-25T23:36:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.490+0000 7f031afc7700 1 -- 172.21.15.81:0/1309109047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03140bef30 msgr2=0x7f03140a61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.490+0000 7f031afc7700 1 --2- 172.21.15.81:0/1309109047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03140bef30 0x7f03140a61f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f030c00ada0 tx=0x7f030c00c330 comp rx=0 tx=0).stop 2023-10-25T23:36:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.491+0000 7f031afc7700 1 -- 172.21.15.81:0/1309109047 shutdown_connections 2023-10-25T23:36:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.491+0000 7f031afc7700 1 --2- 172.21.15.81:0/1309109047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03140bef30 0x7f03140a61f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.491+0000 7f031afc7700 1 --2- 172.21.15.81:0/1309109047 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f02f806aed0 0x7f02f806d390 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.493 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.491+0000 7f031afc7700 1 --2- 172.21.15.81:0/1309109047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03140b40d0 0x7f03140a3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.491+0000 7f031afc7700 1 --2- 172.21.15.81:0/1309109047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03140bce70 0x7f03140a5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.491+0000 7f031afc7700 1 -- 172.21.15.81:0/1309109047 >> 172.21.15.81:0/1309109047 conn(0x7f03140bd4c0 msgr2=0x7f031414e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:19.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.491+0000 7f031afc7700 1 -- 172.21.15.81:0/1309109047 shutdown_connections 2023-10-25T23:36:19.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.491+0000 7f031afc7700 1 -- 172.21.15.81:0/1309109047 wait complete. 2023-10-25T23:36:19.503 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T23:35:57.031170+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T23:36:06.841771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T23:36:07.613269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T23:36:19.504 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T23:36:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.629+0000 7fc5011a7700 1 -- 172.21.15.81:0/3875751136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc14c060 msgr2=0x7fc4fc155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.629+0000 7fc5011a7700 1 --2- 172.21.15.81:0/3875751136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc14c060 0x7fc4fc155cd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc06d760 tx=0x7fc4f400b380 comp rx=0 tx=0).stop 2023-10-25T23:36:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.629+0000 7fc5011a7700 1 -- 172.21.15.81:0/3875751136 shutdown_connections 2023-10-25T23:36:19.630 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.629+0000 7fc5011a7700 1 --2- 172.21.15.81:0/3875751136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc14c060 0x7fc4fc155cd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.629+0000 7fc5011a7700 1 --2- 172.21.15.81:0/3875751136 >> v2:172.21.15.89:3300/0 conn(0x7fc4fc06b990 0x7fc4fc14bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.629+0000 7fc5011a7700 1 -- 172.21.15.81:0/3875751136 >> 172.21.15.81:0/3875751136 conn(0x7fc4fc06d9b0 msgr2=0x7fc4fc06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.629+0000 7fc5011a7700 1 -- 172.21.15.81:0/3875751136 shutdown_connections 2023-10-25T23:36:19.631 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.629+0000 7fc5011a7700 1 -- 172.21.15.81:0/3875751136 wait complete. 2023-10-25T23:36:19.634 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.630+0000 7fc5011a7700 1 Processor -- start 2023-10-25T23:36:19.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.630+0000 7fc5011a7700 1 -- start start 2023-10-25T23:36:19.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc5011a7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4fc06b990 0x7fc4fc1460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:19.635 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc5011a7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4fc073050 0x7fc4fc146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc5011a7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc14c060 0x7fc4fc1d48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc5011a7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc1d2cb0 con 0x7fc4fc14c060 2023-10-25T23:36:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc5011a7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc1d24c0 con 0x7fc4fc073050 2023-10-25T23:36:19.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc5011a7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4fc1d7300 con 0x7fc4fc06b990 2023-10-25T23:36:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc4fb59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc14c060 0x7fc4fc1d48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc4fb59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc14c060 0x7fc4fc1d48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36718/0 (socket says 172.21.15.81:36718) 2023-10-25T23:36:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc4fb59e700 1 -- 172.21.15.81:0/1188390616 learned_addr learned my addr 172.21.15.81:0/1188390616 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc4fa59c700 1 --2- 172.21.15.81:0/1188390616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4fc073050 0x7fc4fc146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:19.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc4fad9d700 1 --2- 172.21.15.81:0/1188390616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4fc06b990 0x7fc4fc1460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc4fb59e700 1 -- 172.21.15.81:0/1188390616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4fc06b990 msgr2=0x7fc4fc1460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc4fb59e700 1 --2- 172.21.15.81:0/1188390616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4fc06b990 0x7fc4fc1460d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc4fb59e700 1 -- 172.21.15.81:0/1188390616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4fc073050 msgr2=0x7fc4fc146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:19.638 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc4fb59e700 1 --2- 172.21.15.81:0/1188390616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4fc073050 0x7fc4fc146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc4fb59e700 1 -- 172.21.15.81:0/1188390616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f4009d00 con 0x7fc4fc14c060 2023-10-25T23:36:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc4fb59e700 1 --2- 172.21.15.81:0/1188390616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc14c060 0x7fc4fc1d48d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009fd0 tx=0x7fc4f4003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc4e37fe700 1 -- 172.21.15.81:0/1188390616 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f400e040 con 0x7fc4fc14c060 2023-10-25T23:36:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc4e37fe700 1 -- 172.21.15.81:0/1188390616 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc4f4007ae0 con 0x7fc4fc14c060 2023-10-25T23:36:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc5011a7700 1 -- 172.21.15.81:0/1188390616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4fc1d2710 con 0x7fc4fc14c060 2023-10-25T23:36:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.631+0000 7fc4e37fe700 1 -- 172.21.15.81:0/1188390616 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4009450 con 0x7fc4fc14c060 2023-10-25T23:36:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.632+0000 7fc5011a7700 1 -- 172.21.15.81:0/1188390616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4fc1e84c0 con 0x7fc4fc14c060 2023-10-25T23:36:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.632+0000 7fc5011a7700 1 -- 172.21.15.81:0/1188390616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4fc067490 con 0x7fc4fc14c060 2023-10-25T23:36:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.633+0000 7fc4e37fe700 1 -- 172.21.15.81:0/1188390616 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc4f4004030 con 0x7fc4fc14c060 2023-10-25T23:36:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.633+0000 7fc4e37fe700 1 --2- 172.21.15.81:0/1188390616 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc4e806af00 0x7fc4e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.633+0000 7fc4e37fe700 1 -- 172.21.15.81:0/1188390616 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4f408aaa0 con 0x7fc4fc14c060 2023-10-25T23:36:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.633+0000 7fc4fad9d700 1 --2- 172.21.15.81:0/1188390616 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc4e806af00 0x7fc4e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:19.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.634+0000 7fc4fad9d700 1 --2- 172.21.15.81:0/1188390616 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc4e806af00 0x7fc4e806d3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec007fd0 tx=0x7fc4ec007ec0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:19.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.638+0000 7fc4e37fe700 1 -- 172.21.15.81:0/1188390616 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc4f4055be0 con 0x7fc4fc14c060 2023-10-25T23:36:19.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.828+0000 7fc5011a7700 1 -- 172.21.15.81:0/1188390616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc4fc04e4c0 con 0x7fc4fc14c060 2023-10-25T23:36:19.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.828+0000 7fc4e37fe700 1 -- 172.21.15.81:0/1188390616 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc4f4017020 con 0x7fc4fc14c060 2023-10-25T23:36:19.829 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-25T23:36:19.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.830+0000 7fc5011a7700 1 -- 172.21.15.81:0/1188390616 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc4e806af00 msgr2=0x7fc4e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.830+0000 7fc5011a7700 1 --2- 172.21.15.81:0/1188390616 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc4e806af00 0x7fc4e806d3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec007fd0 tx=0x7fc4ec007ec0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.830+0000 7fc5011a7700 1 -- 172.21.15.81:0/1188390616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc14c060 msgr2=0x7fc4fc1d48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.830+0000 7fc5011a7700 1 --2- 172.21.15.81:0/1188390616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc14c060 0x7fc4fc1d48d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009fd0 tx=0x7fc4f4003ef0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.830+0000 7fc5011a7700 1 -- 172.21.15.81:0/1188390616 shutdown_connections 2023-10-25T23:36:19.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.830+0000 7fc5011a7700 1 --2- 172.21.15.81:0/1188390616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4fc14c060 0x7fc4fc1d48d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.830+0000 7fc5011a7700 1 --2- 172.21.15.81:0/1188390616 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4fc06b990 0x7fc4fc1460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.830+0000 7fc5011a7700 1 --2- 172.21.15.81:0/1188390616 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc4e806af00 0x7fc4e806d3c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.830+0000 7fc5011a7700 1 --2- 172.21.15.81:0/1188390616 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4fc073050 0x7fc4fc146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.830+0000 7fc5011a7700 1 -- 172.21.15.81:0/1188390616 >> 172.21.15.81:0/1188390616 conn(0x7fc4fc06d9b0 msgr2=0x7fc4fc1d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.830+0000 7fc5011a7700 1 -- 172.21.15.81:0/1188390616 shutdown_connections 2023-10-25T23:36:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.830+0000 7fc5011a7700 1 -- 172.21.15.81:0/1188390616 wait complete. 2023-10-25T23:36:19.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T23:36:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.968+0000 7f88ab76c700 1 -- 172.21.15.81:0/309342194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a4154900 msgr2=0x7f88a4156cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.968+0000 7f88ab76c700 1 --2- 172.21.15.81:0/309342194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a4154900 0x7f88a4156cf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f889c009f60 tx=0x7f889c009f90 comp rx=0 tx=0).stop 2023-10-25T23:36:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.968+0000 7f88ab76c700 1 -- 172.21.15.81:0/309342194 shutdown_connections 2023-10-25T23:36:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.968+0000 7f88ab76c700 1 --2- 172.21.15.81:0/309342194 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a4154900 0x7f88a4156cf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.968+0000 7f88ab76c700 1 -- 172.21.15.81:0/309342194 >> 172.21.15.81:0/309342194 conn(0x7f88a406b320 msgr2=0x7f88a406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.968+0000 7f88ab76c700 1 -- 172.21.15.81:0/309342194 shutdown_connections 2023-10-25T23:36:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.968+0000 7f88ab76c700 1 -- 172.21.15.81:0/309342194 wait complete. 2023-10-25T23:36:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.969+0000 7f88ab76c700 1 Processor -- start 2023-10-25T23:36:19.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.969+0000 7f88ab76c700 1 -- start start 2023-10-25T23:36:19.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.969+0000 7f88ab76c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88a40bb530 0x7f88a4134480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:19.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f88ab76c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a4144f60 0x7f88a41325f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:19.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f88ab76c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a4154900 0x7f88a4140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:19.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f88ab76c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a4133770 con 0x7f88a4154900 2023-10-25T23:36:19.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f88ab76c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a41349c0 con 0x7f88a4144f60 2023-10-25T23:36:19.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f88ab76c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a4136c10 con 0x7f88a40bb530 2023-10-25T23:36:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f88a9d09700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a4154900 0x7f88a4140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f88a9d09700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a4154900 0x7f88a4140e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36728/0 (socket says 172.21.15.81:36728) 2023-10-25T23:36:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f88a9d09700 1 -- 172.21.15.81:0/784777671 learned_addr learned my addr 172.21.15.81:0/784777671 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f88a8d07700 1 --2- 172.21.15.81:0/784777671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a4144f60 0x7f88a41325f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f88a9d09700 1 -- 172.21.15.81:0/784777671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88a40bb530 msgr2=0x7f88a4134480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:19.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f88a9d09700 1 --2- 172.21.15.81:0/784777671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88a40bb530 0x7f88a4134480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f88a9d09700 1 -- 172.21.15.81:0/784777671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a4144f60 msgr2=0x7f88a41325f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:19.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f88a9d09700 1 --2- 172.21.15.81:0/784777671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a4144f60 0x7f88a41325f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:19.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f88a9d09700 1 -- 172.21.15.81:0/784777671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c009c40 con 0x7f88a4154900 2023-10-25T23:36:19.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f88a8d07700 1 --2- 172.21.15.81:0/784777671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a4144f60 0x7f88a41325f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:36:19.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f88a9d09700 1 --2- 172.21.15.81:0/784777671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a4154900 0x7f88a4140e80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f889c009550 tx=0x7f889c007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:19.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f8899ffb700 1 -- 172.21.15.81:0/784777671 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c00e040 con 0x7f88a4154900 2023-10-25T23:36:19.978 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f8899ffb700 1 -- 172.21.15.81:0/784777671 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f889c01d680 con 0x7f88a4154900 2023-10-25T23:36:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f88ab76c700 1 -- 172.21.15.81:0/784777671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a4136ef0 con 0x7f88a4154900 2023-10-25T23:36:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f8899ffb700 1 -- 172.21.15.81:0/784777671 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c01da90 con 0x7f88a4154900 2023-10-25T23:36:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.970+0000 7f88ab76c700 1 -- 172.21.15.81:0/784777671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a41374b0 con 0x7f88a4154900 2023-10-25T23:36:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.971+0000 7f88ab76c700 1 -- 172.21.15.81:0/784777671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a4132160 con 0x7f88a4154900 2023-10-25T23:36:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.972+0000 7f8899ffb700 1 -- 172.21.15.81:0/784777671 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f889c01dbf0 con 0x7f88a4154900 2023-10-25T23:36:19.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.972+0000 7f8899ffb700 1 --2- 172.21.15.81:0/784777671 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f888806aed0 0x7f888806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:19.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.972+0000 7f8899ffb700 1 -- 172.21.15.81:0/784777671 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f889c08b7a0 con 0x7f88a4154900 2023-10-25T23:36:19.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.973+0000 7f88a9508700 1 --2- 172.21.15.81:0/784777671 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f888806aed0 0x7f888806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:19.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.973+0000 7f88a9508700 1 --2- 172.21.15.81:0/784777671 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f888806aed0 0x7f888806d390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f88a0000f60 tx=0x7f88a0007a40 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:19.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:19.977+0000 7f8899ffb700 1 -- 172.21.15.81:0/784777671 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f889c056840 con 0x7f88a4154900 2023-10-25T23:36:20.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.167+0000 7f88ab76c700 1 -- 172.21.15.81:0/784777671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f88a404e4c0 con 0x7f88a4154900 2023-10-25T23:36:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.168+0000 7f8899ffb700 1 -- 172.21.15.81:0/784777671 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f889c059e60 con 0x7f88a4154900 2023-10-25T23:36:20.169 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-25T23:36:20.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.170+0000 7f88ab76c700 1 -- 172.21.15.81:0/784777671 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f888806aed0 msgr2=0x7f888806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:20.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.170+0000 7f88ab76c700 1 --2- 172.21.15.81:0/784777671 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f888806aed0 0x7f888806d390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f88a0000f60 tx=0x7f88a0007a40 comp rx=0 tx=0).stop 2023-10-25T23:36:20.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.170+0000 7f88ab76c700 1 -- 172.21.15.81:0/784777671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a4154900 msgr2=0x7f88a4140e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:20.171 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.170+0000 7f88ab76c700 1 --2- 172.21.15.81:0/784777671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a4154900 0x7f88a4140e80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f889c009550 tx=0x7f889c007b50 comp rx=0 tx=0).stop 2023-10-25T23:36:20.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.170+0000 7f88ab76c700 1 -- 172.21.15.81:0/784777671 shutdown_connections 2023-10-25T23:36:20.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.170+0000 7f88ab76c700 1 --2- 172.21.15.81:0/784777671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88a4154900 0x7f88a4140e80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.170+0000 7f88ab76c700 1 --2- 172.21.15.81:0/784777671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88a40bb530 0x7f88a4134480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.170+0000 7f88ab76c700 1 --2- 172.21.15.81:0/784777671 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f888806aed0 0x7f888806d390 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.172 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.170+0000 7f88ab76c700 1 --2- 172.21.15.81:0/784777671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a4144f60 0x7f88a41325f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.170+0000 7f88ab76c700 1 -- 172.21.15.81:0/784777671 >> 172.21.15.81:0/784777671 conn(0x7f88a406b320 msgr2=0x7f88a40bd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:20.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.170+0000 7f88ab76c700 1 -- 172.21.15.81:0/784777671 shutdown_connections 2023-10-25T23:36:20.173 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.170+0000 7f88ab76c700 1 -- 172.21.15.81:0/784777671 wait complete. 2023-10-25T23:36:20.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T23:36:20.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.307+0000 7f0c214b3700 1 -- 172.21.15.81:0/311902557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c04005210 msgr2=0x7f0c0400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:20.308 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.307+0000 7f0c214b3700 1 --2- 172.21.15.81:0/311902557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c04005210 0x7f0c0400ba10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c1400e4a0 tx=0x7f0c04005880 comp rx=0 tx=0).stop 2023-10-25T23:36:20.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.307+0000 7f0c214b3700 1 -- 172.21.15.81:0/311902557 shutdown_connections 2023-10-25T23:36:20.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.307+0000 7f0c214b3700 1 --2- 172.21.15.81:0/311902557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c04005210 0x7f0c0400ba10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.307+0000 7f0c214b3700 1 -- 172.21.15.81:0/311902557 >> 172.21.15.81:0/311902557 conn(0x7f0c1c0a5730 msgr2=0x7f0c1c0a5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:20.309 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.307+0000 7f0c214b3700 1 -- 172.21.15.81:0/311902557 shutdown_connections 2023-10-25T23:36:20.310 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.307+0000 7f0c214b3700 1 -- 172.21.15.81:0/311902557 wait complete. 2023-10-25T23:36:20.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.308+0000 7f0c214b3700 1 Processor -- start 2023-10-25T23:36:20.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.308+0000 7f0c214b3700 1 -- start start 2023-10-25T23:36:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.309+0000 7f0c214b3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c04005210 0x7f0c1c14f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.309+0000 7f0c214b3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c1c14b070 0x7f0c1c150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.309+0000 7f0c214b3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c1c14b4f0 0x7f0c1c0b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.309+0000 7f0c214b3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c1479e0 con 0x7f0c04005210 2023-10-25T23:36:20.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.309+0000 7f0c214b3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c0a86f0 con 0x7f0c1c14b070 2023-10-25T23:36:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.309+0000 7f0c214b3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1c147790 con 0x7f0c1c14b4f0 2023-10-25T23:36:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.309+0000 7f0c1affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c04005210 0x7f0c1c14f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.309+0000 7f0c1affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c04005210 0x7f0c1c14f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36744/0 (socket says 172.21.15.81:36744) 2023-10-25T23:36:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.309+0000 7f0c1affd700 1 -- 172.21.15.81:0/1736506281 learned_addr learned my addr 172.21.15.81:0/1736506281 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:20.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.309+0000 7f0c1a7fc700 1 --2- 172.21.15.81:0/1736506281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c1c14b070 0x7f0c1c150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:20.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.309+0000 7f0c1b7fe700 1 --2- 172.21.15.81:0/1736506281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c1c14b4f0 0x7f0c1c0b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:20.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.309+0000 7f0c1affd700 1 -- 172.21.15.81:0/1736506281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c1c14b4f0 msgr2=0x7f0c1c0b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:20.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.309+0000 7f0c1affd700 1 --2- 172.21.15.81:0/1736506281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c1c14b4f0 0x7f0c1c0b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.309+0000 7f0c1affd700 1 -- 172.21.15.81:0/1736506281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c1c14b070 msgr2=0x7f0c1c150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:20.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.309+0000 7f0c1affd700 1 --2- 172.21.15.81:0/1736506281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c1c14b070 0x7f0c1c150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.309+0000 7f0c1affd700 1 -- 172.21.15.81:0/1736506281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1c0a7f80 con 0x7f0c04005210 2023-10-25T23:36:20.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.310+0000 7f0c1affd700 1 --2- 172.21.15.81:0/1736506281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c04005210 0x7f0c1c14f460 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c0066e0 tx=0x7f0c0c003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:20.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.310+0000 7f0c037fe700 1 -- 172.21.15.81:0/1736506281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c011840 con 0x7f0c04005210 2023-10-25T23:36:20.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.310+0000 7f0c037fe700 1 -- 172.21.15.81:0/1736506281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0c0c0119c0 con 0x7f0c04005210 2023-10-25T23:36:20.316 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.310+0000 7f0c214b3700 1 -- 172.21.15.81:0/1736506281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c1c0a9530 con 0x7f0c04005210 2023-10-25T23:36:20.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.310+0000 7f0c037fe700 1 -- 172.21.15.81:0/1736506281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c011dd0 con 0x7f0c04005210 2023-10-25T23:36:20.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.310+0000 7f0c214b3700 1 -- 172.21.15.81:0/1736506281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c1c0a81d0 con 0x7f0c04005210 2023-10-25T23:36:20.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.311+0000 7f0c214b3700 1 -- 172.21.15.81:0/1736506281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c1c0738f0 con 0x7f0c04005210 2023-10-25T23:36:20.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.311+0000 7f0c037fe700 1 -- 172.21.15.81:0/1736506281 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0c0c0103c0 con 0x7f0c04005210 2023-10-25T23:36:20.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.312+0000 7f0c037fe700 1 --2- 172.21.15.81:0/1736506281 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0c0806aed0 0x7f0c0806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:20.317 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.312+0000 7f0c037fe700 1 -- 172.21.15.81:0/1736506281 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c0c08a690 con 0x7f0c04005210 2023-10-25T23:36:20.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.312+0000 7f0c1a7fc700 1 --2- 172.21.15.81:0/1736506281 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0c0806aed0 0x7f0c0806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:20.318 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.312+0000 7f0c1a7fc700 1 --2- 172.21.15.81:0/1736506281 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0c0806aed0 0x7f0c0806d390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0c10000f60 tx=0x7f0c10006c40 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:20.319 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.316+0000 7f0c037fe700 1 -- 172.21.15.81:0/1736506281 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0c0c055820 con 0x7f0c04005210 2023-10-25T23:36:20.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.505+0000 7f0c214b3700 1 -- 172.21.15.81:0/1736506281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0c1c0c1e60 con 0x7f0c04005210 2023-10-25T23:36:20.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.506+0000 7f0c037fe700 1 -- 172.21.15.81:0/1736506281 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0c0c015020 con 0x7f0c04005210 2023-10-25T23:36:20.507 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-25T23:36:20.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.508+0000 7f0c214b3700 1 -- 172.21.15.81:0/1736506281 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0c0806aed0 msgr2=0x7f0c0806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:20.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.508+0000 7f0c214b3700 1 --2- 172.21.15.81:0/1736506281 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0c0806aed0 0x7f0c0806d390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0c10000f60 tx=0x7f0c10006c40 comp rx=0 tx=0).stop 2023-10-25T23:36:20.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.508+0000 7f0c214b3700 1 -- 172.21.15.81:0/1736506281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c04005210 msgr2=0x7f0c1c14f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:20.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.508+0000 7f0c214b3700 1 --2- 172.21.15.81:0/1736506281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c04005210 0x7f0c1c14f460 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c0066e0 tx=0x7f0c0c003960 comp rx=0 tx=0).stop 2023-10-25T23:36:20.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.508+0000 7f0c214b3700 1 -- 172.21.15.81:0/1736506281 shutdown_connections 2023-10-25T23:36:20.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.508+0000 7f0c214b3700 1 --2- 172.21.15.81:0/1736506281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c1c14b4f0 0x7f0c1c0b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.508+0000 7f0c214b3700 1 --2- 172.21.15.81:0/1736506281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c04005210 0x7f0c1c14f460 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.508+0000 7f0c214b3700 1 --2- 172.21.15.81:0/1736506281 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0c0806aed0 0x7f0c0806d390 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.508+0000 7f0c214b3700 1 --2- 172.21.15.81:0/1736506281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c1c14b070 0x7f0c1c150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.508+0000 7f0c214b3700 1 -- 172.21.15.81:0/1736506281 >> 172.21.15.81:0/1736506281 conn(0x7f0c1c0a5730 msgr2=0x7f0c1c06b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:20.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.508+0000 7f0c214b3700 1 -- 172.21.15.81:0/1736506281 shutdown_connections 2023-10-25T23:36:20.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.508+0000 7f0c214b3700 1 -- 172.21.15.81:0/1736506281 wait complete. 2023-10-25T23:36:20.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T23:36:20.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.641+0000 7f0d04ca3700 1 -- 172.21.15.81:0/1474911662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d001454f0 msgr2=0x7f0d0014ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:20.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.641+0000 7f0d04ca3700 1 --2- 172.21.15.81:0/1474911662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d001454f0 0x7f0d0014ec20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0cf40098c0 tx=0x7f0cf4009bd0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.641+0000 7f0d04ca3700 1 -- 172.21.15.81:0/1474911662 shutdown_connections 2023-10-25T23:36:20.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.641+0000 7f0d04ca3700 1 --2- 172.21.15.81:0/1474911662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d001454f0 0x7f0d0014ec20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.641+0000 7f0d04ca3700 1 --2- 172.21.15.81:0/1474911662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d0014b930 0x7f0d0014f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.641+0000 7f0d04ca3700 1 -- 172.21.15.81:0/1474911662 >> 172.21.15.81:0/1474911662 conn(0x7f0d000c0a40 msgr2=0x7f0d000c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:20.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.641+0000 7f0d04ca3700 1 -- 172.21.15.81:0/1474911662 shutdown_connections 2023-10-25T23:36:20.644 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.641+0000 7f0d04ca3700 1 -- 172.21.15.81:0/1474911662 wait complete. 2023-10-25T23:36:20.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.642+0000 7f0d04ca3700 1 Processor -- start 2023-10-25T23:36:20.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.642+0000 7f0d04ca3700 1 -- start start 2023-10-25T23:36:20.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.643+0000 7f0d04ca3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d0006cd80 0x7f0d0014db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:20.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.643+0000 7f0d04ca3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d001454f0 0x7f0d000c1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:20.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.643+0000 7f0d04ca3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d0014b930 0x7f0d001e24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:20.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.643+0000 7f0d04ca3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0014e190 con 0x7f0d001454f0 2023-10-25T23:36:20.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.643+0000 7f0d04ca3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d000c15d0 con 0x7f0d0006cd80 2023-10-25T23:36:20.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.643+0000 7f0d04ca3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d001e6900 con 0x7f0d0014b930 2023-10-25T23:36:20.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.643+0000 7f0cfdd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d001454f0 0x7f0d000c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:20.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.643+0000 7f0cfdd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d001454f0 0x7f0d000c1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36758/0 (socket says 172.21.15.81:36758) 2023-10-25T23:36:20.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.643+0000 7f0cfdd9b700 1 -- 172.21.15.81:0/40090783 learned_addr learned my addr 172.21.15.81:0/40090783 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:20.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.643+0000 7f0cfe59c700 1 --2- 172.21.15.81:0/40090783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d0006cd80 0x7f0d0014db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:20.649 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.643+0000 7f0cfed9d700 1 --2- 172.21.15.81:0/40090783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d0014b930 0x7f0d001e24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:20.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.643+0000 7f0cfdd9b700 1 -- 172.21.15.81:0/40090783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d0014b930 msgr2=0x7f0d001e24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:20.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.643+0000 7f0cfdd9b700 1 --2- 172.21.15.81:0/40090783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d0014b930 0x7f0d001e24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.643+0000 7f0cfdd9b700 1 -- 172.21.15.81:0/40090783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d0006cd80 msgr2=0x7f0d0014db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:20.650 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.643+0000 7f0cfdd9b700 1 --2- 172.21.15.81:0/40090783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d0006cd80 0x7f0d0014db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.643+0000 7f0cfdd9b700 1 -- 172.21.15.81:0/40090783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf4009520 con 0x7f0d001454f0 2023-10-25T23:36:20.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.643+0000 7f0cfdd9b700 1 --2- 172.21.15.81:0/40090783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d001454f0 0x7f0d000c1090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000c530 tx=0x7f0cf000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:20.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.644+0000 7f0ceeffd700 1 -- 172.21.15.81:0/40090783 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0011790 con 0x7f0d001454f0 2023-10-25T23:36:20.651 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.644+0000 7f0ceeffd700 1 -- 172.21.15.81:0/40090783 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0cf00119e0 con 0x7f0d001454f0 2023-10-25T23:36:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.644+0000 7f0d04ca3700 1 -- 172.21.15.81:0/40090783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d001e5b40 con 0x7f0d001454f0 2023-10-25T23:36:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.644+0000 7f0ceeffd700 1 -- 172.21.15.81:0/40090783 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0011dd0 con 0x7f0d001454f0 2023-10-25T23:36:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.644+0000 7f0d04ca3700 1 -- 172.21.15.81:0/40090783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d001e6100 con 0x7f0d001454f0 2023-10-25T23:36:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.644+0000 7f0d04ca3700 1 -- 172.21.15.81:0/40090783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0004e4c0 con 0x7f0d001454f0 2023-10-25T23:36:20.652 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.645+0000 7f0ceeffd700 1 -- 172.21.15.81:0/40090783 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0cf001c460 con 0x7f0d001454f0 2023-10-25T23:36:20.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.646+0000 7f0ceeffd700 1 --2- 172.21.15.81:0/40090783 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0ce006af00 0x7f0ce006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:20.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.646+0000 7f0ceeffd700 1 -- 172.21.15.81:0/40090783 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cf0089e50 con 0x7f0d001454f0 2023-10-25T23:36:20.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.646+0000 7f0cfe59c700 1 --2- 172.21.15.81:0/40090783 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0ce006af00 0x7f0ce006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:20.653 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.646+0000 7f0cfe59c700 1 --2- 172.21.15.81:0/40090783 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0ce006af00 0x7f0ce006d3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4000c00 tx=0x7f0cf40047c0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:20.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.649+0000 7f0ceeffd700 1 -- 172.21.15.81:0/40090783 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0cf0055070 con 0x7f0d001454f0 2023-10-25T23:36:20.883 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.882+0000 7f0d04ca3700 1 -- 172.21.15.81:0/40090783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d0006a960 con 0x7f0d001454f0 2023-10-25T23:36:20.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.883+0000 7f0ceeffd700 1 -- 172.21.15.81:0/40090783 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f0cf0058690 con 0x7f0d001454f0 2023-10-25T23:36:20.884 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:20.885 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2649006434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2649006434},{"type":"v1","addr":"172.21.15.89:6836","nonce":2649006434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1805624382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1805624382},{"type":"v1","addr":"172.21.15.89:6837","nonce":1805624382}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/1925858148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1925858148},{"type":"v1","addr":"172.21.15.81:6834","nonce":1925858148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T23:36:08.648444+0000","modified":"2023-10-25T23:36:11.695560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4350":{"gid":4350,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1640191478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1640191478},{"type":"v1","addr":"172.21.15.81:6835","nonce":1640191478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-25T23:36:20.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.885+0000 7f0d04ca3700 1 -- 172.21.15.81:0/40090783 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0ce006af00 msgr2=0x7f0ce006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:20.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.885+0000 7f0d04ca3700 1 --2- 172.21.15.81:0/40090783 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0ce006af00 0x7f0ce006d3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4000c00 tx=0x7f0cf40047c0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.885+0000 7f0d04ca3700 1 -- 172.21.15.81:0/40090783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d001454f0 msgr2=0x7f0d000c1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:20.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.885+0000 7f0d04ca3700 1 --2- 172.21.15.81:0/40090783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d001454f0 0x7f0d000c1090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000c530 tx=0x7f0cf000c840 comp rx=0 tx=0).stop 2023-10-25T23:36:20.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.885+0000 7f0d04ca3700 1 -- 172.21.15.81:0/40090783 shutdown_connections 2023-10-25T23:36:20.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.885+0000 7f0d04ca3700 1 --2- 172.21.15.81:0/40090783 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d0014b930 0x7f0d001e24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.885+0000 7f0d04ca3700 1 --2- 172.21.15.81:0/40090783 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0ce006af00 0x7f0ce006d3c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.885+0000 7f0d04ca3700 1 --2- 172.21.15.81:0/40090783 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d0006cd80 0x7f0d0014db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.885+0000 7f0d04ca3700 1 --2- 172.21.15.81:0/40090783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d001454f0 0x7f0d000c1090 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:20.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.885+0000 7f0d04ca3700 1 -- 172.21.15.81:0/40090783 >> 172.21.15.81:0/40090783 conn(0x7f0d000c0a40 msgr2=0x7f0d0006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:20.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.885+0000 7f0d04ca3700 1 -- 172.21.15.81:0/40090783 shutdown_connections 2023-10-25T23:36:20.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:20.885+0000 7f0d04ca3700 1 -- 172.21.15.81:0/40090783 wait complete. 2023-10-25T23:36:20.889 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2023-10-25T23:36:20.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T23:36:21.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.020+0000 7f1d5c4f6700 1 -- 172.21.15.81:0/2394476716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d40004d90 msgr2=0x7f1d40005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:21.021 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.020+0000 7f1d5c4f6700 1 --2- 172.21.15.81:0/2394476716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d40004d90 0x7f1d40005210 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00c680 tx=0x7f1d40005880 comp rx=0 tx=0).stop 2023-10-25T23:36:21.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.020+0000 7f1d5aa93700 1 -- 172.21.15.81:0/2394476716 reap_dead start 2023-10-25T23:36:21.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.020+0000 7f1d5c4f6700 1 -- 172.21.15.81:0/2394476716 shutdown_connections 2023-10-25T23:36:21.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.020+0000 7f1d5c4f6700 1 -- 172.21.15.81:0/2394476716 >> 172.21.15.81:0/2394476716 conn(0x7f1d540c0a40 msgr2=0x7f1d540c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:21.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.020+0000 7f1d5c4f6700 1 -- 172.21.15.81:0/2394476716 shutdown_connections 2023-10-25T23:36:21.022 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.020+0000 7f1d5c4f6700 1 -- 172.21.15.81:0/2394476716 wait complete. 2023-10-25T23:36:21.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.021+0000 7f1d5c4f6700 1 Processor -- start 2023-10-25T23:36:21.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.021+0000 7f1d5c4f6700 1 -- start start 2023-10-25T23:36:21.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d5c4f6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d40004d90 0x7f1d541d2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:21.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d5c4f6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d540bf270 0x7f1d540b8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:21.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d5c4f6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d540bf6f0 0x7f1d540b87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:21.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d5c4f6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5406e9f0 con 0x7f1d40004d90 2023-10-25T23:36:21.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d5c4f6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d540b8ce0 con 0x7f1d540bf270 2023-10-25T23:36:21.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d5c4f6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d541d3b20 con 0x7f1d540bf6f0 2023-10-25T23:36:21.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d5a292700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d40004d90 0x7f1d541d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:21.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d5a292700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d40004d90 0x7f1d541d2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36774/0 (socket says 172.21.15.81:36774) 2023-10-25T23:36:21.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d5a292700 1 -- 172.21.15.81:0/365129196 learned_addr learned my addr 172.21.15.81:0/365129196 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:21.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d59a91700 1 --2- 172.21.15.81:0/365129196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d540bf270 0x7f1d540b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:21.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d5aa93700 1 --2- 172.21.15.81:0/365129196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d540bf6f0 0x7f1d540b87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:21.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d5a292700 1 -- 172.21.15.81:0/365129196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d540bf6f0 msgr2=0x7f1d540b87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:21.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d5a292700 1 --2- 172.21.15.81:0/365129196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d540bf6f0 0x7f1d540b87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d5a292700 1 -- 172.21.15.81:0/365129196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d540bf270 msgr2=0x7f1d540b8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:21.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d5a292700 1 --2- 172.21.15.81:0/365129196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d540bf270 0x7f1d540b8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d5a292700 1 -- 172.21.15.81:0/365129196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d541d37d0 con 0x7f1d40004d90 2023-10-25T23:36:21.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d5a292700 1 --2- 172.21.15.81:0/365129196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d40004d90 0x7f1d541d2330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1d44011b10 tx=0x7f1d44011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:21.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d4affd700 1 -- 172.21.15.81:0/365129196 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4400fcc0 con 0x7f1d40004d90 2023-10-25T23:36:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d4affd700 1 -- 172.21.15.81:0/365129196 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1d4400fe20 con 0x7f1d40004d90 2023-10-25T23:36:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d5c4f6700 1 -- 172.21.15.81:0/365129196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5406ec00 con 0x7f1d40004d90 2023-10-25T23:36:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d4affd700 1 -- 172.21.15.81:0/365129196 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44004280 con 0x7f1d40004d90 2023-10-25T23:36:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.022+0000 7f1d5c4f6700 1 -- 172.21.15.81:0/365129196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d540c00e0 con 0x7f1d40004d90 2023-10-25T23:36:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.023+0000 7f1d5c4f6700 1 -- 172.21.15.81:0/365129196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d540b65b0 con 0x7f1d40004d90 2023-10-25T23:36:21.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.024+0000 7f1d4affd700 1 -- 172.21.15.81:0/365129196 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1d440043e0 con 0x7f1d40004d90 2023-10-25T23:36:21.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.024+0000 7f1d4affd700 1 --2- 172.21.15.81:0/365129196 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f1d3806aed0 0x7f1d3806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:21.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.024+0000 7f1d4affd700 1 -- 172.21.15.81:0/365129196 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d4408a050 con 0x7f1d40004d90 2023-10-25T23:36:21.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.024+0000 7f1d59a91700 1 --2- 172.21.15.81:0/365129196 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f1d3806aed0 0x7f1d3806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:21.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.025+0000 7f1d59a91700 1 --2- 172.21.15.81:0/365129196 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f1d3806aed0 0x7f1d3806d390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1d540bfc80 tx=0x7f1d50009260 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:21.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.029+0000 7f1d4affd700 1 -- 172.21.15.81:0/365129196 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1d44055250 con 0x7f1d40004d90 2023-10-25T23:36:21.222 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.222+0000 7f1d5c4f6700 1 -- 172.21.15.81:0/365129196 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d5404e4c0 con 0x7f1d40004d90 2023-10-25T23:36:21.223 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.223+0000 7f1d4affd700 1 -- 172.21.15.81:0/365129196 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f1d44058870 con 0x7f1d40004d90 2023-10-25T23:36:21.224 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:21.224 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf","created":"2023-10-25T23:35:42.986840+0000","modified":"2023-10-25T23:36:10.277991+0000","last_up_change":"2023-10-25T23:35:55.052199+0000","last_in_change":"2023-10-25T23:35:46.443490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T23:35:57.031170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T23:36:06.841771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T23:36:07.613269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48415836-8f22-4dcd-baa3-1d09c90c9a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6809","nonce":1045657984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6811","nonce":1045657984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6815","nonce":1045657984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6813","nonce":1045657984}]},"public_addr":"172.21.15.81:6809/1045657984","cluster_addr":"172.21.15.81:6811/1045657984","heartbeat_back_addr":"172.21.15.81:6815/1045657984","heartbeat_front_addr":"172.21.15.81:6813/1045657984","state":["exists","up"]},{"osd":1,"uuid":"19a4f6b5-e75c-45ae-aa08-b3467e69eed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6801","nonce":725386907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6803","nonce":725386907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6807","nonce":725386907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6805","nonce":725386907}]},"public_addr":"172.21.15.81:6801/725386907","cluster_addr":"172.21.15.81:6803/725386907","heartbeat_back_addr":"172.21.15.81:6807/725386907","heartbeat_front_addr":"172.21.15.81:6805/725386907","state":["exists","up"]},{"osd":2,"uuid":"60645312-54f5-4a74-ae52-68d17ff2d6e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6825","nonce":1744054610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6827","nonce":1744054610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6831","nonce":1744054610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6829","nonce":1744054610}]},"public_addr":"172.21.15.81:6825/1744054610","cluster_addr":"172.21.15.81:6827/1744054610","heartbeat_back_addr":"172.21.15.81:6831/1744054610","heartbeat_front_addr":"172.21.15.81:6829/1744054610","state":["exists","up"]},{"osd":3,"uuid":"c636a4a2-c1e8-4306-a78b-fe37eebab526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6817","nonce":1391123341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6819","nonce":1391123341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6823","nonce":1391123341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6821","nonce":1391123341}]},"public_addr":"172.21.15.81:6817/1391123341","cluster_addr":"172.21.15.81:6819/1391123341","heartbeat_back_addr":"172.21.15.81:6823/1391123341","heartbeat_front_addr":"172.21.15.81:6821/1391123341","state":["exists","up"]},{"osd":4,"uuid":"3cafc826-e531-4aa7-8b2a-b592f318f138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6817","nonce":1232781703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6819","nonce":1232781703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6823","nonce":1232781703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6821","nonce":1232781703}]},"public_addr":"172.21.15.89:6817/1232781703","cluster_addr":"172.21.15.89:6819/1232781703","heartbeat_back_addr":"172.21.15.89:6823/1232781703","heartbeat_front_addr":"172.21.15.89:6821/1232781703","state":["exists","up"]},{"osd":5,"uuid":"6098deb2-258e-47e1-b283-9a24c9dddf27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6801","nonce":2255820086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6803","nonce":2255820086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6807","nonce":2255820086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6805","nonce":2255820086}]},"public_addr":"172.21.15.89:6801/2255820086","cluster_addr":"172.21.15.89:6803/2255820086","heartbeat_back_addr":"172.21.15.89:6807/2255820086","heartbeat_front_addr":"172.21.15.89:6805/2255820086","state":["exists","up"]},{"osd":6,"uuid":"d79f68de-3c19-4f68-bbd1-59c8484dfaa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6809","nonce":2561967165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6811","nonce":2561967165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6815","nonce":2561967165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6813","nonce":2561967165}]},"public_addr":"172.21.15.89:6809/2561967165","cluster_addr":"172.21.15.89:6811/2561967165","heartbeat_back_addr":"172.21.15.89:6815/2561967165","heartbeat_front_addr":"172.21.15.89:6813/2561967165","state":["exists","up"]},{"osd":7,"uuid":"f1f7002e-4de9-4a08-97a1-fb52a116687f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6825","nonce":2647243500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6827","nonce":2647243500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6831","nonce":2647243500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6829","nonce":2647243500}]},"public_addr":"172.21.15.89:6825/2647243500","cluster_addr":"172.21.15.89:6827/2647243500","heartbeat_back_addr":"172.21.15.89:6831/2647243500","heartbeat_front_addr":"172.21.15.89:6829/2647243500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.613750+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.593515+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.713198+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.725623+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.686409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.596728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.670930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.676762+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T23:36:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.225+0000 7f1d5c4f6700 1 -- 172.21.15.81:0/365129196 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f1d3806aed0 msgr2=0x7f1d3806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.225+0000 7f1d5c4f6700 1 --2- 172.21.15.81:0/365129196 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f1d3806aed0 0x7f1d3806d390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1d540bfc80 tx=0x7f1d50009260 comp rx=0 tx=0).stop 2023-10-25T23:36:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.225+0000 7f1d5c4f6700 1 -- 172.21.15.81:0/365129196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d40004d90 msgr2=0x7f1d541d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.225+0000 7f1d5c4f6700 1 --2- 172.21.15.81:0/365129196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d40004d90 0x7f1d541d2330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1d44011b10 tx=0x7f1d44011e20 comp rx=0 tx=0).stop 2023-10-25T23:36:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.225+0000 7f1d5c4f6700 1 -- 172.21.15.81:0/365129196 shutdown_connections 2023-10-25T23:36:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.225+0000 7f1d5c4f6700 1 --2- 172.21.15.81:0/365129196 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d540bf6f0 0x7f1d540b87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.225+0000 7f1d5c4f6700 1 --2- 172.21.15.81:0/365129196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d40004d90 0x7f1d541d2330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.225+0000 7f1d5c4f6700 1 --2- 172.21.15.81:0/365129196 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f1d3806aed0 0x7f1d3806d390 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.225+0000 7f1d5c4f6700 1 --2- 172.21.15.81:0/365129196 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d540bf270 0x7f1d540b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.225+0000 7f1d5c4f6700 1 -- 172.21.15.81:0/365129196 >> 172.21.15.81:0/365129196 conn(0x7f1d540c0a40 msgr2=0x7f1d540be820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:21.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.225+0000 7f1d5c4f6700 1 -- 172.21.15.81:0/365129196 shutdown_connections 2023-10-25T23:36:21.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.225+0000 7f1d5c4f6700 1 -- 172.21.15.81:0/365129196 wait complete. 2023-10-25T23:36:21.238 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T23:35:57.031170+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T23:36:06.841771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T23:36:07.613269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T23:36:21.239 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T23:36:21.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.364+0000 7f5fd82de700 1 -- 172.21.15.81:0/2858750834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fbc004d90 msgr2=0x7f5fbc005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:21.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.364+0000 7f5fd82de700 1 --2- 172.21.15.81:0/2858750834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fbc004d90 0x7f5fbc005210 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8001e20 tx=0x7f5fbc005880 comp rx=0 tx=0).stop 2023-10-25T23:36:21.366 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.364+0000 7f5fd687b700 1 -- 172.21.15.81:0/2858750834 reap_dead start 2023-10-25T23:36:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.365+0000 7f5fd82de700 1 -- 172.21.15.81:0/2858750834 shutdown_connections 2023-10-25T23:36:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.365+0000 7f5fd82de700 1 -- 172.21.15.81:0/2858750834 >> 172.21.15.81:0/2858750834 conn(0x7f5fd006b320 msgr2=0x7f5fd006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.365+0000 7f5fd82de700 1 -- 172.21.15.81:0/2858750834 shutdown_connections 2023-10-25T23:36:21.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.365+0000 7f5fd82de700 1 -- 172.21.15.81:0/2858750834 wait complete. 2023-10-25T23:36:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.366+0000 7f5fd82de700 1 Processor -- start 2023-10-25T23:36:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.366+0000 7f5fd82de700 1 -- start start 2023-10-25T23:36:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.366+0000 7f5fd82de700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5fbc004d90 0x7f5fd01444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.366+0000 7f5fd82de700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fd014e6c0 0x7f5fd014c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.366+0000 7f5fd82de700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fd00bfe10 0x7f5fd014c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:21.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.366+0000 7f5fd82de700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd01e2ea0 con 0x7f5fd014e6c0 2023-10-25T23:36:21.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.366+0000 7f5fd82de700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd0144a30 con 0x7f5fd00bfe10 2023-10-25T23:36:21.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.366+0000 7f5fd82de700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd014a940 con 0x7f5fbc004d90 2023-10-25T23:36:21.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.366+0000 7f5fd5879700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fd014e6c0 0x7f5fd014c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:21.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.366+0000 7f5fd5879700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fd014e6c0 0x7f5fd014c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36796/0 (socket says 172.21.15.81:36796) 2023-10-25T23:36:21.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.366+0000 7f5fd5879700 1 -- 172.21.15.81:0/4198432263 learned_addr learned my addr 172.21.15.81:0/4198432263 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:21.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.367+0000 7f5fd607a700 1 --2- 172.21.15.81:0/4198432263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5fbc004d90 0x7f5fd01444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:21.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.367+0000 7f5fd687b700 1 --2- 172.21.15.81:0/4198432263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fd00bfe10 0x7f5fd014c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:21.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.367+0000 7f5fd5879700 1 -- 172.21.15.81:0/4198432263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5fbc004d90 msgr2=0x7f5fd01444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:21.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.367+0000 7f5fd5879700 1 --2- 172.21.15.81:0/4198432263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5fbc004d90 0x7f5fd01444f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.367+0000 7f5fd5879700 1 -- 172.21.15.81:0/4198432263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fd00bfe10 msgr2=0x7f5fd014c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.367+0000 7f5fd5879700 1 --2- 172.21.15.81:0/4198432263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fd00bfe10 0x7f5fd014c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.367+0000 7f5fd5879700 1 -- 172.21.15.81:0/4198432263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd00bf410 con 0x7f5fd014e6c0 2023-10-25T23:36:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.367+0000 7f5fd607a700 1 --2- 172.21.15.81:0/4198432263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5fbc004d90 0x7f5fd01444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:36:21.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.367+0000 7f5fd687b700 1 --2- 172.21.15.81:0/4198432263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fd00bfe10 0x7f5fd014c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:36:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.367+0000 7f5fd5879700 1 --2- 172.21.15.81:0/4198432263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fd014e6c0 0x7f5fd014c220 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0006600 tx=0x7f5fc0003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.367+0000 7f5fc6ffd700 1 -- 172.21.15.81:0/4198432263 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0011900 con 0x7f5fd014e6c0 2023-10-25T23:36:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.367+0000 7f5fc6ffd700 1 -- 172.21.15.81:0/4198432263 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5fc0011a80 con 0x7f5fd014e6c0 2023-10-25T23:36:21.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.367+0000 7f5fd82de700 1 -- 172.21.15.81:0/4198432263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd00bf130 con 0x7f5fd014e6c0 2023-10-25T23:36:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.367+0000 7f5fc6ffd700 1 -- 172.21.15.81:0/4198432263 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0011e90 con 0x7f5fd014e6c0 2023-10-25T23:36:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.367+0000 7f5fd82de700 1 -- 172.21.15.81:0/4198432263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd0148690 con 0x7f5fd014e6c0 2023-10-25T23:36:21.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.368+0000 7f5fd82de700 1 -- 172.21.15.81:0/4198432263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd0073970 con 0x7f5fd014e6c0 2023-10-25T23:36:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.368+0000 7f5fc6ffd700 1 -- 172.21.15.81:0/4198432263 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5fc00103c0 con 0x7f5fd014e6c0 2023-10-25T23:36:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.369+0000 7f5fc6ffd700 1 --2- 172.21.15.81:0/4198432263 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f5fb406aed0 0x7f5fb406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:21.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.369+0000 7f5fc6ffd700 1 -- 172.21.15.81:0/4198432263 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fc008a860 con 0x7f5fd014e6c0 2023-10-25T23:36:21.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.369+0000 7f5fd607a700 1 --2- 172.21.15.81:0/4198432263 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f5fb406aed0 0x7f5fb406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:21.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.369+0000 7f5fd607a700 1 --2- 172.21.15.81:0/4198432263 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f5fb406aed0 0x7f5fb406d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009d40 tx=0x7f5fcc009260 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:21.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.373+0000 7f5fc6ffd700 1 -- 172.21.15.81:0/4198432263 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5fc0055890 con 0x7f5fd014e6c0 2023-10-25T23:36:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.558+0000 7f5fd82de700 1 -- 172.21.15.81:0/4198432263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5fd004e4c0 con 0x7f5fd014e6c0 2023-10-25T23:36:21.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.558+0000 7f5fc6ffd700 1 -- 172.21.15.81:0/4198432263 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5fc00150a0 con 0x7f5fd014e6c0 2023-10-25T23:36:21.561 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-25T23:36:21.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.560+0000 7f5fd82de700 1 -- 172.21.15.81:0/4198432263 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f5fb406aed0 msgr2=0x7f5fb406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:21.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.560+0000 7f5fd82de700 1 --2- 172.21.15.81:0/4198432263 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f5fb406aed0 0x7f5fb406d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009d40 tx=0x7f5fcc009260 comp rx=0 tx=0).stop 2023-10-25T23:36:21.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.560+0000 7f5fd82de700 1 -- 172.21.15.81:0/4198432263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fd014e6c0 msgr2=0x7f5fd014c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:21.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.560+0000 7f5fd82de700 1 --2- 172.21.15.81:0/4198432263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fd014e6c0 0x7f5fd014c220 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0006600 tx=0x7f5fc0003960 comp rx=0 tx=0).stop 2023-10-25T23:36:21.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.560+0000 7f5fd82de700 1 -- 172.21.15.81:0/4198432263 shutdown_connections 2023-10-25T23:36:21.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.560+0000 7f5fd82de700 1 --2- 172.21.15.81:0/4198432263 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f5fb406aed0 0x7f5fb406d390 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.564 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.560+0000 7f5fd82de700 1 --2- 172.21.15.81:0/4198432263 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5fd00bfe10 0x7f5fd014c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.560+0000 7f5fd82de700 1 --2- 172.21.15.81:0/4198432263 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5fbc004d90 0x7f5fd01444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.560+0000 7f5fd82de700 1 --2- 172.21.15.81:0/4198432263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fd014e6c0 0x7f5fd014c220 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.560+0000 7f5fd82de700 1 -- 172.21.15.81:0/4198432263 >> 172.21.15.81:0/4198432263 conn(0x7f5fd006b320 msgr2=0x7f5fd00bd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:21.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.561+0000 7f5fd82de700 1 -- 172.21.15.81:0/4198432263 shutdown_connections 2023-10-25T23:36:21.565 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.561+0000 7f5fd82de700 1 -- 172.21.15.81:0/4198432263 wait complete. 2023-10-25T23:36:21.574 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T23:36:21.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.698+0000 7fde7f1a6700 1 -- 172.21.15.81:0/3717650437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde781538f0 msgr2=0x7fde78155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:21.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.698+0000 7fde7f1a6700 1 --2- 172.21.15.81:0/3717650437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde781538f0 0x7fde78155ce0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fde70009fd0 tx=0x7fde7000b380 comp rx=0 tx=0).stop 2023-10-25T23:36:21.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.698+0000 7fde7f1a6700 1 -- 172.21.15.81:0/3717650437 shutdown_connections 2023-10-25T23:36:21.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.698+0000 7fde7f1a6700 1 --2- 172.21.15.81:0/3717650437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde781538f0 0x7fde78155ce0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.698+0000 7fde7f1a6700 1 --2- 172.21.15.81:0/3717650437 >> v2:172.21.15.89:3300/0 conn(0x7fde78144f60 0x7fde7814b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.698+0000 7fde7f1a6700 1 -- 172.21.15.81:0/3717650437 >> 172.21.15.81:0/3717650437 conn(0x7fde7806b320 msgr2=0x7fde7806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:21.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.698+0000 7fde7f1a6700 1 -- 172.21.15.81:0/3717650437 shutdown_connections 2023-10-25T23:36:21.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.698+0000 7fde7f1a6700 1 -- 172.21.15.81:0/3717650437 wait complete. 2023-10-25T23:36:21.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.699+0000 7fde7f1a6700 1 Processor -- start 2023-10-25T23:36:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.699+0000 7fde7f1a6700 1 -- start start 2023-10-25T23:36:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.700+0000 7fde7f1a6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde780bb530 0x7fde7806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.700+0000 7fde7f1a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde78144f60 0x7fde78151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.700+0000 7fde7f1a6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde781538f0 0x7fde781e42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.700+0000 7fde7f1a6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde78142cb0 con 0x7fde78144f60 2023-10-25T23:36:21.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.700+0000 7fde7f1a6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde78150760 con 0x7fde780bb530 2023-10-25T23:36:21.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.700+0000 7fde7f1a6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7806a9c0 con 0x7fde781538f0 2023-10-25T23:36:21.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.700+0000 7fde77fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde78144f60 0x7fde78151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:21.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.700+0000 7fde77fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde78144f60 0x7fde78151930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36812/0 (socket says 172.21.15.81:36812) 2023-10-25T23:36:21.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.700+0000 7fde77fff700 1 -- 172.21.15.81:0/2080168254 learned_addr learned my addr 172.21.15.81:0/2080168254 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:21.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.700+0000 7fde7cf42700 1 --2- 172.21.15.81:0/2080168254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde780bb530 0x7fde7806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.700+0000 7fde7d743700 1 --2- 172.21.15.81:0/2080168254 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde781538f0 0x7fde781e42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.700+0000 7fde77fff700 1 -- 172.21.15.81:0/2080168254 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde781538f0 msgr2=0x7fde781e42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.700+0000 7fde77fff700 1 --2- 172.21.15.81:0/2080168254 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde781538f0 0x7fde781e42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.700+0000 7fde77fff700 1 -- 172.21.15.81:0/2080168254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde780bb530 msgr2=0x7fde7806a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:21.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.700+0000 7fde77fff700 1 --2- 172.21.15.81:0/2080168254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde780bb530 0x7fde7806a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.700+0000 7fde77fff700 1 -- 172.21.15.81:0/2080168254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde70009d00 con 0x7fde78144f60 2023-10-25T23:36:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.701+0000 7fde77fff700 1 --2- 172.21.15.81:0/2080168254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde78144f60 0x7fde78151930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fde6400c460 tx=0x7fde6400c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.701+0000 7fde757fa700 1 -- 172.21.15.81:0/2080168254 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde640052d0 con 0x7fde78144f60 2023-10-25T23:36:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.701+0000 7fde757fa700 1 -- 172.21.15.81:0/2080168254 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fde64005540 con 0x7fde78144f60 2023-10-25T23:36:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.701+0000 7fde7f1a6700 1 -- 172.21.15.81:0/2080168254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde78142a10 con 0x7fde78144f60 2023-10-25T23:36:21.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.701+0000 7fde757fa700 1 -- 172.21.15.81:0/2080168254 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde640038c0 con 0x7fde78144f60 2023-10-25T23:36:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.701+0000 7fde7f1a6700 1 -- 172.21.15.81:0/2080168254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde781509b0 con 0x7fde78144f60 2023-10-25T23:36:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.702+0000 7fde7f1a6700 1 -- 172.21.15.81:0/2080168254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7806dcc0 con 0x7fde78144f60 2023-10-25T23:36:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.702+0000 7fde757fa700 1 -- 172.21.15.81:0/2080168254 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fde64003a20 con 0x7fde78144f60 2023-10-25T23:36:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.702+0000 7fde757fa700 1 --2- 172.21.15.81:0/2080168254 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fde5c06aed0 0x7fde5c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.703+0000 7fde757fa700 1 -- 172.21.15.81:0/2080168254 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde64088a90 con 0x7fde78144f60 2023-10-25T23:36:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.703+0000 7fde7cf42700 1 --2- 172.21.15.81:0/2080168254 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fde5c06aed0 0x7fde5c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:21.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.703+0000 7fde7cf42700 1 --2- 172.21.15.81:0/2080168254 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fde5c06aed0 0x7fde5c06d390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fde6c009bc0 tx=0x7fde6c009260 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:21.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.707+0000 7fde757fa700 1 -- 172.21.15.81:0/2080168254 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde64053bd0 con 0x7fde78144f60 2023-10-25T23:36:21.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.899+0000 7fde7f1a6700 1 -- 172.21.15.81:0/2080168254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde7804e4c0 con 0x7fde78144f60 2023-10-25T23:36:21.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.900+0000 7fde757fa700 1 -- 172.21.15.81:0/2080168254 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fde64017020 con 0x7fde78144f60 2023-10-25T23:36:21.902 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-25T23:36:21.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.902+0000 7fde7f1a6700 1 -- 172.21.15.81:0/2080168254 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fde5c06aed0 msgr2=0x7fde5c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:21.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.902+0000 7fde7f1a6700 1 --2- 172.21.15.81:0/2080168254 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fde5c06aed0 0x7fde5c06d390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fde6c009bc0 tx=0x7fde6c009260 comp rx=0 tx=0).stop 2023-10-25T23:36:21.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.902+0000 7fde7f1a6700 1 -- 172.21.15.81:0/2080168254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde78144f60 msgr2=0x7fde78151930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:21.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.902+0000 7fde7f1a6700 1 --2- 172.21.15.81:0/2080168254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde78144f60 0x7fde78151930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fde6400c460 tx=0x7fde6400c770 comp rx=0 tx=0).stop 2023-10-25T23:36:21.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.902+0000 7fde7f1a6700 1 -- 172.21.15.81:0/2080168254 shutdown_connections 2023-10-25T23:36:21.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.902+0000 7fde7f1a6700 1 --2- 172.21.15.81:0/2080168254 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde781538f0 0x7fde781e42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.902+0000 7fde7f1a6700 1 --2- 172.21.15.81:0/2080168254 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fde5c06aed0 0x7fde5c06d390 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.902+0000 7fde7f1a6700 1 --2- 172.21.15.81:0/2080168254 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde780bb530 0x7fde7806a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.902+0000 7fde7f1a6700 1 --2- 172.21.15.81:0/2080168254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde78144f60 0x7fde78151930 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:21.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.902+0000 7fde7f1a6700 1 -- 172.21.15.81:0/2080168254 >> 172.21.15.81:0/2080168254 conn(0x7fde7806b320 msgr2=0x7fde7806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:21.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.902+0000 7fde7f1a6700 1 -- 172.21.15.81:0/2080168254 shutdown_connections 2023-10-25T23:36:21.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:21.902+0000 7fde7f1a6700 1 -- 172.21.15.81:0/2080168254 wait complete. 2023-10-25T23:36:21.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T23:36:22.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.040+0000 7f56e460f700 1 -- 172.21.15.81:0/560502432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56c8003f80 msgr2=0x7f56c8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:22.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.040+0000 7f56e460f700 1 --2- 172.21.15.81:0/560502432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56c8003f80 0x7f56c8004850 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f56d800c340 tx=0x7f56c8005880 comp rx=0 tx=0).stop 2023-10-25T23:36:22.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.040+0000 7f56e2bac700 1 -- 172.21.15.81:0/560502432 reap_dead start 2023-10-25T23:36:22.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.040+0000 7f56e460f700 1 -- 172.21.15.81:0/560502432 shutdown_connections 2023-10-25T23:36:22.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.040+0000 7f56e460f700 1 -- 172.21.15.81:0/560502432 >> 172.21.15.81:0/560502432 conn(0x7f56dc0c1a70 msgr2=0x7f56dc0c1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:22.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.040+0000 7f56e460f700 1 -- 172.21.15.81:0/560502432 shutdown_connections 2023-10-25T23:36:22.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.040+0000 7f56e460f700 1 -- 172.21.15.81:0/560502432 wait complete. 2023-10-25T23:36:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.042+0000 7f56e460f700 1 Processor -- start 2023-10-25T23:36:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.042+0000 7f56e460f700 1 -- start start 2023-10-25T23:36:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.042+0000 7f56e460f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56c8003f80 0x7f56dc0a4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.042+0000 7f56e460f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56dc0a70d0 0x7f56dc1e5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.042+0000 7f56e460f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56dc147660 0x7f56dc147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:22.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.042+0000 7f56e460f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0a6cb0 con 0x7f56dc0a70d0 2023-10-25T23:36:22.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.042+0000 7f56e460f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc1e6130 con 0x7f56c8003f80 2023-10-25T23:36:22.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.042+0000 7f56e460f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0a68d0 con 0x7f56dc147660 2023-10-25T23:36:22.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.042+0000 7f56e1baa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56dc0a70d0 0x7f56dc1e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:22.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.043+0000 7f56e1baa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56dc0a70d0 0x7f56dc1e5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36828/0 (socket says 172.21.15.81:36828) 2023-10-25T23:36:22.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.043+0000 7f56e1baa700 1 -- 172.21.15.81:0/2601137546 learned_addr learned my addr 172.21.15.81:0/2601137546 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:22.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.043+0000 7f56e23ab700 1 --2- 172.21.15.81:0/2601137546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56c8003f80 0x7f56dc0a4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:22.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.043+0000 7f56e2bac700 1 --2- 172.21.15.81:0/2601137546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56dc147660 0x7f56dc147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:22.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.043+0000 7f56e1baa700 1 -- 172.21.15.81:0/2601137546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56dc147660 msgr2=0x7f56dc147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:22.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.043+0000 7f56e1baa700 1 --2- 172.21.15.81:0/2601137546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56dc147660 0x7f56dc147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.043+0000 7f56e1baa700 1 -- 172.21.15.81:0/2601137546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56c8003f80 msgr2=0x7f56dc0a4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:22.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.043+0000 7f56e1baa700 1 --2- 172.21.15.81:0/2601137546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56c8003f80 0x7f56dc0a4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.043+0000 7f56e1baa700 1 -- 172.21.15.81:0/2601137546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc0b94a0 con 0x7f56dc0a70d0 2023-10-25T23:36:22.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.043+0000 7f56e23ab700 1 --2- 172.21.15.81:0/2601137546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56c8003f80 0x7f56dc0a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:36:22.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.043+0000 7f56e2bac700 1 --2- 172.21.15.81:0/2601137546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56dc147660 0x7f56dc147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:36:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.043+0000 7f56e1baa700 1 --2- 172.21.15.81:0/2601137546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56dc0a70d0 0x7f56dc1e5860 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f56c8004790 tx=0x7f56d800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.043+0000 7f56d2ffd700 1 -- 172.21.15.81:0/2601137546 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8003680 con 0x7f56dc0a70d0 2023-10-25T23:36:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.043+0000 7f56d2ffd700 1 -- 172.21.15.81:0/2601137546 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f56d80038d0 con 0x7f56dc0a70d0 2023-10-25T23:36:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.043+0000 7f56e460f700 1 -- 172.21.15.81:0/2601137546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56dc1e6410 con 0x7f56dc0a70d0 2023-10-25T23:36:22.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.043+0000 7f56d2ffd700 1 -- 172.21.15.81:0/2601137546 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d8003ce0 con 0x7f56dc0a70d0 2023-10-25T23:36:22.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.043+0000 7f56e460f700 1 -- 172.21.15.81:0/2601137546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56dc1e5da0 con 0x7f56dc0a70d0 2023-10-25T23:36:22.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.044+0000 7f56e460f700 1 -- 172.21.15.81:0/2601137546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56dc1e6270 con 0x7f56dc0a70d0 2023-10-25T23:36:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.044+0000 7f56d2ffd700 1 -- 172.21.15.81:0/2601137546 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f56d8022070 con 0x7f56dc0a70d0 2023-10-25T23:36:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.045+0000 7f56d2ffd700 1 --2- 172.21.15.81:0/2601137546 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f56c006af00 0x7f56c006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.045+0000 7f56d2ffd700 1 -- 172.21.15.81:0/2601137546 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56d808b6d0 con 0x7f56dc0a70d0 2023-10-25T23:36:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.045+0000 7f56e23ab700 1 --2- 172.21.15.81:0/2601137546 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f56c006af00 0x7f56c006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.046+0000 7f56e23ab700 1 --2- 172.21.15.81:0/2601137546 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f56c006af00 0x7f56c006d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00dbf0 tx=0x7f56cc00d5d0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.049+0000 7f56d2ffd700 1 -- 172.21.15.81:0/2601137546 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f56dc1e6270 con 0x7f56dc0a70d0 2023-10-25T23:36:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.239+0000 7f56e460f700 1 -- 172.21.15.81:0/2601137546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56dc0a6df0 con 0x7f56dc0a70d0 2023-10-25T23:36:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.239+0000 7f56d2ffd700 1 -- 172.21.15.81:0/2601137546 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56dc0a6df0 con 0x7f56dc0a70d0 2023-10-25T23:36:22.242 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-25T23:36:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.241+0000 7f56e460f700 1 -- 172.21.15.81:0/2601137546 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f56c006af00 msgr2=0x7f56c006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.241+0000 7f56e460f700 1 --2- 172.21.15.81:0/2601137546 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f56c006af00 0x7f56c006d3c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f56cc00dbf0 tx=0x7f56cc00d5d0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.244 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.241+0000 7f56e460f700 1 -- 172.21.15.81:0/2601137546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56dc0a70d0 msgr2=0x7f56dc1e5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:22.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.241+0000 7f56e460f700 1 --2- 172.21.15.81:0/2601137546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56dc0a70d0 0x7f56dc1e5860 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f56c8004790 tx=0x7f56d800cca0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.241+0000 7f56e460f700 1 -- 172.21.15.81:0/2601137546 shutdown_connections 2023-10-25T23:36:22.245 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.241+0000 7f56e460f700 1 --2- 172.21.15.81:0/2601137546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56dc147660 0x7f56dc147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.241+0000 7f56e460f700 1 --2- 172.21.15.81:0/2601137546 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f56c006af00 0x7f56c006d3c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.241+0000 7f56e460f700 1 --2- 172.21.15.81:0/2601137546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56c8003f80 0x7f56dc0a4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.246 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.241+0000 7f56e460f700 1 --2- 172.21.15.81:0/2601137546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56dc0a70d0 0x7f56dc1e5860 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.241+0000 7f56e460f700 1 -- 172.21.15.81:0/2601137546 >> 172.21.15.81:0/2601137546 conn(0x7f56dc0c1a70 msgr2=0x7f56dc0b8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.241+0000 7f56e460f700 1 -- 172.21.15.81:0/2601137546 shutdown_connections 2023-10-25T23:36:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.241+0000 7f56e460f700 1 -- 172.21.15.81:0/2601137546 wait complete. 2023-10-25T23:36:22.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T23:36:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.376+0000 7f0dbf972700 1 -- 172.21.15.81:0/174977785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da4003fb0 msgr2=0x7f0da4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:22.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.376+0000 7f0dbf972700 1 --2- 172.21.15.81:0/174977785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da4003fb0 0x7f0da4004850 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c310 tx=0x7f0da4005880 comp rx=0 tx=0).stop 2023-10-25T23:36:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.376+0000 7f0dbdf0f700 1 -- 172.21.15.81:0/174977785 reap_dead start 2023-10-25T23:36:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.376+0000 7f0dbf972700 1 -- 172.21.15.81:0/174977785 shutdown_connections 2023-10-25T23:36:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.376+0000 7f0dbf972700 1 -- 172.21.15.81:0/174977785 >> 172.21.15.81:0/174977785 conn(0x7f0db80c0a40 msgr2=0x7f0db80c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.376+0000 7f0dbf972700 1 -- 172.21.15.81:0/174977785 shutdown_connections 2023-10-25T23:36:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.376+0000 7f0dbf972700 1 -- 172.21.15.81:0/174977785 wait complete. 2023-10-25T23:36:22.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.377+0000 7f0dbf972700 1 Processor -- start 2023-10-25T23:36:22.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.377+0000 7f0dbf972700 1 -- start start 2023-10-25T23:36:22.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.378+0000 7f0dbf972700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0da4003fb0 0x7f0db812c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:22.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.378+0000 7f0dbf972700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db8148300 0x7f0db81e4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:22.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.378+0000 7f0dbf972700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0db812d510 0x7f0db814d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:22.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.378+0000 7f0dbf972700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db81e5090 con 0x7f0db812d510 2023-10-25T23:36:22.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.378+0000 7f0dbf972700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db81e4dd0 con 0x7f0da4003fb0 2023-10-25T23:36:22.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.378+0000 7f0dbf972700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db81472a0 con 0x7f0db8148300 2023-10-25T23:36:22.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.378+0000 7f0dbdf0f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0db812d510 0x7f0db814d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:22.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.378+0000 7f0dbdf0f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0db812d510 0x7f0db814d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36850/0 (socket says 172.21.15.81:36850) 2023-10-25T23:36:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.378+0000 7f0dbdf0f700 1 -- 172.21.15.81:0/3938209368 learned_addr learned my addr 172.21.15.81:0/3938209368 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.378+0000 7f0dbd70e700 1 --2- 172.21.15.81:0/3938209368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0da4003fb0 0x7f0db812c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.378+0000 7f0dbcf0d700 1 --2- 172.21.15.81:0/3938209368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db8148300 0x7f0db81e4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.379+0000 7f0dbdf0f700 1 -- 172.21.15.81:0/3938209368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db8148300 msgr2=0x7f0db81e4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:22.385 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.379+0000 7f0dbdf0f700 1 --2- 172.21.15.81:0/3938209368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db8148300 0x7f0db81e4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.379+0000 7f0dbdf0f700 1 -- 172.21.15.81:0/3938209368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0da4003fb0 msgr2=0x7f0db812c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.379+0000 7f0dbdf0f700 1 --2- 172.21.15.81:0/3938209368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0da4003fb0 0x7f0db812c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.379+0000 7f0dbdf0f700 1 -- 172.21.15.81:0/3938209368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db81e5330 con 0x7f0db812d510 2023-10-25T23:36:22.386 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.379+0000 7f0dbdf0f700 1 --2- 172.21.15.81:0/3938209368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0db812d510 0x7f0db814d520 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0db806cc60 tx=0x7f0db0001e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:22.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.379+0000 7f0dadffb700 1 -- 172.21.15.81:0/3938209368 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0013660 con 0x7f0db812d510 2023-10-25T23:36:22.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.379+0000 7f0dadffb700 1 -- 172.21.15.81:0/3938209368 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0db00137e0 con 0x7f0db812d510 2023-10-25T23:36:22.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.379+0000 7f0dbf972700 1 -- 172.21.15.81:0/3938209368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db8147580 con 0x7f0db812d510 2023-10-25T23:36:22.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.379+0000 7f0dadffb700 1 -- 172.21.15.81:0/3938209368 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0013bf0 con 0x7f0db812d510 2023-10-25T23:36:22.387 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.379+0000 7f0dbf972700 1 -- 172.21.15.81:0/3938209368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db812d990 con 0x7f0db812d510 2023-10-25T23:36:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.380+0000 7f0dbf972700 1 -- 172.21.15.81:0/3938209368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db812c9d0 con 0x7f0db812d510 2023-10-25T23:36:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.380+0000 7f0dadffb700 1 -- 172.21.15.81:0/3938209368 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0db0013d50 con 0x7f0db812d510 2023-10-25T23:36:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.381+0000 7f0dadffb700 1 --2- 172.21.15.81:0/3938209368 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0d9c06aed0 0x7f0d9c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.381+0000 7f0dadffb700 1 -- 172.21.15.81:0/3938209368 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0db008c410 con 0x7f0db812d510 2023-10-25T23:36:22.388 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.381+0000 7f0dbd70e700 1 --2- 172.21.15.81:0/3938209368 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0d9c06aed0 0x7f0d9c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.381+0000 7f0dbd70e700 1 --2- 172.21.15.81:0/3938209368 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0d9c06aed0 0x7f0d9c06d390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009d40 tx=0x7f0da8009260 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:22.389 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.385+0000 7f0dadffb700 1 -- 172.21.15.81:0/3938209368 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0db0057550 con 0x7f0db812d510 2023-10-25T23:36:22.616 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.614+0000 7f0dbf972700 1 -- 172.21.15.81:0/3938209368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0db8147710 con 0x7f0db812d510 2023-10-25T23:36:22.617 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.615+0000 7f0dadffb700 1 -- 172.21.15.81:0/3938209368 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f0db0017090 con 0x7f0db812d510 2023-10-25T23:36:22.617 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:22.617 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2649006434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2649006434},{"type":"v1","addr":"172.21.15.89:6836","nonce":2649006434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1805624382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1805624382},{"type":"v1","addr":"172.21.15.89:6837","nonce":1805624382}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/1925858148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1925858148},{"type":"v1","addr":"172.21.15.81:6834","nonce":1925858148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T23:36:08.648444+0000","modified":"2023-10-25T23:36:11.695560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4350":{"gid":4350,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1640191478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1640191478},{"type":"v1","addr":"172.21.15.81:6835","nonce":1640191478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-25T23:36:22.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.617+0000 7f0dbf972700 1 -- 172.21.15.81:0/3938209368 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0d9c06aed0 msgr2=0x7f0d9c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:22.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.617+0000 7f0dbf972700 1 --2- 172.21.15.81:0/3938209368 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0d9c06aed0 0x7f0d9c06d390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009d40 tx=0x7f0da8009260 comp rx=0 tx=0).stop 2023-10-25T23:36:22.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.617+0000 7f0dbf972700 1 -- 172.21.15.81:0/3938209368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0db812d510 msgr2=0x7f0db814d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:22.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.617+0000 7f0dbf972700 1 --2- 172.21.15.81:0/3938209368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0db812d510 0x7f0db814d520 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0db806cc60 tx=0x7f0db0001e30 comp rx=0 tx=0).stop 2023-10-25T23:36:22.619 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.617+0000 7f0dbf972700 1 -- 172.21.15.81:0/3938209368 shutdown_connections 2023-10-25T23:36:22.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.617+0000 7f0dbf972700 1 --2- 172.21.15.81:0/3938209368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0db812d510 0x7f0db814d520 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.617+0000 7f0dbf972700 1 --2- 172.21.15.81:0/3938209368 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f0d9c06aed0 0x7f0d9c06d390 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.617+0000 7f0dbf972700 1 --2- 172.21.15.81:0/3938209368 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0da4003fb0 0x7f0db812c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.617+0000 7f0dbf972700 1 --2- 172.21.15.81:0/3938209368 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db8148300 0x7f0db81e4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.620 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.617+0000 7f0dbf972700 1 -- 172.21.15.81:0/3938209368 >> 172.21.15.81:0/3938209368 conn(0x7f0db80c0a40 msgr2=0x7f0db8149090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:22.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.617+0000 7f0dbf972700 1 -- 172.21.15.81:0/3938209368 shutdown_connections 2023-10-25T23:36:22.621 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.617+0000 7f0dbf972700 1 -- 172.21.15.81:0/3938209368 wait complete. 2023-10-25T23:36:22.621 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2023-10-25T23:36:22.630 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T23:36:22.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.750+0000 7fe1f1a4a700 1 -- 172.21.15.81:0/1756105761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec0b52d0 msgr2=0x7fe1ec0bc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:22.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.750+0000 7fe1f1a4a700 1 --2- 172.21.15.81:0/1756105761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec0b52d0 0x7fe1ec0bc410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009920 tx=0x7fe1dc009c30 comp rx=0 tx=0).stop 2023-10-25T23:36:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.750+0000 7fe1f1a4a700 1 -- 172.21.15.81:0/1756105761 shutdown_connections 2023-10-25T23:36:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.750+0000 7fe1f1a4a700 1 --2- 172.21.15.81:0/1756105761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec0b52d0 0x7fe1ec0bc410 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.750+0000 7fe1f1a4a700 1 -- 172.21.15.81:0/1756105761 >> 172.21.15.81:0/1756105761 conn(0x7fe1ec0c1bb0 msgr2=0x7fe1ec0c1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.750+0000 7fe1f1a4a700 1 -- 172.21.15.81:0/1756105761 shutdown_connections 2023-10-25T23:36:22.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.750+0000 7fe1f1a4a700 1 -- 172.21.15.81:0/1756105761 wait complete. 2023-10-25T23:36:22.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.751+0000 7fe1f1a4a700 1 Processor -- start 2023-10-25T23:36:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.751+0000 7fe1f1a4a700 1 -- start start 2023-10-25T23:36:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.752+0000 7fe1f1a4a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ec06e000 0x7fe1ec1440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.752+0000 7fe1f1a4a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ec070610 0x7fe1ec0a4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.752+0000 7fe1f1a4a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec0b52d0 0x7fe1ec1d59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:22.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.752+0000 7fe1f1a4a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec0a5950 con 0x7fe1ec06e000 2023-10-25T23:36:22.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.752+0000 7fe1f1a4a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec1d6e50 con 0x7fe1ec070610 2023-10-25T23:36:22.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.752+0000 7fe1f1a4a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ec0c27a0 con 0x7fe1ec0b52d0 2023-10-25T23:36:22.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.752+0000 7fe1eaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ec06e000 0x7fe1ec1440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:22.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.752+0000 7fe1eaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ec06e000 0x7fe1ec1440e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36860/0 (socket says 172.21.15.81:36860) 2023-10-25T23:36:22.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.752+0000 7fe1eaffd700 1 -- 172.21.15.81:0/2214325126 learned_addr learned my addr 172.21.15.81:0/2214325126 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:22.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.752+0000 7fe1eb7fe700 1 --2- 172.21.15.81:0/2214325126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec0b52d0 0x7fe1ec1d59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:22.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.752+0000 7fe1ea7fc700 1 --2- 172.21.15.81:0/2214325126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ec070610 0x7fe1ec0a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:22.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.752+0000 7fe1eaffd700 1 -- 172.21.15.81:0/2214325126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec0b52d0 msgr2=0x7fe1ec1d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:22.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.752+0000 7fe1eaffd700 1 --2- 172.21.15.81:0/2214325126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec0b52d0 0x7fe1ec1d59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.752+0000 7fe1eaffd700 1 -- 172.21.15.81:0/2214325126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ec070610 msgr2=0x7fe1ec0a4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:22.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.752+0000 7fe1eaffd700 1 --2- 172.21.15.81:0/2214325126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ec070610 0x7fe1ec0a4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.752+0000 7fe1eaffd700 1 -- 172.21.15.81:0/2214325126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1dc009520 con 0x7fe1ec06e000 2023-10-25T23:36:22.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.752+0000 7fe1eaffd700 1 --2- 172.21.15.81:0/2214325126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ec06e000 0x7fe1ec1440e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000c780 tx=0x7fe1e000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:22.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.752+0000 7fe1d3fff700 1 -- 172.21.15.81:0/2214325126 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00054e0 con 0x7fe1ec06e000 2023-10-25T23:36:22.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.753+0000 7fe1d3fff700 1 -- 172.21.15.81:0/2214325126 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe1e0003680 con 0x7fe1ec06e000 2023-10-25T23:36:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.753+0000 7fe1f1a4a700 1 -- 172.21.15.81:0/2214325126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ec144620 con 0x7fe1ec06e000 2023-10-25T23:36:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.753+0000 7fe1d3fff700 1 -- 172.21.15.81:0/2214325126 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0003a70 con 0x7fe1ec06e000 2023-10-25T23:36:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.753+0000 7fe1f1a4a700 1 -- 172.21.15.81:0/2214325126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ec0bc0f0 con 0x7fe1ec06e000 2023-10-25T23:36:22.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.753+0000 7fe1f1a4a700 1 -- 172.21.15.81:0/2214325126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ec04e4c0 con 0x7fe1ec06e000 2023-10-25T23:36:22.761 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.754+0000 7fe1d3fff700 1 -- 172.21.15.81:0/2214325126 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe1e0003bd0 con 0x7fe1ec06e000 2023-10-25T23:36:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.755+0000 7fe1d3fff700 1 --2- 172.21.15.81:0/2214325126 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe1d806aed0 0x7fe1d806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.755+0000 7fe1d3fff700 1 -- 172.21.15.81:0/2214325126 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1e0089300 con 0x7fe1ec06e000 2023-10-25T23:36:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.755+0000 7fe1ea7fc700 1 --2- 172.21.15.81:0/2214325126 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe1d806aed0 0x7fe1d806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.755+0000 7fe1ea7fc700 1 --2- 172.21.15.81:0/2214325126 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe1d806aed0 0x7fe1d806d390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0b56b0 tx=0x7fe1dc011040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:22.762 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.758+0000 7fe1d3fff700 1 -- 172.21.15.81:0/2214325126 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe1e0054460 con 0x7fe1ec06e000 2023-10-25T23:36:22.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.947+0000 7fe1f1a4a700 1 -- 172.21.15.81:0/2214325126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1ec067400 con 0x7fe1ec06e000 2023-10-25T23:36:22.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.948+0000 7fe1d3fff700 1 -- 172.21.15.81:0/2214325126 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fe1e0057a80 con 0x7fe1ec06e000 2023-10-25T23:36:22.951 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:22.951 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf","created":"2023-10-25T23:35:42.986840+0000","modified":"2023-10-25T23:36:10.277991+0000","last_up_change":"2023-10-25T23:35:55.052199+0000","last_in_change":"2023-10-25T23:35:46.443490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T23:35:57.031170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T23:36:06.841771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T23:36:07.613269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48415836-8f22-4dcd-baa3-1d09c90c9a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6809","nonce":1045657984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6811","nonce":1045657984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6815","nonce":1045657984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6813","nonce":1045657984}]},"public_addr":"172.21.15.81:6809/1045657984","cluster_addr":"172.21.15.81:6811/1045657984","heartbeat_back_addr":"172.21.15.81:6815/1045657984","heartbeat_front_addr":"172.21.15.81:6813/1045657984","state":["exists","up"]},{"osd":1,"uuid":"19a4f6b5-e75c-45ae-aa08-b3467e69eed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6801","nonce":725386907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6803","nonce":725386907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6807","nonce":725386907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6805","nonce":725386907}]},"public_addr":"172.21.15.81:6801/725386907","cluster_addr":"172.21.15.81:6803/725386907","heartbeat_back_addr":"172.21.15.81:6807/725386907","heartbeat_front_addr":"172.21.15.81:6805/725386907","state":["exists","up"]},{"osd":2,"uuid":"60645312-54f5-4a74-ae52-68d17ff2d6e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6825","nonce":1744054610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6827","nonce":1744054610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6831","nonce":1744054610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6829","nonce":1744054610}]},"public_addr":"172.21.15.81:6825/1744054610","cluster_addr":"172.21.15.81:6827/1744054610","heartbeat_back_addr":"172.21.15.81:6831/1744054610","heartbeat_front_addr":"172.21.15.81:6829/1744054610","state":["exists","up"]},{"osd":3,"uuid":"c636a4a2-c1e8-4306-a78b-fe37eebab526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6817","nonce":1391123341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6819","nonce":1391123341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6823","nonce":1391123341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6821","nonce":1391123341}]},"public_addr":"172.21.15.81:6817/1391123341","cluster_addr":"172.21.15.81:6819/1391123341","heartbeat_back_addr":"172.21.15.81:6823/1391123341","heartbeat_front_addr":"172.21.15.81:6821/1391123341","state":["exists","up"]},{"osd":4,"uuid":"3cafc826-e531-4aa7-8b2a-b592f318f138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6817","nonce":1232781703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6819","nonce":1232781703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6823","nonce":1232781703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6821","nonce":1232781703}]},"public_addr":"172.21.15.89:6817/1232781703","cluster_addr":"172.21.15.89:6819/1232781703","heartbeat_back_addr":"172.21.15.89:6823/1232781703","heartbeat_front_addr":"172.21.15.89:6821/1232781703","state":["exists","up"]},{"osd":5,"uuid":"6098deb2-258e-47e1-b283-9a24c9dddf27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6801","nonce":2255820086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6803","nonce":2255820086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6807","nonce":2255820086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6805","nonce":2255820086}]},"public_addr":"172.21.15.89:6801/2255820086","cluster_addr":"172.21.15.89:6803/2255820086","heartbeat_back_addr":"172.21.15.89:6807/2255820086","heartbeat_front_addr":"172.21.15.89:6805/2255820086","state":["exists","up"]},{"osd":6,"uuid":"d79f68de-3c19-4f68-bbd1-59c8484dfaa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6809","nonce":2561967165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6811","nonce":2561967165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6815","nonce":2561967165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6813","nonce":2561967165}]},"public_addr":"172.21.15.89:6809/2561967165","cluster_addr":"172.21.15.89:6811/2561967165","heartbeat_back_addr":"172.21.15.89:6815/2561967165","heartbeat_front_addr":"172.21.15.89:6813/2561967165","state":["exists","up"]},{"osd":7,"uuid":"f1f7002e-4de9-4a08-97a1-fb52a116687f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6825","nonce":2647243500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6827","nonce":2647243500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6831","nonce":2647243500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6829","nonce":2647243500}]},"public_addr":"172.21.15.89:6825/2647243500","cluster_addr":"172.21.15.89:6827/2647243500","heartbeat_back_addr":"172.21.15.89:6831/2647243500","heartbeat_front_addr":"172.21.15.89:6829/2647243500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.613750+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.593515+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.713198+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.725623+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.686409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.596728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.670930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.676762+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T23:36:22.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.950+0000 7fe1f1a4a700 1 -- 172.21.15.81:0/2214325126 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe1d806aed0 msgr2=0x7fe1d806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.950+0000 7fe1f1a4a700 1 --2- 172.21.15.81:0/2214325126 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe1d806aed0 0x7fe1d806d390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec0b56b0 tx=0x7fe1dc011040 comp rx=0 tx=0).stop 2023-10-25T23:36:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.950+0000 7fe1f1a4a700 1 -- 172.21.15.81:0/2214325126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ec06e000 msgr2=0x7fe1ec1440e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.950+0000 7fe1f1a4a700 1 --2- 172.21.15.81:0/2214325126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ec06e000 0x7fe1ec1440e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000c780 tx=0x7fe1e000ca90 comp rx=0 tx=0).stop 2023-10-25T23:36:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.951+0000 7fe1f1a4a700 1 -- 172.21.15.81:0/2214325126 shutdown_connections 2023-10-25T23:36:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.951+0000 7fe1f1a4a700 1 --2- 172.21.15.81:0/2214325126 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe1ec0b52d0 0x7fe1ec1d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.951+0000 7fe1f1a4a700 1 --2- 172.21.15.81:0/2214325126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1ec06e000 0x7fe1ec1440e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.951+0000 7fe1f1a4a700 1 --2- 172.21.15.81:0/2214325126 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe1d806aed0 0x7fe1d806d390 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.951+0000 7fe1f1a4a700 1 --2- 172.21.15.81:0/2214325126 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1ec070610 0x7fe1ec0a4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.951+0000 7fe1f1a4a700 1 -- 172.21.15.81:0/2214325126 >> 172.21.15.81:0/2214325126 conn(0x7fe1ec0c1bb0 msgr2=0x7fe1ec144da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:22.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.951+0000 7fe1f1a4a700 1 -- 172.21.15.81:0/2214325126 shutdown_connections 2023-10-25T23:36:22.955 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:22.951+0000 7fe1f1a4a700 1 -- 172.21.15.81:0/2214325126 wait complete. 2023-10-25T23:36:22.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T23:36:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.085+0000 7f2f96833700 1 -- 172.21.15.81:0/4079049212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f900b52d0 msgr2=0x7f2f900bc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.085+0000 7f2f96833700 1 --2- 172.21.15.81:0/4079049212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f900b52d0 0x7f2f900bc410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2f840098f0 tx=0x7f2f84009c00 comp rx=0 tx=0).stop 2023-10-25T23:36:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.085+0000 7f2f96833700 1 -- 172.21.15.81:0/4079049212 shutdown_connections 2023-10-25T23:36:23.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.085+0000 7f2f96833700 1 --2- 172.21.15.81:0/4079049212 >> v2:172.21.15.89:3300/0 conn(0x7f2f90070610 0x7f2f9014d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.085+0000 7f2f96833700 1 --2- 172.21.15.81:0/4079049212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f900b52d0 0x7f2f900bc410 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.085+0000 7f2f96833700 1 -- 172.21.15.81:0/4079049212 >> 172.21.15.81:0/4079049212 conn(0x7f2f900c1bb0 msgr2=0x7f2f900c1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:23.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.085+0000 7f2f96833700 1 -- 172.21.15.81:0/4079049212 shutdown_connections 2023-10-25T23:36:23.088 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.085+0000 7f2f96833700 1 -- 172.21.15.81:0/4079049212 wait complete. 2023-10-25T23:36:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.086+0000 7f2f96833700 1 Processor -- start 2023-10-25T23:36:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.086+0000 7f2f96833700 1 -- start start 2023-10-25T23:36:23.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f96833700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f9006e000 0x7f2f9014b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f96833700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f90070610 0x7f2f90147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f96833700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f900b52d0 0x7f2f901484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f96833700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90146af0 con 0x7f2f9006e000 2023-10-25T23:36:23.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f96833700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f900a3090 con 0x7f2f90070610 2023-10-25T23:36:23.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f96833700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f901e3360 con 0x7f2f900b52d0 2023-10-25T23:36:23.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f8ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f9006e000 0x7f2f9014b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f8ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f9006e000 0x7f2f9014b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36874/0 (socket says 172.21.15.81:36874) 2023-10-25T23:36:23.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f8ffff700 1 -- 172.21.15.81:0/2228688209 learned_addr learned my addr 172.21.15.81:0/2228688209 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:23.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f8f7fe700 1 --2- 172.21.15.81:0/2228688209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f90070610 0x7f2f90147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f94dd0700 1 --2- 172.21.15.81:0/2228688209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f900b52d0 0x7f2f901484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f8ffff700 1 -- 172.21.15.81:0/2228688209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f900b52d0 msgr2=0x7f2f901484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:23.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f8ffff700 1 --2- 172.21.15.81:0/2228688209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f900b52d0 0x7f2f901484e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f8ffff700 1 -- 172.21.15.81:0/2228688209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f90070610 msgr2=0x7f2f90147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:23.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f8ffff700 1 --2- 172.21.15.81:0/2228688209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f90070610 0x7f2f90147fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f8ffff700 1 -- 172.21.15.81:0/2228688209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f84009520 con 0x7f2f9006e000 2023-10-25T23:36:23.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f8ffff700 1 --2- 172.21.15.81:0/2228688209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f9006e000 0x7f2f9014b200 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000c500 tx=0x7f2f8000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:23.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f8cff9700 1 -- 172.21.15.81:0/2228688209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80011790 con 0x7f2f9006e000 2023-10-25T23:36:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f8cff9700 1 -- 172.21.15.81:0/2228688209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2f800119e0 con 0x7f2f9006e000 2023-10-25T23:36:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f8cff9700 1 -- 172.21.15.81:0/2228688209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80011dd0 con 0x7f2f9006e000 2023-10-25T23:36:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f96833700 1 -- 172.21.15.81:0/2228688209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f900a2e60 con 0x7f2f9006e000 2023-10-25T23:36:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.087+0000 7f2f96833700 1 -- 172.21.15.81:0/2228688209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f901e2ff0 con 0x7f2f9006e000 2023-10-25T23:36:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.088+0000 7f2f96833700 1 -- 172.21.15.81:0/2228688209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9004e4c0 con 0x7f2f9006e000 2023-10-25T23:36:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.089+0000 7f2f8cff9700 1 -- 172.21.15.81:0/2228688209 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2f8001c460 con 0x7f2f9006e000 2023-10-25T23:36:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.089+0000 7f2f8cff9700 1 --2- 172.21.15.81:0/2228688209 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f2f7c06aed0 0x7f2f7c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.089+0000 7f2f8cff9700 1 -- 172.21.15.81:0/2228688209 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f800895f0 con 0x7f2f9006e000 2023-10-25T23:36:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.089+0000 7f2f8f7fe700 1 --2- 172.21.15.81:0/2228688209 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f2f7c06aed0 0x7f2f7c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.090+0000 7f2f8f7fe700 1 --2- 172.21.15.81:0/2228688209 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f2f7c06aed0 0x7f2f7c06d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2f900b56b0 tx=0x7f2f84019040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:23.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.094+0000 7f2f8cff9700 1 -- 172.21.15.81:0/2228688209 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2f80054730 con 0x7f2f9006e000 2023-10-25T23:36:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.325+0000 7f2f96833700 1 -- 172.21.15.81:0/2228688209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f90067400 con 0x7f2f9006e000 2023-10-25T23:36:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.325+0000 7f2f8cff9700 1 -- 172.21.15.81:0/2228688209 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f2f80057d50 con 0x7f2f9006e000 2023-10-25T23:36:23.328 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:36:23.328 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2649006434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2649006434},{"type":"v1","addr":"172.21.15.89:6836","nonce":2649006434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1805624382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1805624382},{"type":"v1","addr":"172.21.15.89:6837","nonce":1805624382}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/1925858148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1925858148},{"type":"v1","addr":"172.21.15.81:6834","nonce":1925858148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T23:36:08.648444+0000","modified":"2023-10-25T23:36:11.695560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4350":{"gid":4350,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1640191478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1640191478},{"type":"v1","addr":"172.21.15.81:6835","nonce":1640191478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-25T23:36:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.328+0000 7f2f96833700 1 -- 172.21.15.81:0/2228688209 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f2f7c06aed0 msgr2=0x7f2f7c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.328+0000 7f2f96833700 1 --2- 172.21.15.81:0/2228688209 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f2f7c06aed0 0x7f2f7c06d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2f900b56b0 tx=0x7f2f84019040 comp rx=0 tx=0).stop 2023-10-25T23:36:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.328+0000 7f2f96833700 1 -- 172.21.15.81:0/2228688209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f9006e000 msgr2=0x7f2f9014b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.328+0000 7f2f96833700 1 --2- 172.21.15.81:0/2228688209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f9006e000 0x7f2f9014b200 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000c500 tx=0x7f2f8000c8c0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.328+0000 7f2f96833700 1 -- 172.21.15.81:0/2228688209 shutdown_connections 2023-10-25T23:36:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.328+0000 7f2f96833700 1 --2- 172.21.15.81:0/2228688209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f900b52d0 0x7f2f901484e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.328+0000 7f2f96833700 1 --2- 172.21.15.81:0/2228688209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f9006e000 0x7f2f9014b200 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.328+0000 7f2f96833700 1 --2- 172.21.15.81:0/2228688209 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f2f7c06aed0 0x7f2f7c06d390 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.328+0000 7f2f96833700 1 --2- 172.21.15.81:0/2228688209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f90070610 0x7f2f90147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.328+0000 7f2f96833700 1 -- 172.21.15.81:0/2228688209 >> 172.21.15.81:0/2228688209 conn(0x7f2f900c1bb0 msgr2=0x7f2f900c1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:23.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.328+0000 7f2f96833700 1 -- 172.21.15.81:0/2228688209 shutdown_connections 2023-10-25T23:36:23.332 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.328+0000 7f2f96833700 1 -- 172.21.15.81:0/2228688209 wait complete. 2023-10-25T23:36:23.332 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2023-10-25T23:36:23.744 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-25T23:36:08.648444+0000', 'modified': '2023-10-25T23:36:11.695560+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4350}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4350': {'gid': 4350, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6835/1640191478', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6833', 'nonce': 1640191478}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 1640191478}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-25T23:36:23.744 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-25T23:36:23.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-25T23:36:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.870+0000 7fe5d81e4700 1 -- 172.21.15.81:0/2649597084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5bc004850 msgr2=0x7fe5bc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.870+0000 7fe5d81e4700 1 --2- 172.21.15.81:0/2649597084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5bc004850 0x7fe5bc004cd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00c2e0 tx=0x7fe5bc005880 comp rx=0 tx=0).stop 2023-10-25T23:36:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.870+0000 7fe5d6781700 1 -- 172.21.15.81:0/2649597084 reap_dead start 2023-10-25T23:36:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.870+0000 7fe5d81e4700 1 -- 172.21.15.81:0/2649597084 shutdown_connections 2023-10-25T23:36:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.870+0000 7fe5d81e4700 1 -- 172.21.15.81:0/2649597084 >> 172.21.15.81:0/2649597084 conn(0x7fe5d006b320 msgr2=0x7fe5d006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.870+0000 7fe5d81e4700 1 -- 172.21.15.81:0/2649597084 shutdown_connections 2023-10-25T23:36:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.870+0000 7fe5d81e4700 1 -- 172.21.15.81:0/2649597084 wait complete. 2023-10-25T23:36:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.871+0000 7fe5d81e4700 1 Processor -- start 2023-10-25T23:36:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.871+0000 7fe5d81e4700 1 -- start start 2023-10-25T23:36:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.872+0000 7fe5d81e4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5bc004850 0x7fe5d0153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.872+0000 7fe5d81e4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5d00bb010 0x7fe5d014c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.872+0000 7fe5d81e4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5d01e2e60 0x7fe5d014ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.872+0000 7fe5d81e4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0144150 con 0x7fe5bc004850 2023-10-25T23:36:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.872+0000 7fe5d81e4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0154530 con 0x7fe5d00bb010 2023-10-25T23:36:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.872+0000 7fe5d81e4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d01e3350 con 0x7fe5d01e2e60 2023-10-25T23:36:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.872+0000 7fe5d5f80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5bc004850 0x7fe5d0153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.872+0000 7fe5d5f80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5bc004850 0x7fe5d0153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36894/0 (socket says 172.21.15.81:36894) 2023-10-25T23:36:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.872+0000 7fe5d5f80700 1 -- 172.21.15.81:0/115112136 learned_addr learned my addr 172.21.15.81:0/115112136 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.872+0000 7fe5d577f700 1 --2- 172.21.15.81:0/115112136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5d00bb010 0x7fe5d014c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.872+0000 7fe5d6781700 1 --2- 172.21.15.81:0/115112136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5d01e2e60 0x7fe5d014ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.872+0000 7fe5d5f80700 1 -- 172.21.15.81:0/115112136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5d01e2e60 msgr2=0x7fe5d014ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.872+0000 7fe5d5f80700 1 --2- 172.21.15.81:0/115112136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5d01e2e60 0x7fe5d014ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.872+0000 7fe5d5f80700 1 -- 172.21.15.81:0/115112136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5d00bb010 msgr2=0x7fe5d014c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.872+0000 7fe5d5f80700 1 --2- 172.21.15.81:0/115112136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5d00bb010 0x7fe5d014c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.872+0000 7fe5d5f80700 1 -- 172.21.15.81:0/115112136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d0144390 con 0x7fe5bc004850 2023-10-25T23:36:23.880 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.872+0000 7fe5d5f80700 1 --2- 172.21.15.81:0/115112136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5bc004850 0x7fe5d0153ff0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0003fa0 tx=0x7fe5c0001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.873+0000 7fe5c67fc700 1 -- 172.21.15.81:0/115112136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c00061b0 con 0x7fe5bc004850 2023-10-25T23:36:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.873+0000 7fe5c67fc700 1 -- 172.21.15.81:0/115112136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe5c0011430 con 0x7fe5bc004850 2023-10-25T23:36:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.873+0000 7fe5d81e4700 1 -- 172.21.15.81:0/115112136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d0144670 con 0x7fe5bc004850 2023-10-25T23:36:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.873+0000 7fe5c67fc700 1 -- 172.21.15.81:0/115112136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0011820 con 0x7fe5bc004850 2023-10-25T23:36:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.873+0000 7fe5d81e4700 1 -- 172.21.15.81:0/115112136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d00bfcb0 con 0x7fe5bc004850 2023-10-25T23:36:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.874+0000 7fe5c67fc700 1 -- 172.21.15.81:0/115112136 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe5c0011980 con 0x7fe5bc004850 2023-10-25T23:36:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.874+0000 7fe5c67fc700 1 --2- 172.21.15.81:0/115112136 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe5b406aed0 0x7fe5b406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.875+0000 7fe5c67fc700 1 -- 172.21.15.81:0/115112136 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5c008a2a0 con 0x7fe5bc004850 2023-10-25T23:36:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.875+0000 7fe5d577f700 1 --2- 172.21.15.81:0/115112136 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe5b406aed0 0x7fe5b406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.875+0000 7fe5d577f700 1 --2- 172.21.15.81:0/115112136 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe5b406aed0 0x7fe5b406d390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc007010 tx=0x7fe5cc00f000 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.877+0000 7fe5e43cdb80 1 Processor -- start 2023-10-25T23:36:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.877+0000 7fe5e43cdb80 1 -- start start 2023-10-25T23:36:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.877+0000 7fe5e43cdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1ce31960 0x555a1ce31d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.877+0000 7fe5e43cdb80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1cdefb80 0x555a1cdf0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.877+0000 7fe5e43cdb80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1cdf1520 0x555a1ce28ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.877+0000 7fe5e43cdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a1cd64690 con 0x555a1ce31960 2023-10-25T23:36:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.877+0000 7fe5e43cdb80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a1cd4ac10 con 0x555a1cdf1520 2023-10-25T23:36:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.877+0000 7fe5e43cdb80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a1cd48530 con 0x555a1cdefb80 2023-10-25T23:36:23.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.877+0000 7fe5d5f80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1ce31960 0x555a1ce31d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.877+0000 7fe5d5f80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1ce31960 0x555a1ce31d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36902/0 (socket says 172.21.15.81:36902) 2023-10-25T23:36:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.877+0000 7fe5d5f80700 1 -- 172.21.15.81:0/4279404341 learned_addr learned my addr 172.21.15.81:0/4279404341 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.878+0000 7fe5d6781700 1 --2- 172.21.15.81:0/4279404341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1cdf1520 0x555a1ce28ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.878+0000 7fe5d577f700 1 --2- 172.21.15.81:0/4279404341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1cdefb80 0x555a1cdf0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.878+0000 7fe5d5f80700 1 -- 172.21.15.81:0/4279404341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1cdefb80 msgr2=0x555a1cdf0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T23:36:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.878+0000 7fe5d5f80700 1 --2- 172.21.15.81:0/4279404341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1cdefb80 0x555a1cdf0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.878+0000 7fe5d5f80700 1 -- 172.21.15.81:0/4279404341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1cdf1520 msgr2=0x555a1ce28ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T23:36:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.878+0000 7fe5d5f80700 1 --2- 172.21.15.81:0/4279404341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1cdf1520 0x555a1ce28ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.878+0000 7fe5d5f80700 1 -- 172.21.15.81:0/4279404341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a1cd013a0 con 0x555a1ce31960 2023-10-25T23:36:23.893 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.878+0000 7fe5d6781700 1 --2- 172.21.15.81:0/4279404341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1cdf1520 0x555a1ce28ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:36:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.878+0000 7fe5d5f80700 1 --2- 172.21.15.81:0/4279404341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1ce31960 0x555a1ce31d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0055500 tx=0x7fe5c0058c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed0aedd51cf9e71 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.878+0000 7fe5b37fe700 1 -- 172.21.15.81:0/4279404341 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0070030 con 0x555a1ce31960 2023-10-25T23:36:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.878+0000 7fe5b37fe700 1 -- 172.21.15.81:0/4279404341 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe5c005de90 con 0x555a1ce31960 2023-10-25T23:36:23.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.878+0000 7fe5b37fe700 1 -- 172.21.15.81:0/4279404341 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c008a0d0 con 0x555a1ce31960 2023-10-25T23:36:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.879+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/4279404341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1ce31960 msgr2=0x555a1ce31d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.879+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/4279404341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1ce31960 0x555a1ce31d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0055500 tx=0x7fe5c0058c70 comp rx=0 tx=0).stop 2023-10-25T23:36:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.879+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/4279404341 shutdown_connections 2023-10-25T23:36:23.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.879+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/4279404341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1cdf1520 0x555a1ce28ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.879+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/4279404341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1ce31960 0x555a1ce31d40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.879+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/4279404341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1cdefb80 0x555a1cdf0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.879+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/4279404341 >> 172.21.15.81:0/4279404341 conn(0x555a1cd656d0 msgr2=0x555a1cdef320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.879+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/4279404341 shutdown_connections 2023-10-25T23:36:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.879+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/4279404341 wait complete. 2023-10-25T23:36:23.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.879+0000 7fe5e43cdb80 1 -- start start 2023-10-25T23:36:23.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.879+0000 7fe5e43cdb80 1 Processor -- start 2023-10-25T23:36:23.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.880+0000 7fe5e43cdb80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1cdefb80 0x555a1ce2c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5e43cdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdf1520 0x555a1ce2aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5e43cdb80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1ce31960 0x555a1ce3c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5e43cdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a1cd43e20 con 0x555a1cdf1520 2023-10-25T23:36:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5e43cdb80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a1cce06c0 con 0x555a1cdefb80 2023-10-25T23:36:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5e43cdb80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a1cce0360 con 0x555a1ce31960 2023-10-25T23:36:23.899 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5e43cdb80 10 client.0 _ll_register_callbacks cb 0x555a1cc2aa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T23:36:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5d577f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdf1520 0x555a1ce2aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5d577f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdf1520 0x555a1ce2aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36910/0 (socket says 172.21.15.81:36910) 2023-10-25T23:36:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5d577f700 1 -- 172.21.15.81:0/4294835812 learned_addr learned my addr 172.21.15.81:0/4294835812 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:23.900 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5d5f80700 1 --2- 172.21.15.81:0/4294835812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1cdefb80 0x555a1ce2c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5d6781700 1 --2- 172.21.15.81:0/4294835812 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1ce31960 0x555a1ce3c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5d577f700 1 -- 172.21.15.81:0/4294835812 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1ce31960 msgr2=0x555a1ce3c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T23:36:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5d577f700 1 --2- 172.21.15.81:0/4294835812 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1ce31960 0x555a1ce3c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5d577f700 1 -- 172.21.15.81:0/4294835812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1cdefb80 msgr2=0x555a1ce2c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T23:36:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5d577f700 1 --2- 172.21.15.81:0/4294835812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1cdefb80 0x555a1ce2c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5d577f700 1 -- 172.21.15.81:0/4294835812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d00bfcb0 con 0x555a1cdf1520 2023-10-25T23:36:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5d5f80700 1 --2- 172.21.15.81:0/4294835812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1cdefb80 0x555a1ce2c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:36:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5d577f700 1 --2- 172.21.15.81:0/4294835812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdf1520 0x555a1ce2aed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00c130 tx=0x7fe5cc0067b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f7b37e187616ee server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5b0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-25T23:36:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5b0ff9700 1 -- 172.21.15.81:0/4294835812 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc02e070 con 0x555a1cdf1520 2023-10-25T23:36:23.902 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/4294835812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a1cde4280 con 0x555a1cdf1520 2023-10-25T23:36:23.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5b0ff9700 1 -- 172.21.15.81:0/4294835812 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5cc003680 con 0x555a1cdf1520 2023-10-25T23:36:23.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5b0ff9700 1 -- 172.21.15.81:0/4294835812 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5cc021070 con 0x555a1cdf1520 2023-10-25T23:36:23.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5e43cdb80 10 client.4734 fetch_fsmap learned FSMap version 8 2023-10-25T23:36:23.903 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/4294835812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x555a1cb6ed90 con 0x555a1cdf1520 2023-10-25T23:36:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.881+0000 7fe5b0ff9700 1 -- 172.21.15.81:0/4294835812 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x555a1cde4280 con 0x555a1cdf1520 2023-10-25T23:36:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.882+0000 7fe5b0ff9700 1 -- 172.21.15.81:0/4294835812 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe5cc003860 con 0x555a1cdf1520 2023-10-25T23:36:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.882+0000 7fe5e43cdb80 10 client.4734 fetch_fsmap finished waiting for FSMap version 8 2023-10-25T23:36:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.882+0000 7fe5e43cdb80 10 client.4734 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-25T23:36:23.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.882+0000 7fe5e43cdb80 20 client.4734 populate_metadata read hostname 'smithi081' 2023-10-25T23:36:23.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.882+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/4294835812 >> [v2:172.21.15.81:6833/1640191478,v1:172.21.15.81:6835/1640191478] conn(0x555a1ce08df0 0x555a1ce091d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.882+0000 7fe5e43cdb80 4 client.4734 mds_command: new command op to 4350 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-25T23:36:23.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.882+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/4294835812 --> [v2:172.21.15.81:6833/1640191478,v1:172.21.15.81:6835/1640191478] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555a1cdc0830 con 0x555a1ce08df0 2023-10-25T23:36:23.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.882+0000 7fe5d5f80700 1 --2- 172.21.15.81:0/4294835812 >> [v2:172.21.15.81:6833/1640191478,v1:172.21.15.81:6835/1640191478] conn(0x555a1ce08df0 0x555a1ce091d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.882+0000 7fe5b0ff9700 10 client.4734 ms_handle_connect on v2:172.21.15.81:6833/1640191478 2023-10-25T23:36:23.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.882+0000 7fe5d5f80700 1 --2- 172.21.15.81:0/4294835812 >> [v2:172.21.15.81:6833/1640191478,v1:172.21.15.81:6835/1640191478] conn(0x555a1ce08df0 0x555a1ce091d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a3e4303324bef26 server_cookie=847580246a8bc9d1 in_seq=0 out_seq=0 2023-10-25T23:36:23.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.883+0000 7fe5b0ff9700 1 -- 172.21.15.81:0/4294835812 <== mds.0 v2:172.21.15.81:6833/1640191478 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555a1cdc0830 con 0x555a1ce08df0 2023-10-25T23:36:23.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.883+0000 7fe5b0ff9700 10 client.4734 handle_command_reply: tid=0 2023-10-25T23:36:23.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.883+0000 7fe5e43cdb80 1 client.4734 shutdown 2023-10-25T23:36:23.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.883+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/4294835812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdf1520 msgr2=0x555a1ce2aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:23.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.883+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/4294835812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdf1520 0x555a1ce2aed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc00c130 tx=0x7fe5cc0067b0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.883+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/4294835812 shutdown_connections 2023-10-25T23:36:23.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.883+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/4294835812 >> [v2:172.21.15.81:6833/1640191478,v1:172.21.15.81:6835/1640191478] conn(0x555a1ce08df0 0x555a1ce091d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.883+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/4294835812 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1ce31960 0x555a1ce3c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.883+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/4294835812 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1cdefb80 0x555a1ce2c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.883+0000 7fe5b0ff9700 0 client.4734 ms_handle_reset on v2:172.21.15.81:6833/1640191478 2023-10-25T23:36:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.883+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/4294835812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdf1520 0x555a1ce2aed0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.883+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/4294835812 >> 172.21.15.81:0/4294835812 conn(0x555a1cd656d0 msgr2=0x555a1cdeb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.883+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/4294835812 shutdown_connections 2023-10-25T23:36:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.883+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/4294835812 wait complete. 2023-10-25T23:36:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.883+0000 7fe5e43cdb80 20 client.4734 trim_cache size 0 max 16384 2023-10-25T23:36:23.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.901+0000 7fe5e43cdb80 1 Processor -- start 2023-10-25T23:36:23.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.901+0000 7fe5e43cdb80 1 -- start start 2023-10-25T23:36:23.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.901+0000 7fe5e43cdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdefb80 0x555a1ce2ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.901+0000 7fe5e43cdb80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1cdf1520 0x555a1ce09590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.901+0000 7fe5e43cdb80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1ce31960 0x555a1cdf0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.901+0000 7fe5e43cdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a1cbc48d0 con 0x555a1cdefb80 2023-10-25T23:36:23.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.901+0000 7fe5e43cdb80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a1ce226c0 con 0x555a1cdf1520 2023-10-25T23:36:23.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.901+0000 7fe5e43cdb80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a1cde4280 con 0x555a1ce31960 2023-10-25T23:36:23.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.902+0000 7fe5d5f80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdefb80 0x555a1ce2ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.902+0000 7fe5d5f80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdefb80 0x555a1ce2ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36916/0 (socket says 172.21.15.81:36916) 2023-10-25T23:36:23.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.902+0000 7fe5d5f80700 1 -- 172.21.15.81:0/3127132570 learned_addr learned my addr 172.21.15.81:0/3127132570 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:23.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.902+0000 7fe5d6781700 1 --2- 172.21.15.81:0/3127132570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1ce31960 0x555a1cdf0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.902+0000 7fe5d577f700 1 --2- 172.21.15.81:0/3127132570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1cdf1520 0x555a1ce09590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.902+0000 7fe5d5f80700 1 -- 172.21.15.81:0/3127132570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1ce31960 msgr2=0x555a1cdf0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T23:36:23.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.902+0000 7fe5d5f80700 1 --2- 172.21.15.81:0/3127132570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1ce31960 0x555a1cdf0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.902+0000 7fe5d5f80700 1 -- 172.21.15.81:0/3127132570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1cdf1520 msgr2=0x555a1ce09590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T23:36:23.920 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.902+0000 7fe5d5f80700 1 --2- 172.21.15.81:0/3127132570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1cdf1520 0x555a1ce09590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.902+0000 7fe5d5f80700 1 -- 172.21.15.81:0/3127132570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a1cb57c10 con 0x555a1cdefb80 2023-10-25T23:36:23.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.902+0000 7fe5d5f80700 1 --2- 172.21.15.81:0/3127132570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdefb80 0x555a1ce2ba70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0055500 tx=0x7fe5c0055470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9fa334e2a9a948 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:23.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.902+0000 7fe5b3fff700 1 -- 172.21.15.81:0/3127132570 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0070040 con 0x555a1cdefb80 2023-10-25T23:36:23.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.902+0000 7fe5b3fff700 1 -- 172.21.15.81:0/3127132570 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe5c005d150 con 0x555a1cdefb80 2023-10-25T23:36:23.921 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.902+0000 7fe5b3fff700 1 -- 172.21.15.81:0/3127132570 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0061300 con 0x555a1cdefb80 2023-10-25T23:36:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.903+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/3127132570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdefb80 msgr2=0x555a1ce2ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.903+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/3127132570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdefb80 0x555a1ce2ba70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0055500 tx=0x7fe5c0055470 comp rx=0 tx=0).stop 2023-10-25T23:36:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.903+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/3127132570 shutdown_connections 2023-10-25T23:36:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.903+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/3127132570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1ce31960 0x555a1cdf0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.903+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/3127132570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdefb80 0x555a1ce2ba70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.903+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/3127132570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1cdf1520 0x555a1ce09590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.903+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/3127132570 >> 172.21.15.81:0/3127132570 conn(0x555a1cd656d0 msgr2=0x555a1ce42de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.903+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/3127132570 shutdown_connections 2023-10-25T23:36:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.903+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/3127132570 wait complete. 2023-10-25T23:36:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.903+0000 7fe5e43cdb80 1 -- start start 2023-10-25T23:36:23.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.903+0000 7fe5e43cdb80 1 Processor -- start 2023-10-25T23:36:23.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.904+0000 7fe5e43cdb80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1cdefb80 0x555a1ce0e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.924 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.904+0000 7fe5e43cdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdf1520 0x555a1ce293a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.904+0000 7fe5e43cdb80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1ce31960 0x555a1ce94300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.904+0000 7fe5e43cdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a1ce91600 con 0x555a1cdf1520 2023-10-25T23:36:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.904+0000 7fe5e43cdb80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a1cdf0d50 con 0x555a1ce31960 2023-10-25T23:36:23.925 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.904+0000 7fe5e43cdb80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a1ce298e0 con 0x555a1cdefb80 2023-10-25T23:36:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.904+0000 7fe5e43cdb80 10 client.0 _ll_register_callbacks cb 0x7fe5cc006e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-25T23:36:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.904+0000 7fe5d577f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdf1520 0x555a1ce293a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.904+0000 7fe5d577f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdf1520 0x555a1ce293a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36924/0 (socket says 172.21.15.81:36924) 2023-10-25T23:36:23.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.904+0000 7fe5d577f700 1 -- 172.21.15.81:0/121525499 learned_addr learned my addr 172.21.15.81:0/121525499 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:23.927 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.904+0000 7fe5d6781700 1 --2- 172.21.15.81:0/121525499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1ce31960 0x555a1ce94300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.904+0000 7fe5d5f80700 1 --2- 172.21.15.81:0/121525499 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1cdefb80 0x555a1ce0e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.904+0000 7fe5d577f700 1 -- 172.21.15.81:0/121525499 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1cdefb80 msgr2=0x555a1ce0e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T23:36:23.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.904+0000 7fe5d577f700 1 --2- 172.21.15.81:0/121525499 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1cdefb80 0x555a1ce0e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.904+0000 7fe5d577f700 1 -- 172.21.15.81:0/121525499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1ce31960 msgr2=0x555a1ce94300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-25T23:36:23.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.904+0000 7fe5d577f700 1 --2- 172.21.15.81:0/121525499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1ce31960 0x555a1ce94300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.929 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.904+0000 7fe5d577f700 1 -- 172.21.15.81:0/121525499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c0086040 con 0x555a1cdf1520 2023-10-25T23:36:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5d577f700 1 --2- 172.21.15.81:0/121525499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdf1520 0x555a1ce293a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00d010 tx=0x7fe5cc003ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1271efb7a2ccca server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5b0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2023-10-25T23:36:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5b0ff9700 1 -- 172.21.15.81:0/121525499 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc021070 con 0x555a1cdf1520 2023-10-25T23:36:23.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5b0ff9700 1 -- 172.21.15.81:0/121525499 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5cc028ab0 con 0x555a1cdf1520 2023-10-25T23:36:23.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/121525499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe5c005de90 con 0x555a1cdf1520 2023-10-25T23:36:23.931 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5b0ff9700 1 -- 172.21.15.81:0/121525499 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5cc028c70 con 0x555a1cdf1520 2023-10-25T23:36:23.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5e43cdb80 10 client.4740 fetch_fsmap learned FSMap version 8 2023-10-25T23:36:23.932 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/121525499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x555a1cb95200 con 0x555a1cdf1520 2023-10-25T23:36:23.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5b0ff9700 1 -- 172.21.15.81:0/121525499 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe5c005de90 con 0x555a1cdf1520 2023-10-25T23:36:23.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5b0ff9700 1 -- 172.21.15.81:0/121525499 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe5cc010690 con 0x555a1cdf1520 2023-10-25T23:36:23.933 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5e43cdb80 10 client.4740 fetch_fsmap finished waiting for FSMap version 8 2023-10-25T23:36:23.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5e43cdb80 10 client.4740 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-25T23:36:23.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5e43cdb80 20 client.4740 populate_metadata read hostname 'smithi081' 2023-10-25T23:36:23.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/121525499 >> [v2:172.21.15.81:6833/1640191478,v1:172.21.15.81:6835/1640191478] conn(0x555a1ce1e340 0x555a1ce1e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:23.934 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5e43cdb80 4 client.4740 mds_command: new command op to 4350 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-25T23:36:23.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/121525499 --> [v2:172.21.15.81:6833/1640191478,v1:172.21.15.81:6835/1640191478] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555a1cd3ce00 con 0x555a1ce1e340 2023-10-25T23:36:23.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5d5f80700 1 --2- 172.21.15.81:0/121525499 >> [v2:172.21.15.81:6833/1640191478,v1:172.21.15.81:6835/1640191478] conn(0x555a1ce1e340 0x555a1ce1e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:23.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5b0ff9700 10 client.4740 ms_handle_connect on v2:172.21.15.81:6833/1640191478 2023-10-25T23:36:23.935 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.905+0000 7fe5d5f80700 1 --2- 172.21.15.81:0/121525499 >> [v2:172.21.15.81:6833/1640191478,v1:172.21.15.81:6835/1640191478] conn(0x555a1ce1e340 0x555a1ce1e720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0c86977a7e96591 server_cookie=e68af85bc145d85 in_seq=0 out_seq=0 2023-10-25T23:36:23.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.906+0000 7fe5b0ff9700 1 -- 172.21.15.81:0/121525499 <== mds.0 v2:172.21.15.81:6833/1640191478 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x555a1cd3ce00 con 0x555a1ce1e340 2023-10-25T23:36:23.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.906+0000 7fe5b0ff9700 10 client.4740 handle_command_reply: tid=0 2023-10-25T23:36:23.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.906+0000 7fe5e43cdb80 1 client.4740 shutdown 2023-10-25T23:36:23.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.906+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/121525499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdf1520 msgr2=0x555a1ce293a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.906+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/121525499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdf1520 0x555a1ce293a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00d010 tx=0x7fe5cc003ac0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.906+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/121525499 shutdown_connections 2023-10-25T23:36:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.906+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/121525499 >> [v2:172.21.15.81:6833/1640191478,v1:172.21.15.81:6835/1640191478] conn(0x555a1ce1e340 0x555a1ce1e720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.906+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/121525499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555a1ce31960 0x555a1ce94300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.906+0000 7fe5b0ff9700 0 client.4740 ms_handle_reset on v2:172.21.15.81:6833/1640191478 2023-10-25T23:36:23.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.906+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/121525499 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555a1cdefb80 0x555a1ce0e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.906+0000 7fe5e43cdb80 1 --2- 172.21.15.81:0/121525499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a1cdf1520 0x555a1ce293a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.906+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/121525499 >> 172.21.15.81:0/121525499 conn(0x555a1cd656d0 msgr2=0x555a1ce09570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:23.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.906+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/121525499 shutdown_connections 2023-10-25T23:36:23.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.906+0000 7fe5e43cdb80 1 -- 172.21.15.81:0/121525499 wait complete. 2023-10-25T23:36:23.939 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.906+0000 7fe5e43cdb80 20 client.4740 trim_cache size 0 max 16384 2023-10-25T23:36:23.939 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-25T23:36:23.939 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf", 2023-10-25T23:36:23.940 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2023-10-25T23:36:23.940 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4350, 2023-10-25T23:36:23.940 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2023-10-25T23:36:23.940 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2023-10-25T23:36:23.941 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2023-10-25T23:36:23.941 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 14.628238244, 2023-10-25T23:36:23.941 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 8, 2023-10-25T23:36:23.941 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 21, 2023-10-25T23:36:23.941 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 21, 2023-10-25T23:36:23.941 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 21.805342435 2023-10-25T23:36:23.942 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-25T23:36:23.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.907+0000 7fe5d81e4700 1 -- 172.21.15.81:0/115112136 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe5b406aed0 msgr2=0x7fe5b406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:23.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.907+0000 7fe5d81e4700 1 --2- 172.21.15.81:0/115112136 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe5b406aed0 0x7fe5b406d390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc007010 tx=0x7fe5cc00f000 comp rx=0 tx=0).stop 2023-10-25T23:36:23.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.907+0000 7fe5d81e4700 1 -- 172.21.15.81:0/115112136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5bc004850 msgr2=0x7fe5d0153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:23.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.907+0000 7fe5d81e4700 1 --2- 172.21.15.81:0/115112136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5bc004850 0x7fe5d0153ff0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0003fa0 tx=0x7fe5c0001540 comp rx=0 tx=0).stop 2023-10-25T23:36:23.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.907+0000 7fe5d81e4700 1 -- 172.21.15.81:0/115112136 shutdown_connections 2023-10-25T23:36:23.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.907+0000 7fe5d81e4700 1 --2- 172.21.15.81:0/115112136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5d01e2e60 0x7fe5d014ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.907+0000 7fe5d81e4700 1 --2- 172.21.15.81:0/115112136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5bc004850 0x7fe5d0153ff0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.907+0000 7fe5d81e4700 1 --2- 172.21.15.81:0/115112136 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe5b406aed0 0x7fe5b406d390 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.907+0000 7fe5d81e4700 1 --2- 172.21.15.81:0/115112136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5d00bb010 0x7fe5d014c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:23.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.907+0000 7fe5d81e4700 1 -- 172.21.15.81:0/115112136 >> 172.21.15.81:0/115112136 conn(0x7fe5d006b320 msgr2=0x7fe5d00bd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:23.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.907+0000 7fe5d81e4700 1 -- 172.21.15.81:0/115112136 shutdown_connections 2023-10-25T23:36:23.945 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:23.907+0000 7fe5d81e4700 1 -- 172.21.15.81:0/115112136 wait complete. 2023-10-25T23:36:23.946 INFO:teuthology.run_tasks:Running task kclient... 2023-10-25T23:36:23.972 INFO:tasks.kclient:Mounting kernel clients... 2023-10-25T23:36:23.973 INFO:tasks.kclient:config is {'client.0': {}} 2023-10-25T23:36:23.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:36:23.974 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-25T23:36:23.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:36:23.993 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-10-25T23:36:24.060 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2023-10-25T23:36:24.061 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T23:36:24.061 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-10-25T23:36:24.062 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-25T23:36:24.062 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-25T23:36:24.063 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-25T23:36:24.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.221+0000 7f4ea63ce700 1 -- 172.21.15.81:0/770465810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ea006cd80 msgr2=0x7f4ea014b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:24.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.221+0000 7f4ea63ce700 1 --2- 172.21.15.81:0/770465810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ea006cd80 0x7f4ea014b760 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00b7b80 tx=0x7f4e9800b380 comp rx=0 tx=0).stop 2023-10-25T23:36:24.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.221+0000 7f4ea63ce700 1 -- 172.21.15.81:0/770465810 shutdown_connections 2023-10-25T23:36:24.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.221+0000 7f4ea63ce700 1 --2- 172.21.15.81:0/770465810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ea006cd80 0x7f4ea014b760 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:24.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.221+0000 7f4ea63ce700 1 --2- 172.21.15.81:0/770465810 >> v2:172.21.15.89:3300/0 conn(0x7f4ea014f330 0x7f4ea014b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:24.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.221+0000 7f4ea63ce700 1 -- 172.21.15.81:0/770465810 >> 172.21.15.81:0/770465810 conn(0x7f4ea00c0a40 msgr2=0x7f4ea00c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:24.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.221+0000 7f4ea63ce700 1 -- 172.21.15.81:0/770465810 shutdown_connections 2023-10-25T23:36:24.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.221+0000 7f4ea63ce700 1 -- 172.21.15.81:0/770465810 wait complete. 2023-10-25T23:36:24.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.222+0000 7f4ea63ce700 1 Processor -- start 2023-10-25T23:36:24.230 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.222+0000 7f4ea63ce700 1 -- start start 2023-10-25T23:36:24.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.223+0000 7f4ea63ce700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ea006cd80 0x7f4ea006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:24.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.223+0000 7f4ea63ce700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ea01454f0 0x7f4ea0132520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:24.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.223+0000 7f4ea63ce700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ea014f330 0x7f4ea0147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:24.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.223+0000 7f4ea63ce700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea01e6680 con 0x7f4ea006cd80 2023-10-25T23:36:24.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.223+0000 7f4ea63ce700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea01e3180 con 0x7f4ea01454f0 2023-10-25T23:36:24.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.223+0000 7f4ea63ce700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea01e61f0 con 0x7f4ea014f330 2023-10-25T23:36:24.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.223+0000 7f4e9ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ea006cd80 0x7f4ea006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:24.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.223+0000 7f4e9ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ea006cd80 0x7f4ea006a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36938/0 (socket says 172.21.15.81:36938) 2023-10-25T23:36:24.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.223+0000 7f4e9ffff700 1 -- 172.21.15.81:0/2349554578 learned_addr learned my addr 172.21.15.81:0/2349554578 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:36:24.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.223+0000 7f4e9f7fe700 1 --2- 172.21.15.81:0/2349554578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ea01454f0 0x7f4ea0132520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:24.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.223+0000 7f4ea496b700 1 --2- 172.21.15.81:0/2349554578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ea014f330 0x7f4ea0147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:24.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.223+0000 7f4e9ffff700 1 -- 172.21.15.81:0/2349554578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ea014f330 msgr2=0x7f4ea0147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:24.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.223+0000 7f4e9ffff700 1 --2- 172.21.15.81:0/2349554578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ea014f330 0x7f4ea0147e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:24.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.223+0000 7f4e9ffff700 1 -- 172.21.15.81:0/2349554578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ea01454f0 msgr2=0x7f4ea0132520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:24.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.223+0000 7f4e9ffff700 1 --2- 172.21.15.81:0/2349554578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ea01454f0 0x7f4ea0132520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:24.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.223+0000 7f4e9ffff700 1 -- 172.21.15.81:0/2349554578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e98009d00 con 0x7f4ea006cd80 2023-10-25T23:36:24.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.224+0000 7f4e9ffff700 1 --2- 172.21.15.81:0/2349554578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ea006cd80 0x7f4ea006a480 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4e9400c500 tx=0x7f4e9400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:24.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.224+0000 7f4e9cff9700 1 -- 172.21.15.81:0/2349554578 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e94011790 con 0x7f4ea006cd80 2023-10-25T23:36:24.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.224+0000 7f4e9cff9700 1 -- 172.21.15.81:0/2349554578 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4e940119e0 con 0x7f4ea006cd80 2023-10-25T23:36:24.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.224+0000 7f4e9cff9700 1 -- 172.21.15.81:0/2349554578 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e94011df0 con 0x7f4ea006cd80 2023-10-25T23:36:24.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.224+0000 7f4ea63ce700 1 -- 172.21.15.81:0/2349554578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea006ae40 con 0x7f4ea006cd80 2023-10-25T23:36:24.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.224+0000 7f4ea63ce700 1 -- 172.21.15.81:0/2349554578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea006a9c0 con 0x7f4ea006cd80 2023-10-25T23:36:24.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.225+0000 7f4ea63ce700 1 -- 172.21.15.81:0/2349554578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea01e64d0 con 0x7f4ea006cd80 2023-10-25T23:36:24.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.225+0000 7f4e9cff9700 1 -- 172.21.15.81:0/2349554578 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4e9401c460 con 0x7f4ea006cd80 2023-10-25T23:36:24.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.225+0000 7f4e9cff9700 1 --2- 172.21.15.81:0/2349554578 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f4e8c06aed0 0x7f4e8c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:36:24.235 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.226+0000 7f4e9cff9700 1 -- 172.21.15.81:0/2349554578 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e94089550 con 0x7f4ea006cd80 2023-10-25T23:36:24.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.226+0000 7f4e9f7fe700 1 --2- 172.21.15.81:0/2349554578 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f4e8c06aed0 0x7f4e8c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:36:24.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.226+0000 7f4e9f7fe700 1 --2- 172.21.15.81:0/2349554578 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f4e8c06aed0 0x7f4e8c06d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00bff70 tx=0x7f4e9000b390 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:36:24.236 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.230+0000 7f4e9cff9700 1 -- 172.21.15.81:0/2349554578 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4e94054600 con 0x7f4ea006cd80 2023-10-25T23:36:24.465 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.464+0000 7f4ea63ce700 1 -- 172.21.15.81:0/2349554578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4ea006f980 con 0x7f4ea006cd80 2023-10-25T23:36:24.466 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.464+0000 7f4e9cff9700 1 -- 172.21.15.81:0/2349554578 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4e94057c20 con 0x7f4ea006cd80 2023-10-25T23:36:24.466 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-25T23:36:24.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.466+0000 7f4ea63ce700 1 -- 172.21.15.81:0/2349554578 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f4e8c06aed0 msgr2=0x7f4e8c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:24.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.466+0000 7f4ea63ce700 1 --2- 172.21.15.81:0/2349554578 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f4e8c06aed0 0x7f4e8c06d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00bff70 tx=0x7f4e9000b390 comp rx=0 tx=0).stop 2023-10-25T23:36:24.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.466+0000 7f4ea63ce700 1 -- 172.21.15.81:0/2349554578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ea006cd80 msgr2=0x7f4ea006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:36:24.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.466+0000 7f4ea63ce700 1 --2- 172.21.15.81:0/2349554578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ea006cd80 0x7f4ea006a480 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4e9400c500 tx=0x7f4e9400c810 comp rx=0 tx=0).stop 2023-10-25T23:36:24.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.466+0000 7f4ea63ce700 1 -- 172.21.15.81:0/2349554578 shutdown_connections 2023-10-25T23:36:24.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.466+0000 7f4ea63ce700 1 --2- 172.21.15.81:0/2349554578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ea014f330 0x7f4ea0147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:24.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.466+0000 7f4ea63ce700 1 --2- 172.21.15.81:0/2349554578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ea006cd80 0x7f4ea006a480 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:24.469 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.466+0000 7f4ea63ce700 1 --2- 172.21.15.81:0/2349554578 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f4e8c06aed0 0x7f4e8c06d390 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:24.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.466+0000 7f4ea63ce700 1 --2- 172.21.15.81:0/2349554578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ea01454f0 0x7f4ea0132520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:36:24.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.466+0000 7f4ea63ce700 1 -- 172.21.15.81:0/2349554578 >> 172.21.15.81:0/2349554578 conn(0x7f4ea00c0a40 msgr2=0x7f4ea00bbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:36:24.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.466+0000 7f4ea63ce700 1 -- 172.21.15.81:0/2349554578 shutdown_connections 2023-10-25T23:36:24.470 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:36:24.466+0000 7f4ea63ce700 1 -- 172.21.15.81:0/2349554578 wait complete. 2023-10-25T23:36:24.480 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-25T23:36:24.480 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-25T23:36:24.480 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2023-10-25T23:36:24.481 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-25T23:36:24.481 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-25T23:36:24.482 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-25T23:36:24.482 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-25T23:36:24.482 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-25T23:36:24.482 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-25T23:36:24.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:36:24.483 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2023-10-25T23:36:24.500 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-25T23:36:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-25T23:36:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2023-10-25T23:36:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-25T23:36:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2023-10-25T23:36:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-25T23:36:24.502 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-25T23:36:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2023-10-25T23:36:24.502 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-25T23:36:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2023-10-25T23:36:24.502 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-25T23:36:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2023-10-25T23:36:24.503 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-25T23:36:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2023-10-25T23:36:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-25T23:36:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42410sec preferred_lft 42410sec 2023-10-25T23:36:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::7429:ee58:c46c:3ebe/64 scope link noprefixroute 2023-10-25T23:36:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2023-10-25T23:36:24.504 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-25T23:36:24.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:36:24.505 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-25T23:36:24.505 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-25T23:36:24.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2023-10-25T23:36:24.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2023-10-25T23:36:24.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2023-10-25T23:36:24.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-25T23:36:24.507 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-25T23:36:24.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:36:24.671 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-25T23:36:24.698 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-10-25T23:36:24.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:36:24.701 DEBUG:teuthology.orchestra.run.smithi081:> route 2023-10-25T23:36:24.771 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2023-10-25T23:36:24.772 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-25T23:36:24.772 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-25T23:36:24.772 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-25T23:36:24.772 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-25T23:36:24.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:36:24.773 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-25T23:36:24.774 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-25T23:36:24.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-25T23:36:24.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-25T23:36:24.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-25T23:36:24.775 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-25T23:36:25.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:36:25.043 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-25T23:36:25.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:36:25.060 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2023-10-25T23:36:25.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:36:25.117 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-25T23:36:25.117 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-25T23:36:25.117 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T23:36:25.117 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-25T23:36:25.118 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-25T23:36:25.211 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-25T23:36:25.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:36:25.212 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-25T23:36:25.212 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-25T23:36:25.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-25T23:36:25.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-25T23:36:25.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-25T23:36:25.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-25T23:36:25.214 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-25T23:36:25.214 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-25T23:36:25.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:36:25.414 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2023-10-25T23:36:25.415 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2023-10-25T23:36:25.415 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2023-10-25T23:36:25.415 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2023-10-25T23:36:25.416 DEBUG:teuthology.orchestra.run.smithi081:> ') 2023-10-25T23:36:25.516 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T23:36:25.517 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-25T23:36:25.536 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-25T23:36:25.537 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-25T23:36:25.537 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-25T23:36:25.593 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-25T23:36:25.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:36:25.594 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-25T23:36:25.689 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-25T23:36:25.690 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-25T23:36:25.690 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-25T23:36:25.799 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-25T23:36:25.799 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-25T23:36:25.799 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-25T23:36:25.800 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-25T23:36:25.800 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-25T23:36:25.874 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-25T23:36:25.875 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-25T23:36:25.875 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2023-10-25T23:36:25.875 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-10-25T23:36:25.875 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-25T23:36:25.875 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-10-25T23:36:25.876 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-10-25T23:36:25.876 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf" will pass to kernel 2023-10-25T23:36:25.877 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-25T23:36:25.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:36:25.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-25T23:36:25.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:36:25.905 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-25T23:36:25.987 INFO:teuthology.orchestra.run.smithi081.stdout:client4547 2023-10-25T23:36:25.987 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:36:25.988 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T23:36:26.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:36:26.045 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-25T23:36:26.126 INFO:teuthology.orchestra.run.smithi081.stdout:client4547 2023-10-25T23:36:26.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:36:26.127 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-25T23:36:26.208 INFO:teuthology.orchestra.run.smithi081.stdout:client4547 2023-10-25T23:36:26.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:36:26.208 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf.client4547/status') 2023-10-25T23:36:26.297 INFO:teuthology.orchestra.run.smithi081.stdout:instance: client.4547 (3)172.21.15.81:0/1311520082 2023-10-25T23:36:26.298 INFO:teuthology.orchestra.run.smithi081.stdout:blocklisted: false 2023-10-25T23:36:26.298 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2023-10-25T23:36:26.299 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2023-10-25T23:36:26.299 INFO:teuthology.orchestra.run.smithi081.stderr:70 bytes copied, 2.2497e-05 s, 3.1 MB/s 2023-10-25T23:36:26.299 INFO:teuthology.run_tasks:Running task workunit... 2023-10-25T23:36:26.312 INFO:tasks.workunit:Pulling workunits from ref 384993681abceb8cb8affea10538d607052db4b4 2023-10-25T23:36:26.313 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-25T23:36:26.313 INFO:tasks.workunit:timeout=6h 2023-10-25T23:36:26.313 INFO:tasks.workunit:cleanup=True 2023-10-25T23:36:26.314 DEBUG:teuthology.orchestra.run.smithi081:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-25T23:36:26.331 INFO:teuthology.orchestra.run.smithi081.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-10-25T23:36:26.332 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-10-25T23:36:26.332 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 2fh/47d Inode: 1 Links: 2 2023-10-25T23:36:26.332 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-25T23:36:26.332 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:cephfs_t:s0 2023-10-25T23:36:26.332 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-10-25T23:36:26.333 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-10-25 23:36:09.279703315 +0000 2023-10-25T23:36:26.333 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-10-25 23:36:25.901918876 +0000 2023-10-25T23:36:26.333 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2023-10-25 23:36:09.279703315 +0000 2023-10-25T23:36:26.333 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-10-25T23:36:26.334 DEBUG:teuthology.orchestra.run.smithi081:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-10-25T23:36:26.403 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 384993681abceb8cb8affea10538d607052db4b4 2023-10-25T23:36:26.461 INFO:tasks.workunit.client.0.smithi081.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-25T23:36:37.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:36:37.143 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:37:07.208 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:37:07.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:37:27.723 INFO:tasks.workunit.client.0.smithi081.stderr:Note: switching to '384993681abceb8cb8affea10538d607052db4b4'. 2023-10-25T23:37:27.723 INFO:tasks.workunit.client.0.smithi081.stderr: 2023-10-25T23:37:27.724 INFO:tasks.workunit.client.0.smithi081.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-25T23:37:27.724 INFO:tasks.workunit.client.0.smithi081.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-25T23:37:27.724 INFO:tasks.workunit.client.0.smithi081.stderr:state without impacting any branches by switching back to a branch. 2023-10-25T23:37:27.724 INFO:tasks.workunit.client.0.smithi081.stderr: 2023-10-25T23:37:27.724 INFO:tasks.workunit.client.0.smithi081.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-25T23:37:27.725 INFO:tasks.workunit.client.0.smithi081.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-25T23:37:27.725 INFO:tasks.workunit.client.0.smithi081.stderr: 2023-10-25T23:37:27.725 INFO:tasks.workunit.client.0.smithi081.stderr: git switch -c 2023-10-25T23:37:27.725 INFO:tasks.workunit.client.0.smithi081.stderr: 2023-10-25T23:37:27.725 INFO:tasks.workunit.client.0.smithi081.stderr:Or undo this operation with: 2023-10-25T23:37:27.726 INFO:tasks.workunit.client.0.smithi081.stderr: 2023-10-25T23:37:27.726 INFO:tasks.workunit.client.0.smithi081.stderr: git switch - 2023-10-25T23:37:27.726 INFO:tasks.workunit.client.0.smithi081.stderr: 2023-10-25T23:37:27.726 INFO:tasks.workunit.client.0.smithi081.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-25T23:37:27.726 INFO:tasks.workunit.client.0.smithi081.stderr: 2023-10-25T23:37:27.727 INFO:tasks.workunit.client.0.smithi081.stderr:HEAD is now at 384993681ab Merge PR #47121 into wip-batrick-testing-20231024.144545 2023-10-25T23:37:27.728 DEBUG:teuthology.orchestra.run.smithi081:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-25T23:37:27.751 INFO:tasks.workunit.client.0.smithi081.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-25T23:37:27.753 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-25T23:37:27.753 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-25T23:37:28.288 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-25T23:37:28.338 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-25T23:37:28.375 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-25T23:37:28.376 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-25T23:37:28.376 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-25T23:37:28.412 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-25T23:37:28.415 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:37:28.416 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-25T23:37:28.472 INFO:tasks.workunit:Running workunits matching fs/snaps on client.0... 2023-10-25T23:37:28.474 INFO:tasks.workunit:Running workunit fs/snaps/snap-rm-diff.sh... 2023-10-25T23:37:28.474 DEBUG:teuthology.orchestra.run.smithi081:workunit test fs/snaps/snap-rm-diff.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snap-rm-diff.sh 2023-10-25T23:37:28.534 INFO:tasks.workunit.client.0.smithi081.stderr:+ wget -q http://download.ceph.com/qa/linux-2.6.33.tar.bz2 2023-10-25T23:37:31.031 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir foo 2023-10-25T23:37:31.035 INFO:tasks.workunit.client.0.smithi081.stderr:+ cp linux-2.6.33.tar.bz2 foo 2023-10-25T23:37:31.072 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir foo/.snap/barsnap 2023-10-25T23:37:31.097 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm foo/linux-2.6.33.tar.bz2 2023-10-25T23:37:31.110 INFO:tasks.workunit.client.0.smithi081.stderr:+ diff -q foo/.snap/barsnap/linux-2.6.33.tar.bz2 linux-2.6.33.tar.bz2 2023-10-25T23:37:31.286 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo 'passed: files are identical' 2023-10-25T23:37:31.286 INFO:tasks.workunit.client.0.smithi081.stdout:passed: files are identical 2023-10-25T23:37:31.287 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir foo/.snap/barsnap 2023-10-25T23:37:31.318 INFO:tasks.workunit.client.0.smithi081.stdout:OK 2023-10-25T23:37:31.319 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo OK 2023-10-25T23:37:31.320 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-25T23:37:31.320 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-25T23:37:31.395 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-1.sh... 2023-10-25T23:37:31.395 DEBUG:teuthology.orchestra.run.smithi081:workunit test fs/snaps/snaptest-1.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-1.sh 2023-10-25T23:37:31.457 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo 1 2023-10-25T23:37:31.458 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo 2 2023-10-25T23:37:31.459 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo 3 2023-10-25T23:37:31.459 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' -e file4 ']' 2023-10-25T23:37:31.459 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/snap1 2023-10-25T23:37:31.484 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo 4 2023-10-25T23:37:31.486 INFO:tasks.workunit.client.0.smithi081.stderr:++ ls 2023-10-25T23:37:31.491 INFO:tasks.workunit.client.0.smithi081.stderr:+ now='file1 2023-10-25T23:37:31.491 INFO:tasks.workunit.client.0.smithi081.stderr:file2 2023-10-25T23:37:31.491 INFO:tasks.workunit.client.0.smithi081.stderr:file3 2023-10-25T23:37:31.491 INFO:tasks.workunit.client.0.smithi081.stderr:file4' 2023-10-25T23:37:31.492 INFO:tasks.workunit.client.0.smithi081.stderr:++ ls .snap/snap1 2023-10-25T23:37:31.495 INFO:tasks.workunit.client.0.smithi081.stderr:+ then='file1 2023-10-25T23:37:31.495 INFO:tasks.workunit.client.0.smithi081.stderr:file2 2023-10-25T23:37:31.496 INFO:tasks.workunit.client.0.smithi081.stderr:file3' 2023-10-25T23:37:31.496 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/snap1 2023-10-25T23:37:31.502 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 'file1 2023-10-25T23:37:31.502 INFO:tasks.workunit.client.0.smithi081.stderr:file2 2023-10-25T23:37:31.502 INFO:tasks.workunit.client.0.smithi081.stderr:file3 2023-10-25T23:37:31.502 INFO:tasks.workunit.client.0.smithi081.stderr:file4' = 'file1 2023-10-25T23:37:31.502 INFO:tasks.workunit.client.0.smithi081.stderr:file2 2023-10-25T23:37:31.503 INFO:tasks.workunit.client.0.smithi081.stderr:file3' ']' 2023-10-25T23:37:31.503 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo 1 2023-10-25T23:37:31.506 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo 2 2023-10-25T23:37:31.511 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo 3 2023-10-25T23:37:31.519 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/snap1 2023-10-25T23:37:31.542 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo 4 2023-10-25T23:37:31.561 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/snap1 2023-10-25T23:37:31.572 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm file1 file2 file3 file4 2023-10-25T23:37:31.577 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo OK 2023-10-25T23:37:31.578 INFO:tasks.workunit.client.0.smithi081.stdout:OK 2023-10-25T23:37:31.578 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-25T23:37:31.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-25T23:37:31.652 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-2.sh... 2023-10-25T23:37:31.652 DEBUG:teuthology.orchestra.run.smithi081:workunit test fs/snaps/snaptest-2.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-2.sh 2023-10-25T23:37:31.714 INFO:tasks.workunit.client.0.smithi081.stdout:Create dir 100 to 199 ... 2023-10-25T23:37:31.716 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 100 2023-10-25T23:37:31.724 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 101 2023-10-25T23:37:31.732 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 102 2023-10-25T23:37:31.741 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 103 2023-10-25T23:37:31.749 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 104 2023-10-25T23:37:31.757 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 105 2023-10-25T23:37:31.766 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 106 2023-10-25T23:37:31.774 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 107 2023-10-25T23:37:31.782 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 108 2023-10-25T23:37:31.791 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 109 2023-10-25T23:37:31.799 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 110 2023-10-25T23:37:31.807 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 111 2023-10-25T23:37:31.816 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 112 2023-10-25T23:37:31.824 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 113 2023-10-25T23:37:31.832 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 114 2023-10-25T23:37:31.840 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 115 2023-10-25T23:37:31.848 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 116 2023-10-25T23:37:31.856 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 117 2023-10-25T23:37:31.868 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 118 2023-10-25T23:37:31.880 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 119 2023-10-25T23:37:31.891 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 120 2023-10-25T23:37:31.903 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 121 2023-10-25T23:37:31.915 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 122 2023-10-25T23:37:31.927 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 123 2023-10-25T23:37:31.938 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 124 2023-10-25T23:37:31.946 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 125 2023-10-25T23:37:31.955 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 126 2023-10-25T23:37:31.963 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 127 2023-10-25T23:37:31.971 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 128 2023-10-25T23:37:31.980 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 129 2023-10-25T23:37:31.988 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 130 2023-10-25T23:37:31.996 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 131 2023-10-25T23:37:32.005 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 132 2023-10-25T23:37:32.013 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 133 2023-10-25T23:37:32.021 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 134 2023-10-25T23:37:32.029 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 135 2023-10-25T23:37:32.038 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 136 2023-10-25T23:37:32.046 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 137 2023-10-25T23:37:32.054 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 138 2023-10-25T23:37:32.062 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 139 2023-10-25T23:37:32.071 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 140 2023-10-25T23:37:32.079 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 141 2023-10-25T23:37:32.087 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 142 2023-10-25T23:37:32.095 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 143 2023-10-25T23:37:32.104 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 144 2023-10-25T23:37:32.117 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 145 2023-10-25T23:37:32.128 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 146 2023-10-25T23:37:32.138 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 147 2023-10-25T23:37:32.149 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 148 2023-10-25T23:37:32.159 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 149 2023-10-25T23:37:32.170 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 150 2023-10-25T23:37:32.184 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 151 2023-10-25T23:37:32.198 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 152 2023-10-25T23:37:32.211 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 153 2023-10-25T23:37:32.224 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 154 2023-10-25T23:37:32.235 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 155 2023-10-25T23:37:32.246 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 156 2023-10-25T23:37:32.256 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 157 2023-10-25T23:37:32.270 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 158 2023-10-25T23:37:32.284 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 159 2023-10-25T23:37:32.294 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 160 2023-10-25T23:37:32.305 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 161 2023-10-25T23:37:32.315 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 162 2023-10-25T23:37:32.326 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 163 2023-10-25T23:37:32.338 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 164 2023-10-25T23:37:32.351 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 165 2023-10-25T23:37:32.365 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 166 2023-10-25T23:37:32.376 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 167 2023-10-25T23:37:32.386 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 168 2023-10-25T23:37:32.397 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 169 2023-10-25T23:37:32.408 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 170 2023-10-25T23:37:32.418 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 171 2023-10-25T23:37:32.429 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 172 2023-10-25T23:37:32.438 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 173 2023-10-25T23:37:32.446 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 174 2023-10-25T23:37:32.454 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 175 2023-10-25T23:37:32.462 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 176 2023-10-25T23:37:32.470 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 177 2023-10-25T23:37:32.478 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 178 2023-10-25T23:37:32.486 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 179 2023-10-25T23:37:32.494 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 180 2023-10-25T23:37:32.503 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 181 2023-10-25T23:37:32.511 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 182 2023-10-25T23:37:32.519 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 183 2023-10-25T23:37:32.527 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 184 2023-10-25T23:37:32.535 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 185 2023-10-25T23:37:32.543 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 186 2023-10-25T23:37:32.551 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 187 2023-10-25T23:37:32.559 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 188 2023-10-25T23:37:32.568 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 189 2023-10-25T23:37:32.576 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 190 2023-10-25T23:37:32.585 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 191 2023-10-25T23:37:32.593 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 192 2023-10-25T23:37:32.602 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 193 2023-10-25T23:37:32.610 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 194 2023-10-25T23:37:32.619 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 195 2023-10-25T23:37:32.627 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 196 2023-10-25T23:37:32.636 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 197 2023-10-25T23:37:32.644 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 198 2023-10-25T23:37:32.652 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 199 2023-10-25T23:37:32.661 INFO:tasks.workunit.client.0.smithi081.stdout:Take first snapshot .snap/test1 2023-10-25T23:37:32.880 INFO:tasks.workunit.client.0.smithi081.stdout:Create dir 200 to 299 ... 2023-10-25T23:37:32.885 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 200 2023-10-25T23:37:32.900 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 201 2023-10-25T23:37:32.908 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 202 2023-10-25T23:37:32.915 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 203 2023-10-25T23:37:32.923 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 204 2023-10-25T23:37:32.931 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 205 2023-10-25T23:37:32.938 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 206 2023-10-25T23:37:32.946 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 207 2023-10-25T23:37:32.954 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 208 2023-10-25T23:37:32.961 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 209 2023-10-25T23:37:32.969 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 210 2023-10-25T23:37:32.977 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 211 2023-10-25T23:37:32.984 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 212 2023-10-25T23:37:32.992 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 213 2023-10-25T23:37:33.000 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 214 2023-10-25T23:37:33.008 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 215 2023-10-25T23:37:33.016 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 216 2023-10-25T23:37:33.024 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 217 2023-10-25T23:37:33.031 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 218 2023-10-25T23:37:33.039 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 219 2023-10-25T23:37:33.047 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 220 2023-10-25T23:37:33.055 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 221 2023-10-25T23:37:33.065 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 222 2023-10-25T23:37:33.074 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 223 2023-10-25T23:37:33.089 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 224 2023-10-25T23:37:33.097 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 225 2023-10-25T23:37:33.105 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 226 2023-10-25T23:37:33.113 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 227 2023-10-25T23:37:33.120 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 228 2023-10-25T23:37:33.128 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 229 2023-10-25T23:37:33.136 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 230 2023-10-25T23:37:33.144 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 231 2023-10-25T23:37:33.151 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 232 2023-10-25T23:37:33.159 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 233 2023-10-25T23:37:33.167 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 234 2023-10-25T23:37:33.175 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 235 2023-10-25T23:37:33.183 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 236 2023-10-25T23:37:33.191 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 237 2023-10-25T23:37:33.199 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 238 2023-10-25T23:37:33.213 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 239 2023-10-25T23:37:33.223 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 240 2023-10-25T23:37:33.231 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 241 2023-10-25T23:37:33.239 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 242 2023-10-25T23:37:33.248 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 243 2023-10-25T23:37:33.256 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 244 2023-10-25T23:37:33.264 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 245 2023-10-25T23:37:33.273 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 246 2023-10-25T23:37:33.281 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 247 2023-10-25T23:37:33.289 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 248 2023-10-25T23:37:33.298 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 249 2023-10-25T23:37:33.306 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 250 2023-10-25T23:37:33.314 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 251 2023-10-25T23:37:33.322 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 252 2023-10-25T23:37:33.330 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 253 2023-10-25T23:37:33.339 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 254 2023-10-25T23:37:33.347 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 255 2023-10-25T23:37:33.356 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 256 2023-10-25T23:37:33.364 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 257 2023-10-25T23:37:33.372 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 258 2023-10-25T23:37:33.381 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 259 2023-10-25T23:37:33.389 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 260 2023-10-25T23:37:33.397 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 261 2023-10-25T23:37:33.406 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 262 2023-10-25T23:37:33.415 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 263 2023-10-25T23:37:33.424 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 264 2023-10-25T23:37:33.435 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 265 2023-10-25T23:37:33.445 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 266 2023-10-25T23:37:33.455 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 267 2023-10-25T23:37:33.465 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 268 2023-10-25T23:37:33.475 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 269 2023-10-25T23:37:33.486 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 270 2023-10-25T23:37:33.497 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 271 2023-10-25T23:37:33.508 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 272 2023-10-25T23:37:33.679 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 273 2023-10-25T23:37:33.687 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 274 2023-10-25T23:37:33.695 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 275 2023-10-25T23:37:33.704 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 276 2023-10-25T23:37:33.712 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 277 2023-10-25T23:37:33.721 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 278 2023-10-25T23:37:33.729 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 279 2023-10-25T23:37:33.737 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 280 2023-10-25T23:37:33.746 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 281 2023-10-25T23:37:33.754 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 282 2023-10-25T23:37:33.762 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 283 2023-10-25T23:37:33.771 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 284 2023-10-25T23:37:33.779 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 285 2023-10-25T23:37:33.787 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 286 2023-10-25T23:37:33.795 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 287 2023-10-25T23:37:33.803 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 288 2023-10-25T23:37:33.811 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 289 2023-10-25T23:37:33.819 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 290 2023-10-25T23:37:33.827 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 291 2023-10-25T23:37:33.835 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 292 2023-10-25T23:37:33.843 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 293 2023-10-25T23:37:33.851 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 294 2023-10-25T23:37:33.859 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 295 2023-10-25T23:37:33.868 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 296 2023-10-25T23:37:33.875 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 297 2023-10-25T23:37:33.884 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 298 2023-10-25T23:37:33.891 INFO:tasks.workunit.client.0.smithi081.stdout: create dir 299 2023-10-25T23:37:33.899 INFO:tasks.workunit.client.0.smithi081.stdout:Create a snapshot in every first level dir ... 2023-10-25T23:37:33.977 INFO:tasks.workunit.client.0.smithi081.stdout: create 100/.snap/snap-subdir-test 2023-10-25T23:37:34.017 INFO:tasks.workunit.client.0.smithi081.stdout: create 100/30 file after the snapshot 2023-10-25T23:37:34.018 INFO:tasks.workunit.client.0.smithi081.stdout: create 100/31 file after the snapshot 2023-10-25T23:37:34.019 INFO:tasks.workunit.client.0.smithi081.stdout: create 100/32 file after the snapshot 2023-10-25T23:37:34.020 INFO:tasks.workunit.client.0.smithi081.stdout: create 100/33 file after the snapshot 2023-10-25T23:37:34.021 INFO:tasks.workunit.client.0.smithi081.stdout: create 100/34 file after the snapshot 2023-10-25T23:37:34.022 INFO:tasks.workunit.client.0.smithi081.stdout: create 100/35 file after the snapshot 2023-10-25T23:37:34.023 INFO:tasks.workunit.client.0.smithi081.stdout: create 100/36 file after the snapshot 2023-10-25T23:37:34.024 INFO:tasks.workunit.client.0.smithi081.stdout: create 100/37 file after the snapshot 2023-10-25T23:37:34.025 INFO:tasks.workunit.client.0.smithi081.stdout: create 100/38 file after the snapshot 2023-10-25T23:37:34.025 INFO:tasks.workunit.client.0.smithi081.stdout: create 100/39 file after the snapshot 2023-10-25T23:37:34.026 INFO:tasks.workunit.client.0.smithi081.stdout: create 101/.snap/snap-subdir-test 2023-10-25T23:37:34.069 INFO:tasks.workunit.client.0.smithi081.stdout: create 101/30 file after the snapshot 2023-10-25T23:37:34.071 INFO:tasks.workunit.client.0.smithi081.stdout: create 101/31 file after the snapshot 2023-10-25T23:37:34.072 INFO:tasks.workunit.client.0.smithi081.stdout: create 101/32 file after the snapshot 2023-10-25T23:37:34.073 INFO:tasks.workunit.client.0.smithi081.stdout: create 101/33 file after the snapshot 2023-10-25T23:37:34.073 INFO:tasks.workunit.client.0.smithi081.stdout: create 101/34 file after the snapshot 2023-10-25T23:37:34.074 INFO:tasks.workunit.client.0.smithi081.stdout: create 101/35 file after the snapshot 2023-10-25T23:37:34.075 INFO:tasks.workunit.client.0.smithi081.stdout: create 101/36 file after the snapshot 2023-10-25T23:37:34.076 INFO:tasks.workunit.client.0.smithi081.stdout: create 101/37 file after the snapshot 2023-10-25T23:37:34.077 INFO:tasks.workunit.client.0.smithi081.stdout: create 101/38 file after the snapshot 2023-10-25T23:37:34.078 INFO:tasks.workunit.client.0.smithi081.stdout: create 101/39 file after the snapshot 2023-10-25T23:37:34.079 INFO:tasks.workunit.client.0.smithi081.stdout: create 102/.snap/snap-subdir-test 2023-10-25T23:37:34.119 INFO:tasks.workunit.client.0.smithi081.stdout: create 102/30 file after the snapshot 2023-10-25T23:37:34.122 INFO:tasks.workunit.client.0.smithi081.stdout: create 102/31 file after the snapshot 2023-10-25T23:37:34.125 INFO:tasks.workunit.client.0.smithi081.stdout: create 102/32 file after the snapshot 2023-10-25T23:37:34.127 INFO:tasks.workunit.client.0.smithi081.stdout: create 102/33 file after the snapshot 2023-10-25T23:37:34.129 INFO:tasks.workunit.client.0.smithi081.stdout: create 102/34 file after the snapshot 2023-10-25T23:37:34.131 INFO:tasks.workunit.client.0.smithi081.stdout: create 102/35 file after the snapshot 2023-10-25T23:37:34.131 INFO:tasks.workunit.client.0.smithi081.stdout: create 102/36 file after the snapshot 2023-10-25T23:37:34.132 INFO:tasks.workunit.client.0.smithi081.stdout: create 102/37 file after the snapshot 2023-10-25T23:37:34.133 INFO:tasks.workunit.client.0.smithi081.stdout: create 102/38 file after the snapshot 2023-10-25T23:37:34.133 INFO:tasks.workunit.client.0.smithi081.stdout: create 102/39 file after the snapshot 2023-10-25T23:37:34.134 INFO:tasks.workunit.client.0.smithi081.stdout: create 103/.snap/snap-subdir-test 2023-10-25T23:37:34.175 INFO:tasks.workunit.client.0.smithi081.stdout: create 103/30 file after the snapshot 2023-10-25T23:37:34.176 INFO:tasks.workunit.client.0.smithi081.stdout: create 103/31 file after the snapshot 2023-10-25T23:37:34.177 INFO:tasks.workunit.client.0.smithi081.stdout: create 103/32 file after the snapshot 2023-10-25T23:37:34.178 INFO:tasks.workunit.client.0.smithi081.stdout: create 103/33 file after the snapshot 2023-10-25T23:37:34.178 INFO:tasks.workunit.client.0.smithi081.stdout: create 103/34 file after the snapshot 2023-10-25T23:37:34.179 INFO:tasks.workunit.client.0.smithi081.stdout: create 103/35 file after the snapshot 2023-10-25T23:37:34.180 INFO:tasks.workunit.client.0.smithi081.stdout: create 103/36 file after the snapshot 2023-10-25T23:37:34.181 INFO:tasks.workunit.client.0.smithi081.stdout: create 103/37 file after the snapshot 2023-10-25T23:37:34.182 INFO:tasks.workunit.client.0.smithi081.stdout: create 103/38 file after the snapshot 2023-10-25T23:37:34.183 INFO:tasks.workunit.client.0.smithi081.stdout: create 103/39 file after the snapshot 2023-10-25T23:37:34.184 INFO:tasks.workunit.client.0.smithi081.stdout: create 104/.snap/snap-subdir-test 2023-10-25T23:37:34.224 INFO:tasks.workunit.client.0.smithi081.stdout: create 104/30 file after the snapshot 2023-10-25T23:37:34.225 INFO:tasks.workunit.client.0.smithi081.stdout: create 104/31 file after the snapshot 2023-10-25T23:37:34.225 INFO:tasks.workunit.client.0.smithi081.stdout: create 104/32 file after the snapshot 2023-10-25T23:37:34.227 INFO:tasks.workunit.client.0.smithi081.stdout: create 104/33 file after the snapshot 2023-10-25T23:37:34.228 INFO:tasks.workunit.client.0.smithi081.stdout: create 104/34 file after the snapshot 2023-10-25T23:37:34.228 INFO:tasks.workunit.client.0.smithi081.stdout: create 104/35 file after the snapshot 2023-10-25T23:37:34.229 INFO:tasks.workunit.client.0.smithi081.stdout: create 104/36 file after the snapshot 2023-10-25T23:37:34.230 INFO:tasks.workunit.client.0.smithi081.stdout: create 104/37 file after the snapshot 2023-10-25T23:37:34.231 INFO:tasks.workunit.client.0.smithi081.stdout: create 104/38 file after the snapshot 2023-10-25T23:37:34.239 INFO:tasks.workunit.client.0.smithi081.stdout: create 104/39 file after the snapshot 2023-10-25T23:37:34.240 INFO:tasks.workunit.client.0.smithi081.stdout: create 105/.snap/snap-subdir-test 2023-10-25T23:37:34.275 INFO:tasks.workunit.client.0.smithi081.stdout: create 105/30 file after the snapshot 2023-10-25T23:37:34.292 INFO:tasks.workunit.client.0.smithi081.stdout: create 105/31 file after the snapshot 2023-10-25T23:37:34.292 INFO:tasks.workunit.client.0.smithi081.stdout: create 105/32 file after the snapshot 2023-10-25T23:37:34.293 INFO:tasks.workunit.client.0.smithi081.stdout: create 105/33 file after the snapshot 2023-10-25T23:37:34.293 INFO:tasks.workunit.client.0.smithi081.stdout: create 105/34 file after the snapshot 2023-10-25T23:37:34.294 INFO:tasks.workunit.client.0.smithi081.stdout: create 105/35 file after the snapshot 2023-10-25T23:37:34.295 INFO:tasks.workunit.client.0.smithi081.stdout: create 105/36 file after the snapshot 2023-10-25T23:37:34.295 INFO:tasks.workunit.client.0.smithi081.stdout: create 105/37 file after the snapshot 2023-10-25T23:37:34.296 INFO:tasks.workunit.client.0.smithi081.stdout: create 105/38 file after the snapshot 2023-10-25T23:37:34.297 INFO:tasks.workunit.client.0.smithi081.stdout: create 105/39 file after the snapshot 2023-10-25T23:37:34.297 INFO:tasks.workunit.client.0.smithi081.stdout: create 106/.snap/snap-subdir-test 2023-10-25T23:37:34.328 INFO:tasks.workunit.client.0.smithi081.stdout: create 106/30 file after the snapshot 2023-10-25T23:37:34.333 INFO:tasks.workunit.client.0.smithi081.stdout: create 106/31 file after the snapshot 2023-10-25T23:37:34.334 INFO:tasks.workunit.client.0.smithi081.stdout: create 106/32 file after the snapshot 2023-10-25T23:37:34.334 INFO:tasks.workunit.client.0.smithi081.stdout: create 106/33 file after the snapshot 2023-10-25T23:37:34.335 INFO:tasks.workunit.client.0.smithi081.stdout: create 106/34 file after the snapshot 2023-10-25T23:37:34.336 INFO:tasks.workunit.client.0.smithi081.stdout: create 106/35 file after the snapshot 2023-10-25T23:37:34.337 INFO:tasks.workunit.client.0.smithi081.stdout: create 106/36 file after the snapshot 2023-10-25T23:37:34.338 INFO:tasks.workunit.client.0.smithi081.stdout: create 106/37 file after the snapshot 2023-10-25T23:37:34.339 INFO:tasks.workunit.client.0.smithi081.stdout: create 106/38 file after the snapshot 2023-10-25T23:37:34.340 INFO:tasks.workunit.client.0.smithi081.stdout: create 106/39 file after the snapshot 2023-10-25T23:37:34.341 INFO:tasks.workunit.client.0.smithi081.stdout: create 107/.snap/snap-subdir-test 2023-10-25T23:37:34.374 INFO:tasks.workunit.client.0.smithi081.stdout: create 107/30 file after the snapshot 2023-10-25T23:37:34.375 INFO:tasks.workunit.client.0.smithi081.stdout: create 107/31 file after the snapshot 2023-10-25T23:37:34.376 INFO:tasks.workunit.client.0.smithi081.stdout: create 107/32 file after the snapshot 2023-10-25T23:37:34.377 INFO:tasks.workunit.client.0.smithi081.stdout: create 107/33 file after the snapshot 2023-10-25T23:37:34.379 INFO:tasks.workunit.client.0.smithi081.stdout: create 107/34 file after the snapshot 2023-10-25T23:37:34.380 INFO:tasks.workunit.client.0.smithi081.stdout: create 107/35 file after the snapshot 2023-10-25T23:37:34.383 INFO:tasks.workunit.client.0.smithi081.stdout: create 107/36 file after the snapshot 2023-10-25T23:37:34.384 INFO:tasks.workunit.client.0.smithi081.stdout: create 107/37 file after the snapshot 2023-10-25T23:37:34.384 INFO:tasks.workunit.client.0.smithi081.stdout: create 107/38 file after the snapshot 2023-10-25T23:37:34.385 INFO:tasks.workunit.client.0.smithi081.stdout: create 107/39 file after the snapshot 2023-10-25T23:37:34.386 INFO:tasks.workunit.client.0.smithi081.stdout: create 108/.snap/snap-subdir-test 2023-10-25T23:37:34.418 INFO:tasks.workunit.client.0.smithi081.stdout: create 108/30 file after the snapshot 2023-10-25T23:37:34.419 INFO:tasks.workunit.client.0.smithi081.stdout: create 108/31 file after the snapshot 2023-10-25T23:37:34.420 INFO:tasks.workunit.client.0.smithi081.stdout: create 108/32 file after the snapshot 2023-10-25T23:37:34.421 INFO:tasks.workunit.client.0.smithi081.stdout: create 108/33 file after the snapshot 2023-10-25T23:37:34.422 INFO:tasks.workunit.client.0.smithi081.stdout: create 108/34 file after the snapshot 2023-10-25T23:37:34.424 INFO:tasks.workunit.client.0.smithi081.stdout: create 108/35 file after the snapshot 2023-10-25T23:37:34.425 INFO:tasks.workunit.client.0.smithi081.stdout: create 108/36 file after the snapshot 2023-10-25T23:37:34.426 INFO:tasks.workunit.client.0.smithi081.stdout: create 108/37 file after the snapshot 2023-10-25T23:37:34.428 INFO:tasks.workunit.client.0.smithi081.stdout: create 108/38 file after the snapshot 2023-10-25T23:37:34.429 INFO:tasks.workunit.client.0.smithi081.stdout: create 108/39 file after the snapshot 2023-10-25T23:37:34.431 INFO:tasks.workunit.client.0.smithi081.stdout: create 109/.snap/snap-subdir-test 2023-10-25T23:37:34.462 INFO:tasks.workunit.client.0.smithi081.stdout: create 109/30 file after the snapshot 2023-10-25T23:37:34.464 INFO:tasks.workunit.client.0.smithi081.stdout: create 109/31 file after the snapshot 2023-10-25T23:37:34.465 INFO:tasks.workunit.client.0.smithi081.stdout: create 109/32 file after the snapshot 2023-10-25T23:37:34.467 INFO:tasks.workunit.client.0.smithi081.stdout: create 109/33 file after the snapshot 2023-10-25T23:37:34.468 INFO:tasks.workunit.client.0.smithi081.stdout: create 109/34 file after the snapshot 2023-10-25T23:37:34.470 INFO:tasks.workunit.client.0.smithi081.stdout: create 109/35 file after the snapshot 2023-10-25T23:37:34.471 INFO:tasks.workunit.client.0.smithi081.stdout: create 109/36 file after the snapshot 2023-10-25T23:37:34.473 INFO:tasks.workunit.client.0.smithi081.stdout: create 109/37 file after the snapshot 2023-10-25T23:37:34.474 INFO:tasks.workunit.client.0.smithi081.stdout: create 109/38 file after the snapshot 2023-10-25T23:37:34.475 INFO:tasks.workunit.client.0.smithi081.stdout: create 109/39 file after the snapshot 2023-10-25T23:37:34.477 INFO:tasks.workunit.client.0.smithi081.stdout: create 110/.snap/snap-subdir-test 2023-10-25T23:37:34.507 INFO:tasks.workunit.client.0.smithi081.stdout: create 110/30 file after the snapshot 2023-10-25T23:37:34.508 INFO:tasks.workunit.client.0.smithi081.stdout: create 110/31 file after the snapshot 2023-10-25T23:37:34.510 INFO:tasks.workunit.client.0.smithi081.stdout: create 110/32 file after the snapshot 2023-10-25T23:37:34.511 INFO:tasks.workunit.client.0.smithi081.stdout: create 110/33 file after the snapshot 2023-10-25T23:37:34.512 INFO:tasks.workunit.client.0.smithi081.stdout: create 110/34 file after the snapshot 2023-10-25T23:37:34.514 INFO:tasks.workunit.client.0.smithi081.stdout: create 110/35 file after the snapshot 2023-10-25T23:37:34.515 INFO:tasks.workunit.client.0.smithi081.stdout: create 110/36 file after the snapshot 2023-10-25T23:37:34.516 INFO:tasks.workunit.client.0.smithi081.stdout: create 110/37 file after the snapshot 2023-10-25T23:37:34.518 INFO:tasks.workunit.client.0.smithi081.stdout: create 110/38 file after the snapshot 2023-10-25T23:37:34.519 INFO:tasks.workunit.client.0.smithi081.stdout: create 110/39 file after the snapshot 2023-10-25T23:37:34.521 INFO:tasks.workunit.client.0.smithi081.stdout: create 111/.snap/snap-subdir-test 2023-10-25T23:37:34.551 INFO:tasks.workunit.client.0.smithi081.stdout: create 111/30 file after the snapshot 2023-10-25T23:37:34.552 INFO:tasks.workunit.client.0.smithi081.stdout: create 111/31 file after the snapshot 2023-10-25T23:37:34.554 INFO:tasks.workunit.client.0.smithi081.stdout: create 111/32 file after the snapshot 2023-10-25T23:37:34.555 INFO:tasks.workunit.client.0.smithi081.stdout: create 111/33 file after the snapshot 2023-10-25T23:37:34.556 INFO:tasks.workunit.client.0.smithi081.stdout: create 111/34 file after the snapshot 2023-10-25T23:37:34.556 INFO:tasks.workunit.client.0.smithi081.stdout: create 111/35 file after the snapshot 2023-10-25T23:37:34.557 INFO:tasks.workunit.client.0.smithi081.stdout: create 111/36 file after the snapshot 2023-10-25T23:37:34.559 INFO:tasks.workunit.client.0.smithi081.stdout: create 111/37 file after the snapshot 2023-10-25T23:37:34.559 INFO:tasks.workunit.client.0.smithi081.stdout: create 111/38 file after the snapshot 2023-10-25T23:37:34.560 INFO:tasks.workunit.client.0.smithi081.stdout: create 111/39 file after the snapshot 2023-10-25T23:37:34.561 INFO:tasks.workunit.client.0.smithi081.stdout: create 112/.snap/snap-subdir-test 2023-10-25T23:37:34.592 INFO:tasks.workunit.client.0.smithi081.stdout: create 112/30 file after the snapshot 2023-10-25T23:37:34.593 INFO:tasks.workunit.client.0.smithi081.stdout: create 112/31 file after the snapshot 2023-10-25T23:37:34.594 INFO:tasks.workunit.client.0.smithi081.stdout: create 112/32 file after the snapshot 2023-10-25T23:37:34.596 INFO:tasks.workunit.client.0.smithi081.stdout: create 112/33 file after the snapshot 2023-10-25T23:37:34.597 INFO:tasks.workunit.client.0.smithi081.stdout: create 112/34 file after the snapshot 2023-10-25T23:37:34.599 INFO:tasks.workunit.client.0.smithi081.stdout: create 112/35 file after the snapshot 2023-10-25T23:37:34.600 INFO:tasks.workunit.client.0.smithi081.stdout: create 112/36 file after the snapshot 2023-10-25T23:37:34.601 INFO:tasks.workunit.client.0.smithi081.stdout: create 112/37 file after the snapshot 2023-10-25T23:37:34.602 INFO:tasks.workunit.client.0.smithi081.stdout: create 112/38 file after the snapshot 2023-10-25T23:37:34.603 INFO:tasks.workunit.client.0.smithi081.stdout: create 112/39 file after the snapshot 2023-10-25T23:37:34.605 INFO:tasks.workunit.client.0.smithi081.stdout: create 113/.snap/snap-subdir-test 2023-10-25T23:37:34.636 INFO:tasks.workunit.client.0.smithi081.stdout: create 113/30 file after the snapshot 2023-10-25T23:37:34.637 INFO:tasks.workunit.client.0.smithi081.stdout: create 113/31 file after the snapshot 2023-10-25T23:37:34.638 INFO:tasks.workunit.client.0.smithi081.stdout: create 113/32 file after the snapshot 2023-10-25T23:37:34.639 INFO:tasks.workunit.client.0.smithi081.stdout: create 113/33 file after the snapshot 2023-10-25T23:37:34.639 INFO:tasks.workunit.client.0.smithi081.stdout: create 113/34 file after the snapshot 2023-10-25T23:37:34.640 INFO:tasks.workunit.client.0.smithi081.stdout: create 113/35 file after the snapshot 2023-10-25T23:37:34.641 INFO:tasks.workunit.client.0.smithi081.stdout: create 113/36 file after the snapshot 2023-10-25T23:37:34.642 INFO:tasks.workunit.client.0.smithi081.stdout: create 113/37 file after the snapshot 2023-10-25T23:37:34.643 INFO:tasks.workunit.client.0.smithi081.stdout: create 113/38 file after the snapshot 2023-10-25T23:37:34.644 INFO:tasks.workunit.client.0.smithi081.stdout: create 113/39 file after the snapshot 2023-10-25T23:37:34.645 INFO:tasks.workunit.client.0.smithi081.stdout: create 114/.snap/snap-subdir-test 2023-10-25T23:37:34.675 INFO:tasks.workunit.client.0.smithi081.stdout: create 114/30 file after the snapshot 2023-10-25T23:37:34.676 INFO:tasks.workunit.client.0.smithi081.stdout: create 114/31 file after the snapshot 2023-10-25T23:37:34.677 INFO:tasks.workunit.client.0.smithi081.stdout: create 114/32 file after the snapshot 2023-10-25T23:37:34.677 INFO:tasks.workunit.client.0.smithi081.stdout: create 114/33 file after the snapshot 2023-10-25T23:37:34.678 INFO:tasks.workunit.client.0.smithi081.stdout: create 114/34 file after the snapshot 2023-10-25T23:37:34.679 INFO:tasks.workunit.client.0.smithi081.stdout: create 114/35 file after the snapshot 2023-10-25T23:37:34.680 INFO:tasks.workunit.client.0.smithi081.stdout: create 114/36 file after the snapshot 2023-10-25T23:37:34.681 INFO:tasks.workunit.client.0.smithi081.stdout: create 114/37 file after the snapshot 2023-10-25T23:37:34.682 INFO:tasks.workunit.client.0.smithi081.stdout: create 114/38 file after the snapshot 2023-10-25T23:37:34.683 INFO:tasks.workunit.client.0.smithi081.stdout: create 114/39 file after the snapshot 2023-10-25T23:37:34.684 INFO:tasks.workunit.client.0.smithi081.stdout: create 115/.snap/snap-subdir-test 2023-10-25T23:37:34.714 INFO:tasks.workunit.client.0.smithi081.stdout: create 115/30 file after the snapshot 2023-10-25T23:37:34.716 INFO:tasks.workunit.client.0.smithi081.stdout: create 115/31 file after the snapshot 2023-10-25T23:37:34.717 INFO:tasks.workunit.client.0.smithi081.stdout: create 115/32 file after the snapshot 2023-10-25T23:37:34.719 INFO:tasks.workunit.client.0.smithi081.stdout: create 115/33 file after the snapshot 2023-10-25T23:37:34.720 INFO:tasks.workunit.client.0.smithi081.stdout: create 115/34 file after the snapshot 2023-10-25T23:37:34.721 INFO:tasks.workunit.client.0.smithi081.stdout: create 115/35 file after the snapshot 2023-10-25T23:37:34.723 INFO:tasks.workunit.client.0.smithi081.stdout: create 115/36 file after the snapshot 2023-10-25T23:37:34.724 INFO:tasks.workunit.client.0.smithi081.stdout: create 115/37 file after the snapshot 2023-10-25T23:37:34.725 INFO:tasks.workunit.client.0.smithi081.stdout: create 115/38 file after the snapshot 2023-10-25T23:37:34.727 INFO:tasks.workunit.client.0.smithi081.stdout: create 115/39 file after the snapshot 2023-10-25T23:37:34.728 INFO:tasks.workunit.client.0.smithi081.stdout: create 116/.snap/snap-subdir-test 2023-10-25T23:37:34.758 INFO:tasks.workunit.client.0.smithi081.stdout: create 116/30 file after the snapshot 2023-10-25T23:37:34.759 INFO:tasks.workunit.client.0.smithi081.stdout: create 116/31 file after the snapshot 2023-10-25T23:37:34.761 INFO:tasks.workunit.client.0.smithi081.stdout: create 116/32 file after the snapshot 2023-10-25T23:37:34.762 INFO:tasks.workunit.client.0.smithi081.stdout: create 116/33 file after the snapshot 2023-10-25T23:37:34.764 INFO:tasks.workunit.client.0.smithi081.stdout: create 116/34 file after the snapshot 2023-10-25T23:37:34.765 INFO:tasks.workunit.client.0.smithi081.stdout: create 116/35 file after the snapshot 2023-10-25T23:37:34.766 INFO:tasks.workunit.client.0.smithi081.stdout: create 116/36 file after the snapshot 2023-10-25T23:37:34.767 INFO:tasks.workunit.client.0.smithi081.stdout: create 116/37 file after the snapshot 2023-10-25T23:37:34.768 INFO:tasks.workunit.client.0.smithi081.stdout: create 116/38 file after the snapshot 2023-10-25T23:37:34.769 INFO:tasks.workunit.client.0.smithi081.stdout: create 116/39 file after the snapshot 2023-10-25T23:37:34.770 INFO:tasks.workunit.client.0.smithi081.stdout: create 117/.snap/snap-subdir-test 2023-10-25T23:37:34.802 INFO:tasks.workunit.client.0.smithi081.stdout: create 117/30 file after the snapshot 2023-10-25T23:37:34.804 INFO:tasks.workunit.client.0.smithi081.stdout: create 117/31 file after the snapshot 2023-10-25T23:37:34.805 INFO:tasks.workunit.client.0.smithi081.stdout: create 117/32 file after the snapshot 2023-10-25T23:37:34.807 INFO:tasks.workunit.client.0.smithi081.stdout: create 117/33 file after the snapshot 2023-10-25T23:37:34.808 INFO:tasks.workunit.client.0.smithi081.stdout: create 117/34 file after the snapshot 2023-10-25T23:37:34.809 INFO:tasks.workunit.client.0.smithi081.stdout: create 117/35 file after the snapshot 2023-10-25T23:37:34.811 INFO:tasks.workunit.client.0.smithi081.stdout: create 117/36 file after the snapshot 2023-10-25T23:37:34.812 INFO:tasks.workunit.client.0.smithi081.stdout: create 117/37 file after the snapshot 2023-10-25T23:37:34.813 INFO:tasks.workunit.client.0.smithi081.stdout: create 117/38 file after the snapshot 2023-10-25T23:37:34.815 INFO:tasks.workunit.client.0.smithi081.stdout: create 117/39 file after the snapshot 2023-10-25T23:37:34.816 INFO:tasks.workunit.client.0.smithi081.stdout: create 118/.snap/snap-subdir-test 2023-10-25T23:37:34.847 INFO:tasks.workunit.client.0.smithi081.stdout: create 118/30 file after the snapshot 2023-10-25T23:37:34.848 INFO:tasks.workunit.client.0.smithi081.stdout: create 118/31 file after the snapshot 2023-10-25T23:37:34.849 INFO:tasks.workunit.client.0.smithi081.stdout: create 118/32 file after the snapshot 2023-10-25T23:37:34.850 INFO:tasks.workunit.client.0.smithi081.stdout: create 118/33 file after the snapshot 2023-10-25T23:37:34.851 INFO:tasks.workunit.client.0.smithi081.stdout: create 118/34 file after the snapshot 2023-10-25T23:37:34.852 INFO:tasks.workunit.client.0.smithi081.stdout: create 118/35 file after the snapshot 2023-10-25T23:37:34.853 INFO:tasks.workunit.client.0.smithi081.stdout: create 118/36 file after the snapshot 2023-10-25T23:37:34.854 INFO:tasks.workunit.client.0.smithi081.stdout: create 118/37 file after the snapshot 2023-10-25T23:37:34.854 INFO:tasks.workunit.client.0.smithi081.stdout: create 118/38 file after the snapshot 2023-10-25T23:37:34.855 INFO:tasks.workunit.client.0.smithi081.stdout: create 118/39 file after the snapshot 2023-10-25T23:37:34.856 INFO:tasks.workunit.client.0.smithi081.stdout: create 119/.snap/snap-subdir-test 2023-10-25T23:37:34.888 INFO:tasks.workunit.client.0.smithi081.stdout: create 119/30 file after the snapshot 2023-10-25T23:37:34.889 INFO:tasks.workunit.client.0.smithi081.stdout: create 119/31 file after the snapshot 2023-10-25T23:37:34.890 INFO:tasks.workunit.client.0.smithi081.stdout: create 119/32 file after the snapshot 2023-10-25T23:37:34.891 INFO:tasks.workunit.client.0.smithi081.stdout: create 119/33 file after the snapshot 2023-10-25T23:37:34.892 INFO:tasks.workunit.client.0.smithi081.stdout: create 119/34 file after the snapshot 2023-10-25T23:37:34.896 INFO:tasks.workunit.client.0.smithi081.stdout: create 119/35 file after the snapshot 2023-10-25T23:37:34.896 INFO:tasks.workunit.client.0.smithi081.stdout: create 119/36 file after the snapshot 2023-10-25T23:37:34.896 INFO:tasks.workunit.client.0.smithi081.stdout: create 119/37 file after the snapshot 2023-10-25T23:37:34.896 INFO:tasks.workunit.client.0.smithi081.stdout: create 119/38 file after the snapshot 2023-10-25T23:37:34.897 INFO:tasks.workunit.client.0.smithi081.stdout: create 119/39 file after the snapshot 2023-10-25T23:37:34.898 INFO:tasks.workunit.client.0.smithi081.stdout: create 120/.snap/snap-subdir-test 2023-10-25T23:37:34.929 INFO:tasks.workunit.client.0.smithi081.stdout: create 120/30 file after the snapshot 2023-10-25T23:37:34.930 INFO:tasks.workunit.client.0.smithi081.stdout: create 120/31 file after the snapshot 2023-10-25T23:37:34.931 INFO:tasks.workunit.client.0.smithi081.stdout: create 120/32 file after the snapshot 2023-10-25T23:37:34.932 INFO:tasks.workunit.client.0.smithi081.stdout: create 120/33 file after the snapshot 2023-10-25T23:37:34.933 INFO:tasks.workunit.client.0.smithi081.stdout: create 120/34 file after the snapshot 2023-10-25T23:37:34.934 INFO:tasks.workunit.client.0.smithi081.stdout: create 120/35 file after the snapshot 2023-10-25T23:37:34.935 INFO:tasks.workunit.client.0.smithi081.stdout: create 120/36 file after the snapshot 2023-10-25T23:37:34.936 INFO:tasks.workunit.client.0.smithi081.stdout: create 120/37 file after the snapshot 2023-10-25T23:37:34.936 INFO:tasks.workunit.client.0.smithi081.stdout: create 120/38 file after the snapshot 2023-10-25T23:37:34.937 INFO:tasks.workunit.client.0.smithi081.stdout: create 120/39 file after the snapshot 2023-10-25T23:37:34.938 INFO:tasks.workunit.client.0.smithi081.stdout: create 121/.snap/snap-subdir-test 2023-10-25T23:37:34.977 INFO:tasks.workunit.client.0.smithi081.stdout: create 121/30 file after the snapshot 2023-10-25T23:37:34.978 INFO:tasks.workunit.client.0.smithi081.stdout: create 121/31 file after the snapshot 2023-10-25T23:37:34.979 INFO:tasks.workunit.client.0.smithi081.stdout: create 121/32 file after the snapshot 2023-10-25T23:37:34.980 INFO:tasks.workunit.client.0.smithi081.stdout: create 121/33 file after the snapshot 2023-10-25T23:37:34.981 INFO:tasks.workunit.client.0.smithi081.stdout: create 121/34 file after the snapshot 2023-10-25T23:37:34.982 INFO:tasks.workunit.client.0.smithi081.stdout: create 121/35 file after the snapshot 2023-10-25T23:37:34.983 INFO:tasks.workunit.client.0.smithi081.stdout: create 121/36 file after the snapshot 2023-10-25T23:37:34.984 INFO:tasks.workunit.client.0.smithi081.stdout: create 121/37 file after the snapshot 2023-10-25T23:37:34.985 INFO:tasks.workunit.client.0.smithi081.stdout: create 121/38 file after the snapshot 2023-10-25T23:37:34.986 INFO:tasks.workunit.client.0.smithi081.stdout: create 121/39 file after the snapshot 2023-10-25T23:37:34.986 INFO:tasks.workunit.client.0.smithi081.stdout: create 122/.snap/snap-subdir-test 2023-10-25T23:37:35.018 INFO:tasks.workunit.client.0.smithi081.stdout: create 122/30 file after the snapshot 2023-10-25T23:37:35.019 INFO:tasks.workunit.client.0.smithi081.stdout: create 122/31 file after the snapshot 2023-10-25T23:37:35.020 INFO:tasks.workunit.client.0.smithi081.stdout: create 122/32 file after the snapshot 2023-10-25T23:37:35.021 INFO:tasks.workunit.client.0.smithi081.stdout: create 122/33 file after the snapshot 2023-10-25T23:37:35.022 INFO:tasks.workunit.client.0.smithi081.stdout: create 122/34 file after the snapshot 2023-10-25T23:37:35.023 INFO:tasks.workunit.client.0.smithi081.stdout: create 122/35 file after the snapshot 2023-10-25T23:37:35.023 INFO:tasks.workunit.client.0.smithi081.stdout: create 122/36 file after the snapshot 2023-10-25T23:37:35.025 INFO:tasks.workunit.client.0.smithi081.stdout: create 122/37 file after the snapshot 2023-10-25T23:37:35.025 INFO:tasks.workunit.client.0.smithi081.stdout: create 122/38 file after the snapshot 2023-10-25T23:37:35.027 INFO:tasks.workunit.client.0.smithi081.stdout: create 122/39 file after the snapshot 2023-10-25T23:37:35.027 INFO:tasks.workunit.client.0.smithi081.stdout: create 123/.snap/snap-subdir-test 2023-10-25T23:37:35.065 INFO:tasks.workunit.client.0.smithi081.stdout: create 123/30 file after the snapshot 2023-10-25T23:37:35.067 INFO:tasks.workunit.client.0.smithi081.stdout: create 123/31 file after the snapshot 2023-10-25T23:37:35.068 INFO:tasks.workunit.client.0.smithi081.stdout: create 123/32 file after the snapshot 2023-10-25T23:37:35.068 INFO:tasks.workunit.client.0.smithi081.stdout: create 123/33 file after the snapshot 2023-10-25T23:37:35.069 INFO:tasks.workunit.client.0.smithi081.stdout: create 123/34 file after the snapshot 2023-10-25T23:37:35.070 INFO:tasks.workunit.client.0.smithi081.stdout: create 123/35 file after the snapshot 2023-10-25T23:37:35.071 INFO:tasks.workunit.client.0.smithi081.stdout: create 123/36 file after the snapshot 2023-10-25T23:37:35.072 INFO:tasks.workunit.client.0.smithi081.stdout: create 123/37 file after the snapshot 2023-10-25T23:37:35.073 INFO:tasks.workunit.client.0.smithi081.stdout: create 123/38 file after the snapshot 2023-10-25T23:37:35.074 INFO:tasks.workunit.client.0.smithi081.stdout: create 123/39 file after the snapshot 2023-10-25T23:37:35.075 INFO:tasks.workunit.client.0.smithi081.stdout: create 124/.snap/snap-subdir-test 2023-10-25T23:37:35.106 INFO:tasks.workunit.client.0.smithi081.stdout: create 124/30 file after the snapshot 2023-10-25T23:37:35.107 INFO:tasks.workunit.client.0.smithi081.stdout: create 124/31 file after the snapshot 2023-10-25T23:37:35.108 INFO:tasks.workunit.client.0.smithi081.stdout: create 124/32 file after the snapshot 2023-10-25T23:37:35.109 INFO:tasks.workunit.client.0.smithi081.stdout: create 124/33 file after the snapshot 2023-10-25T23:37:35.109 INFO:tasks.workunit.client.0.smithi081.stdout: create 124/34 file after the snapshot 2023-10-25T23:37:35.110 INFO:tasks.workunit.client.0.smithi081.stdout: create 124/35 file after the snapshot 2023-10-25T23:37:35.111 INFO:tasks.workunit.client.0.smithi081.stdout: create 124/36 file after the snapshot 2023-10-25T23:37:35.114 INFO:tasks.workunit.client.0.smithi081.stdout: create 124/37 file after the snapshot 2023-10-25T23:37:35.114 INFO:tasks.workunit.client.0.smithi081.stdout: create 124/38 file after the snapshot 2023-10-25T23:37:35.114 INFO:tasks.workunit.client.0.smithi081.stdout: create 124/39 file after the snapshot 2023-10-25T23:37:35.115 INFO:tasks.workunit.client.0.smithi081.stdout: create 125/.snap/snap-subdir-test 2023-10-25T23:37:35.146 INFO:tasks.workunit.client.0.smithi081.stdout: create 125/30 file after the snapshot 2023-10-25T23:37:35.147 INFO:tasks.workunit.client.0.smithi081.stdout: create 125/31 file after the snapshot 2023-10-25T23:37:35.148 INFO:tasks.workunit.client.0.smithi081.stdout: create 125/32 file after the snapshot 2023-10-25T23:37:35.149 INFO:tasks.workunit.client.0.smithi081.stdout: create 125/33 file after the snapshot 2023-10-25T23:37:35.150 INFO:tasks.workunit.client.0.smithi081.stdout: create 125/34 file after the snapshot 2023-10-25T23:37:35.151 INFO:tasks.workunit.client.0.smithi081.stdout: create 125/35 file after the snapshot 2023-10-25T23:37:35.151 INFO:tasks.workunit.client.0.smithi081.stdout: create 125/36 file after the snapshot 2023-10-25T23:37:35.153 INFO:tasks.workunit.client.0.smithi081.stdout: create 125/37 file after the snapshot 2023-10-25T23:37:35.153 INFO:tasks.workunit.client.0.smithi081.stdout: create 125/38 file after the snapshot 2023-10-25T23:37:35.154 INFO:tasks.workunit.client.0.smithi081.stdout: create 125/39 file after the snapshot 2023-10-25T23:37:35.155 INFO:tasks.workunit.client.0.smithi081.stdout: create 126/.snap/snap-subdir-test 2023-10-25T23:37:35.186 INFO:tasks.workunit.client.0.smithi081.stdout: create 126/30 file after the snapshot 2023-10-25T23:37:35.187 INFO:tasks.workunit.client.0.smithi081.stdout: create 126/31 file after the snapshot 2023-10-25T23:37:35.188 INFO:tasks.workunit.client.0.smithi081.stdout: create 126/32 file after the snapshot 2023-10-25T23:37:35.189 INFO:tasks.workunit.client.0.smithi081.stdout: create 126/33 file after the snapshot 2023-10-25T23:37:35.190 INFO:tasks.workunit.client.0.smithi081.stdout: create 126/34 file after the snapshot 2023-10-25T23:37:35.191 INFO:tasks.workunit.client.0.smithi081.stdout: create 126/35 file after the snapshot 2023-10-25T23:37:35.192 INFO:tasks.workunit.client.0.smithi081.stdout: create 126/36 file after the snapshot 2023-10-25T23:37:35.193 INFO:tasks.workunit.client.0.smithi081.stdout: create 126/37 file after the snapshot 2023-10-25T23:37:35.193 INFO:tasks.workunit.client.0.smithi081.stdout: create 126/38 file after the snapshot 2023-10-25T23:37:35.194 INFO:tasks.workunit.client.0.smithi081.stdout: create 126/39 file after the snapshot 2023-10-25T23:37:35.195 INFO:tasks.workunit.client.0.smithi081.stdout: create 127/.snap/snap-subdir-test 2023-10-25T23:37:35.226 INFO:tasks.workunit.client.0.smithi081.stdout: create 127/30 file after the snapshot 2023-10-25T23:37:35.227 INFO:tasks.workunit.client.0.smithi081.stdout: create 127/31 file after the snapshot 2023-10-25T23:37:35.228 INFO:tasks.workunit.client.0.smithi081.stdout: create 127/32 file after the snapshot 2023-10-25T23:37:35.229 INFO:tasks.workunit.client.0.smithi081.stdout: create 127/33 file after the snapshot 2023-10-25T23:37:35.230 INFO:tasks.workunit.client.0.smithi081.stdout: create 127/34 file after the snapshot 2023-10-25T23:37:35.231 INFO:tasks.workunit.client.0.smithi081.stdout: create 127/35 file after the snapshot 2023-10-25T23:37:35.232 INFO:tasks.workunit.client.0.smithi081.stdout: create 127/36 file after the snapshot 2023-10-25T23:37:35.232 INFO:tasks.workunit.client.0.smithi081.stdout: create 127/37 file after the snapshot 2023-10-25T23:37:35.233 INFO:tasks.workunit.client.0.smithi081.stdout: create 127/38 file after the snapshot 2023-10-25T23:37:35.234 INFO:tasks.workunit.client.0.smithi081.stdout: create 127/39 file after the snapshot 2023-10-25T23:37:35.235 INFO:tasks.workunit.client.0.smithi081.stdout: create 128/.snap/snap-subdir-test 2023-10-25T23:37:35.266 INFO:tasks.workunit.client.0.smithi081.stdout: create 128/30 file after the snapshot 2023-10-25T23:37:35.266 INFO:tasks.workunit.client.0.smithi081.stdout: create 128/31 file after the snapshot 2023-10-25T23:37:35.268 INFO:tasks.workunit.client.0.smithi081.stdout: create 128/32 file after the snapshot 2023-10-25T23:37:35.269 INFO:tasks.workunit.client.0.smithi081.stdout: create 128/33 file after the snapshot 2023-10-25T23:37:35.270 INFO:tasks.workunit.client.0.smithi081.stdout: create 128/34 file after the snapshot 2023-10-25T23:37:35.271 INFO:tasks.workunit.client.0.smithi081.stdout: create 128/35 file after the snapshot 2023-10-25T23:37:35.272 INFO:tasks.workunit.client.0.smithi081.stdout: create 128/36 file after the snapshot 2023-10-25T23:37:35.273 INFO:tasks.workunit.client.0.smithi081.stdout: create 128/37 file after the snapshot 2023-10-25T23:37:35.273 INFO:tasks.workunit.client.0.smithi081.stdout: create 128/38 file after the snapshot 2023-10-25T23:37:35.274 INFO:tasks.workunit.client.0.smithi081.stdout: create 128/39 file after the snapshot 2023-10-25T23:37:35.275 INFO:tasks.workunit.client.0.smithi081.stdout: create 129/.snap/snap-subdir-test 2023-10-25T23:37:35.310 INFO:tasks.workunit.client.0.smithi081.stdout: create 129/30 file after the snapshot 2023-10-25T23:37:35.311 INFO:tasks.workunit.client.0.smithi081.stdout: create 129/31 file after the snapshot 2023-10-25T23:37:35.312 INFO:tasks.workunit.client.0.smithi081.stdout: create 129/32 file after the snapshot 2023-10-25T23:37:35.313 INFO:tasks.workunit.client.0.smithi081.stdout: create 129/33 file after the snapshot 2023-10-25T23:37:35.313 INFO:tasks.workunit.client.0.smithi081.stdout: create 129/34 file after the snapshot 2023-10-25T23:37:35.318 INFO:tasks.workunit.client.0.smithi081.stdout: create 129/35 file after the snapshot 2023-10-25T23:37:35.318 INFO:tasks.workunit.client.0.smithi081.stdout: create 129/36 file after the snapshot 2023-10-25T23:37:35.319 INFO:tasks.workunit.client.0.smithi081.stdout: create 129/37 file after the snapshot 2023-10-25T23:37:35.319 INFO:tasks.workunit.client.0.smithi081.stdout: create 129/38 file after the snapshot 2023-10-25T23:37:35.319 INFO:tasks.workunit.client.0.smithi081.stdout: create 129/39 file after the snapshot 2023-10-25T23:37:35.320 INFO:tasks.workunit.client.0.smithi081.stdout: create 130/.snap/snap-subdir-test 2023-10-25T23:37:35.351 INFO:tasks.workunit.client.0.smithi081.stdout: create 130/30 file after the snapshot 2023-10-25T23:37:35.365 INFO:tasks.workunit.client.0.smithi081.stdout: create 130/31 file after the snapshot 2023-10-25T23:37:35.365 INFO:tasks.workunit.client.0.smithi081.stdout: create 130/32 file after the snapshot 2023-10-25T23:37:35.366 INFO:tasks.workunit.client.0.smithi081.stdout: create 130/33 file after the snapshot 2023-10-25T23:37:35.366 INFO:tasks.workunit.client.0.smithi081.stdout: create 130/34 file after the snapshot 2023-10-25T23:37:35.367 INFO:tasks.workunit.client.0.smithi081.stdout: create 130/35 file after the snapshot 2023-10-25T23:37:35.367 INFO:tasks.workunit.client.0.smithi081.stdout: create 130/36 file after the snapshot 2023-10-25T23:37:35.368 INFO:tasks.workunit.client.0.smithi081.stdout: create 130/37 file after the snapshot 2023-10-25T23:37:35.369 INFO:tasks.workunit.client.0.smithi081.stdout: create 130/38 file after the snapshot 2023-10-25T23:37:35.369 INFO:tasks.workunit.client.0.smithi081.stdout: create 130/39 file after the snapshot 2023-10-25T23:37:35.370 INFO:tasks.workunit.client.0.smithi081.stdout: create 131/.snap/snap-subdir-test 2023-10-25T23:37:35.398 INFO:tasks.workunit.client.0.smithi081.stdout: create 131/30 file after the snapshot 2023-10-25T23:37:35.400 INFO:tasks.workunit.client.0.smithi081.stdout: create 131/31 file after the snapshot 2023-10-25T23:37:35.401 INFO:tasks.workunit.client.0.smithi081.stdout: create 131/32 file after the snapshot 2023-10-25T23:37:35.402 INFO:tasks.workunit.client.0.smithi081.stdout: create 131/33 file after the snapshot 2023-10-25T23:37:35.404 INFO:tasks.workunit.client.0.smithi081.stdout: create 131/34 file after the snapshot 2023-10-25T23:37:35.405 INFO:tasks.workunit.client.0.smithi081.stdout: create 131/35 file after the snapshot 2023-10-25T23:37:35.405 INFO:tasks.workunit.client.0.smithi081.stdout: create 131/36 file after the snapshot 2023-10-25T23:37:35.406 INFO:tasks.workunit.client.0.smithi081.stdout: create 131/37 file after the snapshot 2023-10-25T23:37:35.408 INFO:tasks.workunit.client.0.smithi081.stdout: create 131/38 file after the snapshot 2023-10-25T23:37:35.409 INFO:tasks.workunit.client.0.smithi081.stdout: create 131/39 file after the snapshot 2023-10-25T23:37:35.410 INFO:tasks.workunit.client.0.smithi081.stdout: create 132/.snap/snap-subdir-test 2023-10-25T23:37:35.440 INFO:tasks.workunit.client.0.smithi081.stdout: create 132/30 file after the snapshot 2023-10-25T23:37:35.441 INFO:tasks.workunit.client.0.smithi081.stdout: create 132/31 file after the snapshot 2023-10-25T23:37:35.443 INFO:tasks.workunit.client.0.smithi081.stdout: create 132/32 file after the snapshot 2023-10-25T23:37:35.445 INFO:tasks.workunit.client.0.smithi081.stdout: create 132/33 file after the snapshot 2023-10-25T23:37:35.445 INFO:tasks.workunit.client.0.smithi081.stdout: create 132/34 file after the snapshot 2023-10-25T23:37:35.447 INFO:tasks.workunit.client.0.smithi081.stdout: create 132/35 file after the snapshot 2023-10-25T23:37:35.448 INFO:tasks.workunit.client.0.smithi081.stdout: create 132/36 file after the snapshot 2023-10-25T23:37:35.450 INFO:tasks.workunit.client.0.smithi081.stdout: create 132/37 file after the snapshot 2023-10-25T23:37:35.451 INFO:tasks.workunit.client.0.smithi081.stdout: create 132/38 file after the snapshot 2023-10-25T23:37:35.453 INFO:tasks.workunit.client.0.smithi081.stdout: create 132/39 file after the snapshot 2023-10-25T23:37:35.455 INFO:tasks.workunit.client.0.smithi081.stdout: create 133/.snap/snap-subdir-test 2023-10-25T23:37:35.484 INFO:tasks.workunit.client.0.smithi081.stdout: create 133/30 file after the snapshot 2023-10-25T23:37:35.485 INFO:tasks.workunit.client.0.smithi081.stdout: create 133/31 file after the snapshot 2023-10-25T23:37:35.486 INFO:tasks.workunit.client.0.smithi081.stdout: create 133/32 file after the snapshot 2023-10-25T23:37:35.487 INFO:tasks.workunit.client.0.smithi081.stdout: create 133/33 file after the snapshot 2023-10-25T23:37:35.488 INFO:tasks.workunit.client.0.smithi081.stdout: create 133/34 file after the snapshot 2023-10-25T23:37:35.489 INFO:tasks.workunit.client.0.smithi081.stdout: create 133/35 file after the snapshot 2023-10-25T23:37:35.489 INFO:tasks.workunit.client.0.smithi081.stdout: create 133/36 file after the snapshot 2023-10-25T23:37:35.490 INFO:tasks.workunit.client.0.smithi081.stdout: create 133/37 file after the snapshot 2023-10-25T23:37:35.491 INFO:tasks.workunit.client.0.smithi081.stdout: create 133/38 file after the snapshot 2023-10-25T23:37:35.492 INFO:tasks.workunit.client.0.smithi081.stdout: create 133/39 file after the snapshot 2023-10-25T23:37:35.495 INFO:tasks.workunit.client.0.smithi081.stdout: create 134/.snap/snap-subdir-test 2023-10-25T23:37:35.525 INFO:tasks.workunit.client.0.smithi081.stdout: create 134/30 file after the snapshot 2023-10-25T23:37:35.529 INFO:tasks.workunit.client.0.smithi081.stdout: create 134/31 file after the snapshot 2023-10-25T23:37:35.530 INFO:tasks.workunit.client.0.smithi081.stdout: create 134/32 file after the snapshot 2023-10-25T23:37:35.530 INFO:tasks.workunit.client.0.smithi081.stdout: create 134/33 file after the snapshot 2023-10-25T23:37:35.530 INFO:tasks.workunit.client.0.smithi081.stdout: create 134/34 file after the snapshot 2023-10-25T23:37:35.530 INFO:tasks.workunit.client.0.smithi081.stdout: create 134/35 file after the snapshot 2023-10-25T23:37:35.531 INFO:tasks.workunit.client.0.smithi081.stdout: create 134/36 file after the snapshot 2023-10-25T23:37:35.531 INFO:tasks.workunit.client.0.smithi081.stdout: create 134/37 file after the snapshot 2023-10-25T23:37:35.532 INFO:tasks.workunit.client.0.smithi081.stdout: create 134/38 file after the snapshot 2023-10-25T23:37:35.533 INFO:tasks.workunit.client.0.smithi081.stdout: create 134/39 file after the snapshot 2023-10-25T23:37:35.534 INFO:tasks.workunit.client.0.smithi081.stdout: create 135/.snap/snap-subdir-test 2023-10-25T23:37:35.568 INFO:tasks.workunit.client.0.smithi081.stdout: create 135/30 file after the snapshot 2023-10-25T23:37:35.569 INFO:tasks.workunit.client.0.smithi081.stdout: create 135/31 file after the snapshot 2023-10-25T23:37:35.569 INFO:tasks.workunit.client.0.smithi081.stdout: create 135/32 file after the snapshot 2023-10-25T23:37:35.570 INFO:tasks.workunit.client.0.smithi081.stdout: create 135/33 file after the snapshot 2023-10-25T23:37:35.571 INFO:tasks.workunit.client.0.smithi081.stdout: create 135/34 file after the snapshot 2023-10-25T23:37:35.572 INFO:tasks.workunit.client.0.smithi081.stdout: create 135/35 file after the snapshot 2023-10-25T23:37:35.573 INFO:tasks.workunit.client.0.smithi081.stdout: create 135/36 file after the snapshot 2023-10-25T23:37:35.574 INFO:tasks.workunit.client.0.smithi081.stdout: create 135/37 file after the snapshot 2023-10-25T23:37:35.575 INFO:tasks.workunit.client.0.smithi081.stdout: create 135/38 file after the snapshot 2023-10-25T23:37:35.576 INFO:tasks.workunit.client.0.smithi081.stdout: create 135/39 file after the snapshot 2023-10-25T23:37:35.576 INFO:tasks.workunit.client.0.smithi081.stdout: create 136/.snap/snap-subdir-test 2023-10-25T23:37:35.615 INFO:tasks.workunit.client.0.smithi081.stdout: create 136/30 file after the snapshot 2023-10-25T23:37:35.616 INFO:tasks.workunit.client.0.smithi081.stdout: create 136/31 file after the snapshot 2023-10-25T23:37:35.617 INFO:tasks.workunit.client.0.smithi081.stdout: create 136/32 file after the snapshot 2023-10-25T23:37:35.617 INFO:tasks.workunit.client.0.smithi081.stdout: create 136/33 file after the snapshot 2023-10-25T23:37:35.618 INFO:tasks.workunit.client.0.smithi081.stdout: create 136/34 file after the snapshot 2023-10-25T23:37:35.619 INFO:tasks.workunit.client.0.smithi081.stdout: create 136/35 file after the snapshot 2023-10-25T23:37:35.620 INFO:tasks.workunit.client.0.smithi081.stdout: create 136/36 file after the snapshot 2023-10-25T23:37:35.621 INFO:tasks.workunit.client.0.smithi081.stdout: create 136/37 file after the snapshot 2023-10-25T23:37:35.621 INFO:tasks.workunit.client.0.smithi081.stdout: create 136/38 file after the snapshot 2023-10-25T23:37:35.622 INFO:tasks.workunit.client.0.smithi081.stdout: create 136/39 file after the snapshot 2023-10-25T23:37:35.623 INFO:tasks.workunit.client.0.smithi081.stdout: create 137/.snap/snap-subdir-test 2023-10-25T23:37:35.655 INFO:tasks.workunit.client.0.smithi081.stdout: create 137/30 file after the snapshot 2023-10-25T23:37:35.656 INFO:tasks.workunit.client.0.smithi081.stdout: create 137/31 file after the snapshot 2023-10-25T23:37:35.657 INFO:tasks.workunit.client.0.smithi081.stdout: create 137/32 file after the snapshot 2023-10-25T23:37:35.658 INFO:tasks.workunit.client.0.smithi081.stdout: create 137/33 file after the snapshot 2023-10-25T23:37:35.659 INFO:tasks.workunit.client.0.smithi081.stdout: create 137/34 file after the snapshot 2023-10-25T23:37:35.660 INFO:tasks.workunit.client.0.smithi081.stdout: create 137/35 file after the snapshot 2023-10-25T23:37:35.660 INFO:tasks.workunit.client.0.smithi081.stdout: create 137/36 file after the snapshot 2023-10-25T23:37:35.661 INFO:tasks.workunit.client.0.smithi081.stdout: create 137/37 file after the snapshot 2023-10-25T23:37:35.662 INFO:tasks.workunit.client.0.smithi081.stdout: create 137/38 file after the snapshot 2023-10-25T23:37:35.663 INFO:tasks.workunit.client.0.smithi081.stdout: create 137/39 file after the snapshot 2023-10-25T23:37:35.664 INFO:tasks.workunit.client.0.smithi081.stdout: create 138/.snap/snap-subdir-test 2023-10-25T23:37:35.693 INFO:tasks.workunit.client.0.smithi081.stdout: create 138/30 file after the snapshot 2023-10-25T23:37:35.694 INFO:tasks.workunit.client.0.smithi081.stdout: create 138/31 file after the snapshot 2023-10-25T23:37:35.695 INFO:tasks.workunit.client.0.smithi081.stdout: create 138/32 file after the snapshot 2023-10-25T23:37:35.696 INFO:tasks.workunit.client.0.smithi081.stdout: create 138/33 file after the snapshot 2023-10-25T23:37:35.696 INFO:tasks.workunit.client.0.smithi081.stdout: create 138/34 file after the snapshot 2023-10-25T23:37:35.697 INFO:tasks.workunit.client.0.smithi081.stdout: create 138/35 file after the snapshot 2023-10-25T23:37:35.698 INFO:tasks.workunit.client.0.smithi081.stdout: create 138/36 file after the snapshot 2023-10-25T23:37:35.699 INFO:tasks.workunit.client.0.smithi081.stdout: create 138/37 file after the snapshot 2023-10-25T23:37:35.700 INFO:tasks.workunit.client.0.smithi081.stdout: create 138/38 file after the snapshot 2023-10-25T23:37:35.700 INFO:tasks.workunit.client.0.smithi081.stdout: create 138/39 file after the snapshot 2023-10-25T23:37:35.701 INFO:tasks.workunit.client.0.smithi081.stdout: create 139/.snap/snap-subdir-test 2023-10-25T23:37:35.731 INFO:tasks.workunit.client.0.smithi081.stdout: create 139/30 file after the snapshot 2023-10-25T23:37:35.732 INFO:tasks.workunit.client.0.smithi081.stdout: create 139/31 file after the snapshot 2023-10-25T23:37:35.733 INFO:tasks.workunit.client.0.smithi081.stdout: create 139/32 file after the snapshot 2023-10-25T23:37:35.733 INFO:tasks.workunit.client.0.smithi081.stdout: create 139/33 file after the snapshot 2023-10-25T23:37:35.734 INFO:tasks.workunit.client.0.smithi081.stdout: create 139/34 file after the snapshot 2023-10-25T23:37:35.735 INFO:tasks.workunit.client.0.smithi081.stdout: create 139/35 file after the snapshot 2023-10-25T23:37:35.736 INFO:tasks.workunit.client.0.smithi081.stdout: create 139/36 file after the snapshot 2023-10-25T23:37:35.737 INFO:tasks.workunit.client.0.smithi081.stdout: create 139/37 file after the snapshot 2023-10-25T23:37:35.738 INFO:tasks.workunit.client.0.smithi081.stdout: create 139/38 file after the snapshot 2023-10-25T23:37:35.739 INFO:tasks.workunit.client.0.smithi081.stdout: create 139/39 file after the snapshot 2023-10-25T23:37:35.740 INFO:tasks.workunit.client.0.smithi081.stdout: create 140/.snap/snap-subdir-test 2023-10-25T23:37:35.769 INFO:tasks.workunit.client.0.smithi081.stdout: create 140/30 file after the snapshot 2023-10-25T23:37:35.770 INFO:tasks.workunit.client.0.smithi081.stdout: create 140/31 file after the snapshot 2023-10-25T23:37:35.771 INFO:tasks.workunit.client.0.smithi081.stdout: create 140/32 file after the snapshot 2023-10-25T23:37:35.772 INFO:tasks.workunit.client.0.smithi081.stdout: create 140/33 file after the snapshot 2023-10-25T23:37:35.773 INFO:tasks.workunit.client.0.smithi081.stdout: create 140/34 file after the snapshot 2023-10-25T23:37:35.774 INFO:tasks.workunit.client.0.smithi081.stdout: create 140/35 file after the snapshot 2023-10-25T23:37:35.775 INFO:tasks.workunit.client.0.smithi081.stdout: create 140/36 file after the snapshot 2023-10-25T23:37:35.776 INFO:tasks.workunit.client.0.smithi081.stdout: create 140/37 file after the snapshot 2023-10-25T23:37:35.776 INFO:tasks.workunit.client.0.smithi081.stdout: create 140/38 file after the snapshot 2023-10-25T23:37:35.777 INFO:tasks.workunit.client.0.smithi081.stdout: create 140/39 file after the snapshot 2023-10-25T23:37:35.778 INFO:tasks.workunit.client.0.smithi081.stdout: create 141/.snap/snap-subdir-test 2023-10-25T23:37:35.808 INFO:tasks.workunit.client.0.smithi081.stdout: create 141/30 file after the snapshot 2023-10-25T23:37:35.810 INFO:tasks.workunit.client.0.smithi081.stdout: create 141/31 file after the snapshot 2023-10-25T23:37:35.811 INFO:tasks.workunit.client.0.smithi081.stdout: create 141/32 file after the snapshot 2023-10-25T23:37:35.811 INFO:tasks.workunit.client.0.smithi081.stdout: create 141/33 file after the snapshot 2023-10-25T23:37:35.812 INFO:tasks.workunit.client.0.smithi081.stdout: create 141/34 file after the snapshot 2023-10-25T23:37:35.813 INFO:tasks.workunit.client.0.smithi081.stdout: create 141/35 file after the snapshot 2023-10-25T23:37:35.814 INFO:tasks.workunit.client.0.smithi081.stdout: create 141/36 file after the snapshot 2023-10-25T23:37:35.814 INFO:tasks.workunit.client.0.smithi081.stdout: create 141/37 file after the snapshot 2023-10-25T23:37:35.815 INFO:tasks.workunit.client.0.smithi081.stdout: create 141/38 file after the snapshot 2023-10-25T23:37:35.816 INFO:tasks.workunit.client.0.smithi081.stdout: create 141/39 file after the snapshot 2023-10-25T23:37:35.817 INFO:tasks.workunit.client.0.smithi081.stdout: create 142/.snap/snap-subdir-test 2023-10-25T23:37:35.847 INFO:tasks.workunit.client.0.smithi081.stdout: create 142/30 file after the snapshot 2023-10-25T23:37:35.848 INFO:tasks.workunit.client.0.smithi081.stdout: create 142/31 file after the snapshot 2023-10-25T23:37:35.849 INFO:tasks.workunit.client.0.smithi081.stdout: create 142/32 file after the snapshot 2023-10-25T23:37:35.849 INFO:tasks.workunit.client.0.smithi081.stdout: create 142/33 file after the snapshot 2023-10-25T23:37:35.850 INFO:tasks.workunit.client.0.smithi081.stdout: create 142/34 file after the snapshot 2023-10-25T23:37:35.851 INFO:tasks.workunit.client.0.smithi081.stdout: create 142/35 file after the snapshot 2023-10-25T23:37:35.852 INFO:tasks.workunit.client.0.smithi081.stdout: create 142/36 file after the snapshot 2023-10-25T23:37:35.853 INFO:tasks.workunit.client.0.smithi081.stdout: create 142/37 file after the snapshot 2023-10-25T23:37:35.854 INFO:tasks.workunit.client.0.smithi081.stdout: create 142/38 file after the snapshot 2023-10-25T23:37:35.854 INFO:tasks.workunit.client.0.smithi081.stdout: create 142/39 file after the snapshot 2023-10-25T23:37:35.855 INFO:tasks.workunit.client.0.smithi081.stdout: create 143/.snap/snap-subdir-test 2023-10-25T23:37:35.885 INFO:tasks.workunit.client.0.smithi081.stdout: create 143/30 file after the snapshot 2023-10-25T23:37:35.886 INFO:tasks.workunit.client.0.smithi081.stdout: create 143/31 file after the snapshot 2023-10-25T23:37:35.887 INFO:tasks.workunit.client.0.smithi081.stdout: create 143/32 file after the snapshot 2023-10-25T23:37:35.888 INFO:tasks.workunit.client.0.smithi081.stdout: create 143/33 file after the snapshot 2023-10-25T23:37:35.889 INFO:tasks.workunit.client.0.smithi081.stdout: create 143/34 file after the snapshot 2023-10-25T23:37:35.890 INFO:tasks.workunit.client.0.smithi081.stdout: create 143/35 file after the snapshot 2023-10-25T23:37:35.891 INFO:tasks.workunit.client.0.smithi081.stdout: create 143/36 file after the snapshot 2023-10-25T23:37:35.892 INFO:tasks.workunit.client.0.smithi081.stdout: create 143/37 file after the snapshot 2023-10-25T23:37:35.893 INFO:tasks.workunit.client.0.smithi081.stdout: create 143/38 file after the snapshot 2023-10-25T23:37:35.893 INFO:tasks.workunit.client.0.smithi081.stdout: create 143/39 file after the snapshot 2023-10-25T23:37:35.894 INFO:tasks.workunit.client.0.smithi081.stdout: create 144/.snap/snap-subdir-test 2023-10-25T23:37:35.926 INFO:tasks.workunit.client.0.smithi081.stdout: create 144/30 file after the snapshot 2023-10-25T23:37:35.926 INFO:tasks.workunit.client.0.smithi081.stdout: create 144/31 file after the snapshot 2023-10-25T23:37:35.926 INFO:tasks.workunit.client.0.smithi081.stdout: create 144/32 file after the snapshot 2023-10-25T23:37:35.930 INFO:tasks.workunit.client.0.smithi081.stdout: create 144/33 file after the snapshot 2023-10-25T23:37:35.930 INFO:tasks.workunit.client.0.smithi081.stdout: create 144/34 file after the snapshot 2023-10-25T23:37:35.930 INFO:tasks.workunit.client.0.smithi081.stdout: create 144/35 file after the snapshot 2023-10-25T23:37:35.930 INFO:tasks.workunit.client.0.smithi081.stdout: create 144/36 file after the snapshot 2023-10-25T23:37:35.931 INFO:tasks.workunit.client.0.smithi081.stdout: create 144/37 file after the snapshot 2023-10-25T23:37:35.931 INFO:tasks.workunit.client.0.smithi081.stdout: create 144/38 file after the snapshot 2023-10-25T23:37:35.933 INFO:tasks.workunit.client.0.smithi081.stdout: create 144/39 file after the snapshot 2023-10-25T23:37:35.933 INFO:tasks.workunit.client.0.smithi081.stdout: create 145/.snap/snap-subdir-test 2023-10-25T23:37:35.962 INFO:tasks.workunit.client.0.smithi081.stdout: create 145/30 file after the snapshot 2023-10-25T23:37:35.963 INFO:tasks.workunit.client.0.smithi081.stdout: create 145/31 file after the snapshot 2023-10-25T23:37:35.964 INFO:tasks.workunit.client.0.smithi081.stdout: create 145/32 file after the snapshot 2023-10-25T23:37:35.965 INFO:tasks.workunit.client.0.smithi081.stdout: create 145/33 file after the snapshot 2023-10-25T23:37:35.966 INFO:tasks.workunit.client.0.smithi081.stdout: create 145/34 file after the snapshot 2023-10-25T23:37:35.966 INFO:tasks.workunit.client.0.smithi081.stdout: create 145/35 file after the snapshot 2023-10-25T23:37:35.967 INFO:tasks.workunit.client.0.smithi081.stdout: create 145/36 file after the snapshot 2023-10-25T23:37:35.968 INFO:tasks.workunit.client.0.smithi081.stdout: create 145/37 file after the snapshot 2023-10-25T23:37:35.969 INFO:tasks.workunit.client.0.smithi081.stdout: create 145/38 file after the snapshot 2023-10-25T23:37:35.970 INFO:tasks.workunit.client.0.smithi081.stdout: create 145/39 file after the snapshot 2023-10-25T23:37:35.971 INFO:tasks.workunit.client.0.smithi081.stdout: create 146/.snap/snap-subdir-test 2023-10-25T23:37:36.001 INFO:tasks.workunit.client.0.smithi081.stdout: create 146/30 file after the snapshot 2023-10-25T23:37:36.002 INFO:tasks.workunit.client.0.smithi081.stdout: create 146/31 file after the snapshot 2023-10-25T23:37:36.003 INFO:tasks.workunit.client.0.smithi081.stdout: create 146/32 file after the snapshot 2023-10-25T23:37:36.004 INFO:tasks.workunit.client.0.smithi081.stdout: create 146/33 file after the snapshot 2023-10-25T23:37:36.005 INFO:tasks.workunit.client.0.smithi081.stdout: create 146/34 file after the snapshot 2023-10-25T23:37:36.005 INFO:tasks.workunit.client.0.smithi081.stdout: create 146/35 file after the snapshot 2023-10-25T23:37:36.006 INFO:tasks.workunit.client.0.smithi081.stdout: create 146/36 file after the snapshot 2023-10-25T23:37:36.007 INFO:tasks.workunit.client.0.smithi081.stdout: create 146/37 file after the snapshot 2023-10-25T23:37:36.008 INFO:tasks.workunit.client.0.smithi081.stdout: create 146/38 file after the snapshot 2023-10-25T23:37:36.009 INFO:tasks.workunit.client.0.smithi081.stdout: create 146/39 file after the snapshot 2023-10-25T23:37:36.010 INFO:tasks.workunit.client.0.smithi081.stdout: create 147/.snap/snap-subdir-test 2023-10-25T23:37:36.039 INFO:tasks.workunit.client.0.smithi081.stdout: create 147/30 file after the snapshot 2023-10-25T23:37:36.040 INFO:tasks.workunit.client.0.smithi081.stdout: create 147/31 file after the snapshot 2023-10-25T23:37:36.041 INFO:tasks.workunit.client.0.smithi081.stdout: create 147/32 file after the snapshot 2023-10-25T23:37:36.042 INFO:tasks.workunit.client.0.smithi081.stdout: create 147/33 file after the snapshot 2023-10-25T23:37:36.043 INFO:tasks.workunit.client.0.smithi081.stdout: create 147/34 file after the snapshot 2023-10-25T23:37:36.044 INFO:tasks.workunit.client.0.smithi081.stdout: create 147/35 file after the snapshot 2023-10-25T23:37:36.045 INFO:tasks.workunit.client.0.smithi081.stdout: create 147/36 file after the snapshot 2023-10-25T23:37:36.046 INFO:tasks.workunit.client.0.smithi081.stdout: create 147/37 file after the snapshot 2023-10-25T23:37:36.047 INFO:tasks.workunit.client.0.smithi081.stdout: create 147/38 file after the snapshot 2023-10-25T23:37:36.047 INFO:tasks.workunit.client.0.smithi081.stdout: create 147/39 file after the snapshot 2023-10-25T23:37:36.048 INFO:tasks.workunit.client.0.smithi081.stdout: create 148/.snap/snap-subdir-test 2023-10-25T23:37:36.080 INFO:tasks.workunit.client.0.smithi081.stdout: create 148/30 file after the snapshot 2023-10-25T23:37:36.081 INFO:tasks.workunit.client.0.smithi081.stdout: create 148/31 file after the snapshot 2023-10-25T23:37:36.082 INFO:tasks.workunit.client.0.smithi081.stdout: create 148/32 file after the snapshot 2023-10-25T23:37:36.083 INFO:tasks.workunit.client.0.smithi081.stdout: create 148/33 file after the snapshot 2023-10-25T23:37:36.084 INFO:tasks.workunit.client.0.smithi081.stdout: create 148/34 file after the snapshot 2023-10-25T23:37:36.085 INFO:tasks.workunit.client.0.smithi081.stdout: create 148/35 file after the snapshot 2023-10-25T23:37:36.086 INFO:tasks.workunit.client.0.smithi081.stdout: create 148/36 file after the snapshot 2023-10-25T23:37:36.086 INFO:tasks.workunit.client.0.smithi081.stdout: create 148/37 file after the snapshot 2023-10-25T23:37:36.087 INFO:tasks.workunit.client.0.smithi081.stdout: create 148/38 file after the snapshot 2023-10-25T23:37:36.088 INFO:tasks.workunit.client.0.smithi081.stdout: create 148/39 file after the snapshot 2023-10-25T23:37:36.089 INFO:tasks.workunit.client.0.smithi081.stdout: create 149/.snap/snap-subdir-test 2023-10-25T23:37:36.135 INFO:tasks.workunit.client.0.smithi081.stdout: create 149/30 file after the snapshot 2023-10-25T23:37:36.136 INFO:tasks.workunit.client.0.smithi081.stdout: create 149/31 file after the snapshot 2023-10-25T23:37:36.137 INFO:tasks.workunit.client.0.smithi081.stdout: create 149/32 file after the snapshot 2023-10-25T23:37:36.138 INFO:tasks.workunit.client.0.smithi081.stdout: create 149/33 file after the snapshot 2023-10-25T23:37:36.139 INFO:tasks.workunit.client.0.smithi081.stdout: create 149/34 file after the snapshot 2023-10-25T23:37:36.140 INFO:tasks.workunit.client.0.smithi081.stdout: create 149/35 file after the snapshot 2023-10-25T23:37:36.141 INFO:tasks.workunit.client.0.smithi081.stdout: create 149/36 file after the snapshot 2023-10-25T23:37:36.143 INFO:tasks.workunit.client.0.smithi081.stdout: create 149/37 file after the snapshot 2023-10-25T23:37:36.143 INFO:tasks.workunit.client.0.smithi081.stdout: create 149/38 file after the snapshot 2023-10-25T23:37:36.144 INFO:tasks.workunit.client.0.smithi081.stdout: create 149/39 file after the snapshot 2023-10-25T23:37:36.144 INFO:tasks.workunit.client.0.smithi081.stdout: create 150/.snap/snap-subdir-test 2023-10-25T23:37:36.183 INFO:tasks.workunit.client.0.smithi081.stdout: create 150/30 file after the snapshot 2023-10-25T23:37:36.184 INFO:tasks.workunit.client.0.smithi081.stdout: create 150/31 file after the snapshot 2023-10-25T23:37:36.185 INFO:tasks.workunit.client.0.smithi081.stdout: create 150/32 file after the snapshot 2023-10-25T23:37:36.185 INFO:tasks.workunit.client.0.smithi081.stdout: create 150/33 file after the snapshot 2023-10-25T23:37:36.186 INFO:tasks.workunit.client.0.smithi081.stdout: create 150/34 file after the snapshot 2023-10-25T23:37:36.187 INFO:tasks.workunit.client.0.smithi081.stdout: create 150/35 file after the snapshot 2023-10-25T23:37:36.188 INFO:tasks.workunit.client.0.smithi081.stdout: create 150/36 file after the snapshot 2023-10-25T23:37:36.189 INFO:tasks.workunit.client.0.smithi081.stdout: create 150/37 file after the snapshot 2023-10-25T23:37:36.190 INFO:tasks.workunit.client.0.smithi081.stdout: create 150/38 file after the snapshot 2023-10-25T23:37:36.191 INFO:tasks.workunit.client.0.smithi081.stdout: create 150/39 file after the snapshot 2023-10-25T23:37:36.192 INFO:tasks.workunit.client.0.smithi081.stdout: create 151/.snap/snap-subdir-test 2023-10-25T23:37:36.229 INFO:tasks.workunit.client.0.smithi081.stdout: create 151/30 file after the snapshot 2023-10-25T23:37:36.230 INFO:tasks.workunit.client.0.smithi081.stdout: create 151/31 file after the snapshot 2023-10-25T23:37:36.231 INFO:tasks.workunit.client.0.smithi081.stdout: create 151/32 file after the snapshot 2023-10-25T23:37:36.232 INFO:tasks.workunit.client.0.smithi081.stdout: create 151/33 file after the snapshot 2023-10-25T23:37:36.233 INFO:tasks.workunit.client.0.smithi081.stdout: create 151/34 file after the snapshot 2023-10-25T23:37:36.234 INFO:tasks.workunit.client.0.smithi081.stdout: create 151/35 file after the snapshot 2023-10-25T23:37:36.235 INFO:tasks.workunit.client.0.smithi081.stdout: create 151/36 file after the snapshot 2023-10-25T23:37:36.236 INFO:tasks.workunit.client.0.smithi081.stdout: create 151/37 file after the snapshot 2023-10-25T23:37:36.236 INFO:tasks.workunit.client.0.smithi081.stdout: create 151/38 file after the snapshot 2023-10-25T23:37:36.237 INFO:tasks.workunit.client.0.smithi081.stdout: create 151/39 file after the snapshot 2023-10-25T23:37:36.238 INFO:tasks.workunit.client.0.smithi081.stdout: create 152/.snap/snap-subdir-test 2023-10-25T23:37:36.275 INFO:tasks.workunit.client.0.smithi081.stdout: create 152/30 file after the snapshot 2023-10-25T23:37:36.276 INFO:tasks.workunit.client.0.smithi081.stdout: create 152/31 file after the snapshot 2023-10-25T23:37:36.277 INFO:tasks.workunit.client.0.smithi081.stdout: create 152/32 file after the snapshot 2023-10-25T23:37:36.278 INFO:tasks.workunit.client.0.smithi081.stdout: create 152/33 file after the snapshot 2023-10-25T23:37:36.279 INFO:tasks.workunit.client.0.smithi081.stdout: create 152/34 file after the snapshot 2023-10-25T23:37:36.280 INFO:tasks.workunit.client.0.smithi081.stdout: create 152/35 file after the snapshot 2023-10-25T23:37:36.281 INFO:tasks.workunit.client.0.smithi081.stdout: create 152/36 file after the snapshot 2023-10-25T23:37:36.282 INFO:tasks.workunit.client.0.smithi081.stdout: create 152/37 file after the snapshot 2023-10-25T23:37:36.283 INFO:tasks.workunit.client.0.smithi081.stdout: create 152/38 file after the snapshot 2023-10-25T23:37:36.284 INFO:tasks.workunit.client.0.smithi081.stdout: create 152/39 file after the snapshot 2023-10-25T23:37:36.285 INFO:tasks.workunit.client.0.smithi081.stdout: create 153/.snap/snap-subdir-test 2023-10-25T23:37:36.322 INFO:tasks.workunit.client.0.smithi081.stdout: create 153/30 file after the snapshot 2023-10-25T23:37:36.339 INFO:tasks.workunit.client.0.smithi081.stdout: create 153/31 file after the snapshot 2023-10-25T23:37:36.339 INFO:tasks.workunit.client.0.smithi081.stdout: create 153/32 file after the snapshot 2023-10-25T23:37:36.342 INFO:tasks.workunit.client.0.smithi081.stdout: create 153/33 file after the snapshot 2023-10-25T23:37:36.342 INFO:tasks.workunit.client.0.smithi081.stdout: create 153/34 file after the snapshot 2023-10-25T23:37:36.342 INFO:tasks.workunit.client.0.smithi081.stdout: create 153/35 file after the snapshot 2023-10-25T23:37:36.342 INFO:tasks.workunit.client.0.smithi081.stdout: create 153/36 file after the snapshot 2023-10-25T23:37:36.343 INFO:tasks.workunit.client.0.smithi081.stdout: create 153/37 file after the snapshot 2023-10-25T23:37:36.343 INFO:tasks.workunit.client.0.smithi081.stdout: create 153/38 file after the snapshot 2023-10-25T23:37:36.344 INFO:tasks.workunit.client.0.smithi081.stdout: create 153/39 file after the snapshot 2023-10-25T23:37:36.344 INFO:tasks.workunit.client.0.smithi081.stdout: create 154/.snap/snap-subdir-test 2023-10-25T23:37:36.383 INFO:tasks.workunit.client.0.smithi081.stdout: create 154/30 file after the snapshot 2023-10-25T23:37:36.384 INFO:tasks.workunit.client.0.smithi081.stdout: create 154/31 file after the snapshot 2023-10-25T23:37:36.385 INFO:tasks.workunit.client.0.smithi081.stdout: create 154/32 file after the snapshot 2023-10-25T23:37:36.386 INFO:tasks.workunit.client.0.smithi081.stdout: create 154/33 file after the snapshot 2023-10-25T23:37:36.387 INFO:tasks.workunit.client.0.smithi081.stdout: create 154/34 file after the snapshot 2023-10-25T23:37:36.388 INFO:tasks.workunit.client.0.smithi081.stdout: create 154/35 file after the snapshot 2023-10-25T23:37:36.389 INFO:tasks.workunit.client.0.smithi081.stdout: create 154/36 file after the snapshot 2023-10-25T23:37:36.389 INFO:tasks.workunit.client.0.smithi081.stdout: create 154/37 file after the snapshot 2023-10-25T23:37:36.390 INFO:tasks.workunit.client.0.smithi081.stdout: create 154/38 file after the snapshot 2023-10-25T23:37:36.391 INFO:tasks.workunit.client.0.smithi081.stdout: create 154/39 file after the snapshot 2023-10-25T23:37:36.392 INFO:tasks.workunit.client.0.smithi081.stdout: create 155/.snap/snap-subdir-test 2023-10-25T23:37:36.429 INFO:tasks.workunit.client.0.smithi081.stdout: create 155/30 file after the snapshot 2023-10-25T23:37:36.430 INFO:tasks.workunit.client.0.smithi081.stdout: create 155/31 file after the snapshot 2023-10-25T23:37:36.431 INFO:tasks.workunit.client.0.smithi081.stdout: create 155/32 file after the snapshot 2023-10-25T23:37:36.431 INFO:tasks.workunit.client.0.smithi081.stdout: create 155/33 file after the snapshot 2023-10-25T23:37:36.432 INFO:tasks.workunit.client.0.smithi081.stdout: create 155/34 file after the snapshot 2023-10-25T23:37:36.433 INFO:tasks.workunit.client.0.smithi081.stdout: create 155/35 file after the snapshot 2023-10-25T23:37:36.434 INFO:tasks.workunit.client.0.smithi081.stdout: create 155/36 file after the snapshot 2023-10-25T23:37:36.435 INFO:tasks.workunit.client.0.smithi081.stdout: create 155/37 file after the snapshot 2023-10-25T23:37:36.436 INFO:tasks.workunit.client.0.smithi081.stdout: create 155/38 file after the snapshot 2023-10-25T23:37:36.437 INFO:tasks.workunit.client.0.smithi081.stdout: create 155/39 file after the snapshot 2023-10-25T23:37:36.437 INFO:tasks.workunit.client.0.smithi081.stdout: create 156/.snap/snap-subdir-test 2023-10-25T23:37:36.475 INFO:tasks.workunit.client.0.smithi081.stdout: create 156/30 file after the snapshot 2023-10-25T23:37:36.476 INFO:tasks.workunit.client.0.smithi081.stdout: create 156/31 file after the snapshot 2023-10-25T23:37:36.477 INFO:tasks.workunit.client.0.smithi081.stdout: create 156/32 file after the snapshot 2023-10-25T23:37:36.478 INFO:tasks.workunit.client.0.smithi081.stdout: create 156/33 file after the snapshot 2023-10-25T23:37:36.479 INFO:tasks.workunit.client.0.smithi081.stdout: create 156/34 file after the snapshot 2023-10-25T23:37:36.479 INFO:tasks.workunit.client.0.smithi081.stdout: create 156/35 file after the snapshot 2023-10-25T23:37:36.480 INFO:tasks.workunit.client.0.smithi081.stdout: create 156/36 file after the snapshot 2023-10-25T23:37:36.481 INFO:tasks.workunit.client.0.smithi081.stdout: create 156/37 file after the snapshot 2023-10-25T23:37:36.482 INFO:tasks.workunit.client.0.smithi081.stdout: create 156/38 file after the snapshot 2023-10-25T23:37:36.483 INFO:tasks.workunit.client.0.smithi081.stdout: create 156/39 file after the snapshot 2023-10-25T23:37:36.484 INFO:tasks.workunit.client.0.smithi081.stdout: create 157/.snap/snap-subdir-test 2023-10-25T23:37:36.521 INFO:tasks.workunit.client.0.smithi081.stdout: create 157/30 file after the snapshot 2023-10-25T23:37:36.522 INFO:tasks.workunit.client.0.smithi081.stdout: create 157/31 file after the snapshot 2023-10-25T23:37:36.522 INFO:tasks.workunit.client.0.smithi081.stdout: create 157/32 file after the snapshot 2023-10-25T23:37:36.523 INFO:tasks.workunit.client.0.smithi081.stdout: create 157/33 file after the snapshot 2023-10-25T23:37:36.524 INFO:tasks.workunit.client.0.smithi081.stdout: create 157/34 file after the snapshot 2023-10-25T23:37:36.525 INFO:tasks.workunit.client.0.smithi081.stdout: create 157/35 file after the snapshot 2023-10-25T23:37:36.526 INFO:tasks.workunit.client.0.smithi081.stdout: create 157/36 file after the snapshot 2023-10-25T23:37:36.527 INFO:tasks.workunit.client.0.smithi081.stdout: create 157/37 file after the snapshot 2023-10-25T23:37:36.528 INFO:tasks.workunit.client.0.smithi081.stdout: create 157/38 file after the snapshot 2023-10-25T23:37:36.528 INFO:tasks.workunit.client.0.smithi081.stdout: create 157/39 file after the snapshot 2023-10-25T23:37:36.529 INFO:tasks.workunit.client.0.smithi081.stdout: create 158/.snap/snap-subdir-test 2023-10-25T23:37:36.567 INFO:tasks.workunit.client.0.smithi081.stdout: create 158/30 file after the snapshot 2023-10-25T23:37:36.568 INFO:tasks.workunit.client.0.smithi081.stdout: create 158/31 file after the snapshot 2023-10-25T23:37:36.569 INFO:tasks.workunit.client.0.smithi081.stdout: create 158/32 file after the snapshot 2023-10-25T23:37:36.570 INFO:tasks.workunit.client.0.smithi081.stdout: create 158/33 file after the snapshot 2023-10-25T23:37:36.570 INFO:tasks.workunit.client.0.smithi081.stdout: create 158/34 file after the snapshot 2023-10-25T23:37:36.571 INFO:tasks.workunit.client.0.smithi081.stdout: create 158/35 file after the snapshot 2023-10-25T23:37:36.572 INFO:tasks.workunit.client.0.smithi081.stdout: create 158/36 file after the snapshot 2023-10-25T23:37:36.573 INFO:tasks.workunit.client.0.smithi081.stdout: create 158/37 file after the snapshot 2023-10-25T23:37:36.574 INFO:tasks.workunit.client.0.smithi081.stdout: create 158/38 file after the snapshot 2023-10-25T23:37:36.575 INFO:tasks.workunit.client.0.smithi081.stdout: create 158/39 file after the snapshot 2023-10-25T23:37:36.575 INFO:tasks.workunit.client.0.smithi081.stdout: create 159/.snap/snap-subdir-test 2023-10-25T23:37:36.605 INFO:tasks.workunit.client.0.smithi081.stdout: create 159/30 file after the snapshot 2023-10-25T23:37:36.606 INFO:tasks.workunit.client.0.smithi081.stdout: create 159/31 file after the snapshot 2023-10-25T23:37:36.608 INFO:tasks.workunit.client.0.smithi081.stdout: create 159/32 file after the snapshot 2023-10-25T23:37:36.609 INFO:tasks.workunit.client.0.smithi081.stdout: create 159/33 file after the snapshot 2023-10-25T23:37:36.611 INFO:tasks.workunit.client.0.smithi081.stdout: create 159/34 file after the snapshot 2023-10-25T23:37:36.612 INFO:tasks.workunit.client.0.smithi081.stdout: create 159/35 file after the snapshot 2023-10-25T23:37:36.614 INFO:tasks.workunit.client.0.smithi081.stdout: create 159/36 file after the snapshot 2023-10-25T23:37:36.615 INFO:tasks.workunit.client.0.smithi081.stdout: create 159/37 file after the snapshot 2023-10-25T23:37:36.616 INFO:tasks.workunit.client.0.smithi081.stdout: create 159/38 file after the snapshot 2023-10-25T23:37:36.617 INFO:tasks.workunit.client.0.smithi081.stdout: create 159/39 file after the snapshot 2023-10-25T23:37:36.619 INFO:tasks.workunit.client.0.smithi081.stdout: create 160/.snap/snap-subdir-test 2023-10-25T23:37:36.649 INFO:tasks.workunit.client.0.smithi081.stdout: create 160/30 file after the snapshot 2023-10-25T23:37:36.664 INFO:tasks.workunit.client.0.smithi081.stdout: create 160/31 file after the snapshot 2023-10-25T23:37:36.665 INFO:tasks.workunit.client.0.smithi081.stdout: create 160/32 file after the snapshot 2023-10-25T23:37:36.665 INFO:tasks.workunit.client.0.smithi081.stdout: create 160/33 file after the snapshot 2023-10-25T23:37:36.666 INFO:tasks.workunit.client.0.smithi081.stdout: create 160/34 file after the snapshot 2023-10-25T23:37:36.667 INFO:tasks.workunit.client.0.smithi081.stdout: create 160/35 file after the snapshot 2023-10-25T23:37:36.667 INFO:tasks.workunit.client.0.smithi081.stdout: create 160/36 file after the snapshot 2023-10-25T23:37:36.668 INFO:tasks.workunit.client.0.smithi081.stdout: create 160/37 file after the snapshot 2023-10-25T23:37:36.669 INFO:tasks.workunit.client.0.smithi081.stdout: create 160/38 file after the snapshot 2023-10-25T23:37:36.670 INFO:tasks.workunit.client.0.smithi081.stdout: create 160/39 file after the snapshot 2023-10-25T23:37:36.670 INFO:tasks.workunit.client.0.smithi081.stdout: create 161/.snap/snap-subdir-test 2023-10-25T23:37:36.699 INFO:tasks.workunit.client.0.smithi081.stdout: create 161/30 file after the snapshot 2023-10-25T23:37:36.715 INFO:tasks.workunit.client.0.smithi081.stdout: create 161/31 file after the snapshot 2023-10-25T23:37:36.716 INFO:tasks.workunit.client.0.smithi081.stdout: create 161/32 file after the snapshot 2023-10-25T23:37:36.716 INFO:tasks.workunit.client.0.smithi081.stdout: create 161/33 file after the snapshot 2023-10-25T23:37:36.717 INFO:tasks.workunit.client.0.smithi081.stdout: create 161/34 file after the snapshot 2023-10-25T23:37:36.717 INFO:tasks.workunit.client.0.smithi081.stdout: create 161/35 file after the snapshot 2023-10-25T23:37:36.718 INFO:tasks.workunit.client.0.smithi081.stdout: create 161/36 file after the snapshot 2023-10-25T23:37:36.719 INFO:tasks.workunit.client.0.smithi081.stdout: create 161/37 file after the snapshot 2023-10-25T23:37:36.719 INFO:tasks.workunit.client.0.smithi081.stdout: create 161/38 file after the snapshot 2023-10-25T23:37:36.720 INFO:tasks.workunit.client.0.smithi081.stdout: create 161/39 file after the snapshot 2023-10-25T23:37:36.721 INFO:tasks.workunit.client.0.smithi081.stdout: create 162/.snap/snap-subdir-test 2023-10-25T23:37:36.754 INFO:tasks.workunit.client.0.smithi081.stdout: create 162/30 file after the snapshot 2023-10-25T23:37:36.755 INFO:tasks.workunit.client.0.smithi081.stdout: create 162/31 file after the snapshot 2023-10-25T23:37:36.755 INFO:tasks.workunit.client.0.smithi081.stdout: create 162/32 file after the snapshot 2023-10-25T23:37:36.756 INFO:tasks.workunit.client.0.smithi081.stdout: create 162/33 file after the snapshot 2023-10-25T23:37:36.756 INFO:tasks.workunit.client.0.smithi081.stdout: create 162/34 file after the snapshot 2023-10-25T23:37:36.756 INFO:tasks.workunit.client.0.smithi081.stdout: create 162/35 file after the snapshot 2023-10-25T23:37:36.757 INFO:tasks.workunit.client.0.smithi081.stdout: create 162/36 file after the snapshot 2023-10-25T23:37:36.758 INFO:tasks.workunit.client.0.smithi081.stdout: create 162/37 file after the snapshot 2023-10-25T23:37:36.759 INFO:tasks.workunit.client.0.smithi081.stdout: create 162/38 file after the snapshot 2023-10-25T23:37:36.760 INFO:tasks.workunit.client.0.smithi081.stdout: create 162/39 file after the snapshot 2023-10-25T23:37:36.761 INFO:tasks.workunit.client.0.smithi081.stdout: create 163/.snap/snap-subdir-test 2023-10-25T23:37:36.792 INFO:tasks.workunit.client.0.smithi081.stdout: create 163/30 file after the snapshot 2023-10-25T23:37:36.793 INFO:tasks.workunit.client.0.smithi081.stdout: create 163/31 file after the snapshot 2023-10-25T23:37:36.794 INFO:tasks.workunit.client.0.smithi081.stdout: create 163/32 file after the snapshot 2023-10-25T23:37:36.795 INFO:tasks.workunit.client.0.smithi081.stdout: create 163/33 file after the snapshot 2023-10-25T23:37:36.796 INFO:tasks.workunit.client.0.smithi081.stdout: create 163/34 file after the snapshot 2023-10-25T23:37:36.797 INFO:tasks.workunit.client.0.smithi081.stdout: create 163/35 file after the snapshot 2023-10-25T23:37:36.798 INFO:tasks.workunit.client.0.smithi081.stdout: create 163/36 file after the snapshot 2023-10-25T23:37:36.801 INFO:tasks.workunit.client.0.smithi081.stdout: create 163/37 file after the snapshot 2023-10-25T23:37:36.803 INFO:tasks.workunit.client.0.smithi081.stdout: create 163/38 file after the snapshot 2023-10-25T23:37:36.805 INFO:tasks.workunit.client.0.smithi081.stdout: create 163/39 file after the snapshot 2023-10-25T23:37:36.807 INFO:tasks.workunit.client.0.smithi081.stdout: create 164/.snap/snap-subdir-test 2023-10-25T23:37:36.837 INFO:tasks.workunit.client.0.smithi081.stdout: create 164/30 file after the snapshot 2023-10-25T23:37:36.838 INFO:tasks.workunit.client.0.smithi081.stdout: create 164/31 file after the snapshot 2023-10-25T23:37:36.839 INFO:tasks.workunit.client.0.smithi081.stdout: create 164/32 file after the snapshot 2023-10-25T23:37:36.840 INFO:tasks.workunit.client.0.smithi081.stdout: create 164/33 file after the snapshot 2023-10-25T23:37:36.841 INFO:tasks.workunit.client.0.smithi081.stdout: create 164/34 file after the snapshot 2023-10-25T23:37:36.841 INFO:tasks.workunit.client.0.smithi081.stdout: create 164/35 file after the snapshot 2023-10-25T23:37:36.842 INFO:tasks.workunit.client.0.smithi081.stdout: create 164/36 file after the snapshot 2023-10-25T23:37:36.843 INFO:tasks.workunit.client.0.smithi081.stdout: create 164/37 file after the snapshot 2023-10-25T23:37:36.844 INFO:tasks.workunit.client.0.smithi081.stdout: create 164/38 file after the snapshot 2023-10-25T23:37:36.845 INFO:tasks.workunit.client.0.smithi081.stdout: create 164/39 file after the snapshot 2023-10-25T23:37:36.846 INFO:tasks.workunit.client.0.smithi081.stdout: create 165/.snap/snap-subdir-test 2023-10-25T23:37:36.878 INFO:tasks.workunit.client.0.smithi081.stdout: create 165/30 file after the snapshot 2023-10-25T23:37:36.879 INFO:tasks.workunit.client.0.smithi081.stdout: create 165/31 file after the snapshot 2023-10-25T23:37:36.880 INFO:tasks.workunit.client.0.smithi081.stdout: create 165/32 file after the snapshot 2023-10-25T23:37:36.881 INFO:tasks.workunit.client.0.smithi081.stdout: create 165/33 file after the snapshot 2023-10-25T23:37:36.882 INFO:tasks.workunit.client.0.smithi081.stdout: create 165/34 file after the snapshot 2023-10-25T23:37:36.884 INFO:tasks.workunit.client.0.smithi081.stdout: create 165/35 file after the snapshot 2023-10-25T23:37:36.885 INFO:tasks.workunit.client.0.smithi081.stdout: create 165/36 file after the snapshot 2023-10-25T23:37:36.886 INFO:tasks.workunit.client.0.smithi081.stdout: create 165/37 file after the snapshot 2023-10-25T23:37:36.887 INFO:tasks.workunit.client.0.smithi081.stdout: create 165/38 file after the snapshot 2023-10-25T23:37:36.888 INFO:tasks.workunit.client.0.smithi081.stdout: create 165/39 file after the snapshot 2023-10-25T23:37:36.889 INFO:tasks.workunit.client.0.smithi081.stdout: create 166/.snap/snap-subdir-test 2023-10-25T23:37:36.920 INFO:tasks.workunit.client.0.smithi081.stdout: create 166/30 file after the snapshot 2023-10-25T23:37:36.921 INFO:tasks.workunit.client.0.smithi081.stdout: create 166/31 file after the snapshot 2023-10-25T23:37:36.922 INFO:tasks.workunit.client.0.smithi081.stdout: create 166/32 file after the snapshot 2023-10-25T23:37:36.923 INFO:tasks.workunit.client.0.smithi081.stdout: create 166/33 file after the snapshot 2023-10-25T23:37:36.924 INFO:tasks.workunit.client.0.smithi081.stdout: create 166/34 file after the snapshot 2023-10-25T23:37:36.925 INFO:tasks.workunit.client.0.smithi081.stdout: create 166/35 file after the snapshot 2023-10-25T23:37:36.925 INFO:tasks.workunit.client.0.smithi081.stdout: create 166/36 file after the snapshot 2023-10-25T23:37:36.926 INFO:tasks.workunit.client.0.smithi081.stdout: create 166/37 file after the snapshot 2023-10-25T23:37:36.927 INFO:tasks.workunit.client.0.smithi081.stdout: create 166/38 file after the snapshot 2023-10-25T23:37:36.928 INFO:tasks.workunit.client.0.smithi081.stdout: create 166/39 file after the snapshot 2023-10-25T23:37:36.929 INFO:tasks.workunit.client.0.smithi081.stdout: create 167/.snap/snap-subdir-test 2023-10-25T23:37:36.960 INFO:tasks.workunit.client.0.smithi081.stdout: create 167/30 file after the snapshot 2023-10-25T23:37:36.961 INFO:tasks.workunit.client.0.smithi081.stdout: create 167/31 file after the snapshot 2023-10-25T23:37:36.962 INFO:tasks.workunit.client.0.smithi081.stdout: create 167/32 file after the snapshot 2023-10-25T23:37:36.963 INFO:tasks.workunit.client.0.smithi081.stdout: create 167/33 file after the snapshot 2023-10-25T23:37:36.964 INFO:tasks.workunit.client.0.smithi081.stdout: create 167/34 file after the snapshot 2023-10-25T23:37:36.964 INFO:tasks.workunit.client.0.smithi081.stdout: create 167/35 file after the snapshot 2023-10-25T23:37:36.965 INFO:tasks.workunit.client.0.smithi081.stdout: create 167/36 file after the snapshot 2023-10-25T23:37:36.966 INFO:tasks.workunit.client.0.smithi081.stdout: create 167/37 file after the snapshot 2023-10-25T23:37:36.967 INFO:tasks.workunit.client.0.smithi081.stdout: create 167/38 file after the snapshot 2023-10-25T23:37:36.968 INFO:tasks.workunit.client.0.smithi081.stdout: create 167/39 file after the snapshot 2023-10-25T23:37:36.969 INFO:tasks.workunit.client.0.smithi081.stdout: create 168/.snap/snap-subdir-test 2023-10-25T23:37:36.998 INFO:tasks.workunit.client.0.smithi081.stdout: create 168/30 file after the snapshot 2023-10-25T23:37:37.000 INFO:tasks.workunit.client.0.smithi081.stdout: create 168/31 file after the snapshot 2023-10-25T23:37:37.000 INFO:tasks.workunit.client.0.smithi081.stdout: create 168/32 file after the snapshot 2023-10-25T23:37:37.001 INFO:tasks.workunit.client.0.smithi081.stdout: create 168/33 file after the snapshot 2023-10-25T23:37:37.002 INFO:tasks.workunit.client.0.smithi081.stdout: create 168/34 file after the snapshot 2023-10-25T23:37:37.003 INFO:tasks.workunit.client.0.smithi081.stdout: create 168/35 file after the snapshot 2023-10-25T23:37:37.004 INFO:tasks.workunit.client.0.smithi081.stdout: create 168/36 file after the snapshot 2023-10-25T23:37:37.005 INFO:tasks.workunit.client.0.smithi081.stdout: create 168/37 file after the snapshot 2023-10-25T23:37:37.006 INFO:tasks.workunit.client.0.smithi081.stdout: create 168/38 file after the snapshot 2023-10-25T23:37:37.007 INFO:tasks.workunit.client.0.smithi081.stdout: create 168/39 file after the snapshot 2023-10-25T23:37:37.008 INFO:tasks.workunit.client.0.smithi081.stdout: create 169/.snap/snap-subdir-test 2023-10-25T23:37:37.040 INFO:tasks.workunit.client.0.smithi081.stdout: create 169/30 file after the snapshot 2023-10-25T23:37:37.041 INFO:tasks.workunit.client.0.smithi081.stdout: create 169/31 file after the snapshot 2023-10-25T23:37:37.042 INFO:tasks.workunit.client.0.smithi081.stdout: create 169/32 file after the snapshot 2023-10-25T23:37:37.043 INFO:tasks.workunit.client.0.smithi081.stdout: create 169/33 file after the snapshot 2023-10-25T23:37:37.044 INFO:tasks.workunit.client.0.smithi081.stdout: create 169/34 file after the snapshot 2023-10-25T23:37:37.045 INFO:tasks.workunit.client.0.smithi081.stdout: create 169/35 file after the snapshot 2023-10-25T23:37:37.046 INFO:tasks.workunit.client.0.smithi081.stdout: create 169/36 file after the snapshot 2023-10-25T23:37:37.047 INFO:tasks.workunit.client.0.smithi081.stdout: create 169/37 file after the snapshot 2023-10-25T23:37:37.048 INFO:tasks.workunit.client.0.smithi081.stdout: create 169/38 file after the snapshot 2023-10-25T23:37:37.049 INFO:tasks.workunit.client.0.smithi081.stdout: create 169/39 file after the snapshot 2023-10-25T23:37:37.051 INFO:tasks.workunit.client.0.smithi081.stdout: create 170/.snap/snap-subdir-test 2023-10-25T23:37:37.082 INFO:tasks.workunit.client.0.smithi081.stdout: create 170/30 file after the snapshot 2023-10-25T23:37:37.084 INFO:tasks.workunit.client.0.smithi081.stdout: create 170/31 file after the snapshot 2023-10-25T23:37:37.085 INFO:tasks.workunit.client.0.smithi081.stdout: create 170/32 file after the snapshot 2023-10-25T23:37:37.087 INFO:tasks.workunit.client.0.smithi081.stdout: create 170/33 file after the snapshot 2023-10-25T23:37:37.088 INFO:tasks.workunit.client.0.smithi081.stdout: create 170/34 file after the snapshot 2023-10-25T23:37:37.088 INFO:tasks.workunit.client.0.smithi081.stdout: create 170/35 file after the snapshot 2023-10-25T23:37:37.089 INFO:tasks.workunit.client.0.smithi081.stdout: create 170/36 file after the snapshot 2023-10-25T23:37:37.090 INFO:tasks.workunit.client.0.smithi081.stdout: create 170/37 file after the snapshot 2023-10-25T23:37:37.091 INFO:tasks.workunit.client.0.smithi081.stdout: create 170/38 file after the snapshot 2023-10-25T23:37:37.092 INFO:tasks.workunit.client.0.smithi081.stdout: create 170/39 file after the snapshot 2023-10-25T23:37:37.093 INFO:tasks.workunit.client.0.smithi081.stdout: create 171/.snap/snap-subdir-test 2023-10-25T23:37:37.123 INFO:tasks.workunit.client.0.smithi081.stdout: create 171/30 file after the snapshot 2023-10-25T23:37:37.124 INFO:tasks.workunit.client.0.smithi081.stdout: create 171/31 file after the snapshot 2023-10-25T23:37:37.127 INFO:tasks.workunit.client.0.smithi081.stdout: create 171/32 file after the snapshot 2023-10-25T23:37:37.129 INFO:tasks.workunit.client.0.smithi081.stdout: create 171/33 file after the snapshot 2023-10-25T23:37:37.130 INFO:tasks.workunit.client.0.smithi081.stdout: create 171/34 file after the snapshot 2023-10-25T23:37:37.132 INFO:tasks.workunit.client.0.smithi081.stdout: create 171/35 file after the snapshot 2023-10-25T23:37:37.133 INFO:tasks.workunit.client.0.smithi081.stdout: create 171/36 file after the snapshot 2023-10-25T23:37:37.137 INFO:tasks.workunit.client.0.smithi081.stdout: create 171/37 file after the snapshot 2023-10-25T23:37:37.139 INFO:tasks.workunit.client.0.smithi081.stdout: create 171/38 file after the snapshot 2023-10-25T23:37:37.139 INFO:tasks.workunit.client.0.smithi081.stdout: create 171/39 file after the snapshot 2023-10-25T23:37:37.140 INFO:tasks.workunit.client.0.smithi081.stdout: create 172/.snap/snap-subdir-test 2023-10-25T23:37:37.167 INFO:tasks.workunit.client.0.smithi081.stdout: create 172/30 file after the snapshot 2023-10-25T23:37:37.169 INFO:tasks.workunit.client.0.smithi081.stdout: create 172/31 file after the snapshot 2023-10-25T23:37:37.170 INFO:tasks.workunit.client.0.smithi081.stdout: create 172/32 file after the snapshot 2023-10-25T23:37:37.171 INFO:tasks.workunit.client.0.smithi081.stdout: create 172/33 file after the snapshot 2023-10-25T23:37:37.173 INFO:tasks.workunit.client.0.smithi081.stdout: create 172/34 file after the snapshot 2023-10-25T23:37:37.174 INFO:tasks.workunit.client.0.smithi081.stdout: create 172/35 file after the snapshot 2023-10-25T23:37:37.175 INFO:tasks.workunit.client.0.smithi081.stdout: create 172/36 file after the snapshot 2023-10-25T23:37:37.177 INFO:tasks.workunit.client.0.smithi081.stdout: create 172/37 file after the snapshot 2023-10-25T23:37:37.178 INFO:tasks.workunit.client.0.smithi081.stdout: create 172/38 file after the snapshot 2023-10-25T23:37:37.179 INFO:tasks.workunit.client.0.smithi081.stdout: create 172/39 file after the snapshot 2023-10-25T23:37:37.180 INFO:tasks.workunit.client.0.smithi081.stdout: create 173/.snap/snap-subdir-test 2023-10-25T23:37:37.209 INFO:tasks.workunit.client.0.smithi081.stdout: create 173/30 file after the snapshot 2023-10-25T23:37:37.211 INFO:tasks.workunit.client.0.smithi081.stdout: create 173/31 file after the snapshot 2023-10-25T23:37:37.212 INFO:tasks.workunit.client.0.smithi081.stdout: create 173/32 file after the snapshot 2023-10-25T23:37:37.214 INFO:tasks.workunit.client.0.smithi081.stdout: create 173/33 file after the snapshot 2023-10-25T23:37:37.215 INFO:tasks.workunit.client.0.smithi081.stdout: create 173/34 file after the snapshot 2023-10-25T23:37:37.216 INFO:tasks.workunit.client.0.smithi081.stdout: create 173/35 file after the snapshot 2023-10-25T23:37:37.218 INFO:tasks.workunit.client.0.smithi081.stdout: create 173/36 file after the snapshot 2023-10-25T23:37:37.219 INFO:tasks.workunit.client.0.smithi081.stdout: create 173/37 file after the snapshot 2023-10-25T23:37:37.220 INFO:tasks.workunit.client.0.smithi081.stdout: create 173/38 file after the snapshot 2023-10-25T23:37:37.222 INFO:tasks.workunit.client.0.smithi081.stdout: create 173/39 file after the snapshot 2023-10-25T23:37:37.223 INFO:tasks.workunit.client.0.smithi081.stdout: create 174/.snap/snap-subdir-test 2023-10-25T23:37:37.253 INFO:tasks.workunit.client.0.smithi081.stdout: create 174/30 file after the snapshot 2023-10-25T23:37:37.255 INFO:tasks.workunit.client.0.smithi081.stdout: create 174/31 file after the snapshot 2023-10-25T23:37:37.256 INFO:tasks.workunit.client.0.smithi081.stdout: create 174/32 file after the snapshot 2023-10-25T23:37:37.258 INFO:tasks.workunit.client.0.smithi081.stdout: create 174/33 file after the snapshot 2023-10-25T23:37:37.259 INFO:tasks.workunit.client.0.smithi081.stdout: create 174/34 file after the snapshot 2023-10-25T23:37:37.260 INFO:tasks.workunit.client.0.smithi081.stdout: create 174/35 file after the snapshot 2023-10-25T23:37:37.262 INFO:tasks.workunit.client.0.smithi081.stdout: create 174/36 file after the snapshot 2023-10-25T23:37:37.263 INFO:tasks.workunit.client.0.smithi081.stdout: create 174/37 file after the snapshot 2023-10-25T23:37:37.264 INFO:tasks.workunit.client.0.smithi081.stdout: create 174/38 file after the snapshot 2023-10-25T23:37:37.266 INFO:tasks.workunit.client.0.smithi081.stdout: create 174/39 file after the snapshot 2023-10-25T23:37:37.267 INFO:tasks.workunit.client.0.smithi081.stdout: create 175/.snap/snap-subdir-test 2023-10-25T23:37:37.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:37:37.284 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:37:37.298 INFO:tasks.workunit.client.0.smithi081.stdout: create 175/30 file after the snapshot 2023-10-25T23:37:37.300 INFO:tasks.workunit.client.0.smithi081.stdout: create 175/31 file after the snapshot 2023-10-25T23:37:37.301 INFO:tasks.workunit.client.0.smithi081.stdout: create 175/32 file after the snapshot 2023-10-25T23:37:37.302 INFO:tasks.workunit.client.0.smithi081.stdout: create 175/33 file after the snapshot 2023-10-25T23:37:37.303 INFO:tasks.workunit.client.0.smithi081.stdout: create 175/34 file after the snapshot 2023-10-25T23:37:37.304 INFO:tasks.workunit.client.0.smithi081.stdout: create 175/35 file after the snapshot 2023-10-25T23:37:37.305 INFO:tasks.workunit.client.0.smithi081.stdout: create 175/36 file after the snapshot 2023-10-25T23:37:37.307 INFO:tasks.workunit.client.0.smithi081.stdout: create 175/37 file after the snapshot 2023-10-25T23:37:37.308 INFO:tasks.workunit.client.0.smithi081.stdout: create 175/38 file after the snapshot 2023-10-25T23:37:37.309 INFO:tasks.workunit.client.0.smithi081.stdout: create 175/39 file after the snapshot 2023-10-25T23:37:37.312 INFO:tasks.workunit.client.0.smithi081.stdout: create 176/.snap/snap-subdir-test 2023-10-25T23:37:37.344 INFO:tasks.workunit.client.0.smithi081.stdout: create 176/30 file after the snapshot 2023-10-25T23:37:37.344 INFO:tasks.workunit.client.0.smithi081.stdout: create 176/31 file after the snapshot 2023-10-25T23:37:37.346 INFO:tasks.workunit.client.0.smithi081.stdout: create 176/32 file after the snapshot 2023-10-25T23:37:37.348 INFO:tasks.workunit.client.0.smithi081.stdout: create 176/33 file after the snapshot 2023-10-25T23:37:37.350 INFO:tasks.workunit.client.0.smithi081.stdout: create 176/34 file after the snapshot 2023-10-25T23:37:37.351 INFO:tasks.workunit.client.0.smithi081.stdout: create 176/35 file after the snapshot 2023-10-25T23:37:37.352 INFO:tasks.workunit.client.0.smithi081.stdout: create 176/36 file after the snapshot 2023-10-25T23:37:37.353 INFO:tasks.workunit.client.0.smithi081.stdout: create 176/37 file after the snapshot 2023-10-25T23:37:37.355 INFO:tasks.workunit.client.0.smithi081.stdout: create 176/38 file after the snapshot 2023-10-25T23:37:37.356 INFO:tasks.workunit.client.0.smithi081.stdout: create 176/39 file after the snapshot 2023-10-25T23:37:37.357 INFO:tasks.workunit.client.0.smithi081.stdout: create 177/.snap/snap-subdir-test 2023-10-25T23:37:37.387 INFO:tasks.workunit.client.0.smithi081.stdout: create 177/30 file after the snapshot 2023-10-25T23:37:37.389 INFO:tasks.workunit.client.0.smithi081.stdout: create 177/31 file after the snapshot 2023-10-25T23:37:37.390 INFO:tasks.workunit.client.0.smithi081.stdout: create 177/32 file after the snapshot 2023-10-25T23:37:37.391 INFO:tasks.workunit.client.0.smithi081.stdout: create 177/33 file after the snapshot 2023-10-25T23:37:37.393 INFO:tasks.workunit.client.0.smithi081.stdout: create 177/34 file after the snapshot 2023-10-25T23:37:37.394 INFO:tasks.workunit.client.0.smithi081.stdout: create 177/35 file after the snapshot 2023-10-25T23:37:37.395 INFO:tasks.workunit.client.0.smithi081.stdout: create 177/36 file after the snapshot 2023-10-25T23:37:37.397 INFO:tasks.workunit.client.0.smithi081.stdout: create 177/37 file after the snapshot 2023-10-25T23:37:37.398 INFO:tasks.workunit.client.0.smithi081.stdout: create 177/38 file after the snapshot 2023-10-25T23:37:37.400 INFO:tasks.workunit.client.0.smithi081.stdout: create 177/39 file after the snapshot 2023-10-25T23:37:37.400 INFO:tasks.workunit.client.0.smithi081.stdout: create 178/.snap/snap-subdir-test 2023-10-25T23:37:37.436 INFO:tasks.workunit.client.0.smithi081.stdout: create 178/30 file after the snapshot 2023-10-25T23:37:37.437 INFO:tasks.workunit.client.0.smithi081.stdout: create 178/31 file after the snapshot 2023-10-25T23:37:37.439 INFO:tasks.workunit.client.0.smithi081.stdout: create 178/32 file after the snapshot 2023-10-25T23:37:37.440 INFO:tasks.workunit.client.0.smithi081.stdout: create 178/33 file after the snapshot 2023-10-25T23:37:37.441 INFO:tasks.workunit.client.0.smithi081.stdout: create 178/34 file after the snapshot 2023-10-25T23:37:37.443 INFO:tasks.workunit.client.0.smithi081.stdout: create 178/35 file after the snapshot 2023-10-25T23:37:37.444 INFO:tasks.workunit.client.0.smithi081.stdout: create 178/36 file after the snapshot 2023-10-25T23:37:37.445 INFO:tasks.workunit.client.0.smithi081.stdout: create 178/37 file after the snapshot 2023-10-25T23:37:37.446 INFO:tasks.workunit.client.0.smithi081.stdout: create 178/38 file after the snapshot 2023-10-25T23:37:37.447 INFO:tasks.workunit.client.0.smithi081.stdout: create 178/39 file after the snapshot 2023-10-25T23:37:37.448 INFO:tasks.workunit.client.0.smithi081.stdout: create 179/.snap/snap-subdir-test 2023-10-25T23:37:37.477 INFO:tasks.workunit.client.0.smithi081.stdout: create 179/30 file after the snapshot 2023-10-25T23:37:37.478 INFO:tasks.workunit.client.0.smithi081.stdout: create 179/31 file after the snapshot 2023-10-25T23:37:37.478 INFO:tasks.workunit.client.0.smithi081.stdout: create 179/32 file after the snapshot 2023-10-25T23:37:37.479 INFO:tasks.workunit.client.0.smithi081.stdout: create 179/33 file after the snapshot 2023-10-25T23:37:37.480 INFO:tasks.workunit.client.0.smithi081.stdout: create 179/34 file after the snapshot 2023-10-25T23:37:37.481 INFO:tasks.workunit.client.0.smithi081.stdout: create 179/35 file after the snapshot 2023-10-25T23:37:37.482 INFO:tasks.workunit.client.0.smithi081.stdout: create 179/36 file after the snapshot 2023-10-25T23:37:37.483 INFO:tasks.workunit.client.0.smithi081.stdout: create 179/37 file after the snapshot 2023-10-25T23:37:37.484 INFO:tasks.workunit.client.0.smithi081.stdout: create 179/38 file after the snapshot 2023-10-25T23:37:37.485 INFO:tasks.workunit.client.0.smithi081.stdout: create 179/39 file after the snapshot 2023-10-25T23:37:37.485 INFO:tasks.workunit.client.0.smithi081.stdout: create 180/.snap/snap-subdir-test 2023-10-25T23:37:37.515 INFO:tasks.workunit.client.0.smithi081.stdout: create 180/30 file after the snapshot 2023-10-25T23:37:37.516 INFO:tasks.workunit.client.0.smithi081.stdout: create 180/31 file after the snapshot 2023-10-25T23:37:37.517 INFO:tasks.workunit.client.0.smithi081.stdout: create 180/32 file after the snapshot 2023-10-25T23:37:37.518 INFO:tasks.workunit.client.0.smithi081.stdout: create 180/33 file after the snapshot 2023-10-25T23:37:37.519 INFO:tasks.workunit.client.0.smithi081.stdout: create 180/34 file after the snapshot 2023-10-25T23:37:37.520 INFO:tasks.workunit.client.0.smithi081.stdout: create 180/35 file after the snapshot 2023-10-25T23:37:37.521 INFO:tasks.workunit.client.0.smithi081.stdout: create 180/36 file after the snapshot 2023-10-25T23:37:37.522 INFO:tasks.workunit.client.0.smithi081.stdout: create 180/37 file after the snapshot 2023-10-25T23:37:37.523 INFO:tasks.workunit.client.0.smithi081.stdout: create 180/38 file after the snapshot 2023-10-25T23:37:37.523 INFO:tasks.workunit.client.0.smithi081.stdout: create 180/39 file after the snapshot 2023-10-25T23:37:37.524 INFO:tasks.workunit.client.0.smithi081.stdout: create 181/.snap/snap-subdir-test 2023-10-25T23:37:37.554 INFO:tasks.workunit.client.0.smithi081.stdout: create 181/30 file after the snapshot 2023-10-25T23:37:37.570 INFO:tasks.workunit.client.0.smithi081.stdout: create 181/31 file after the snapshot 2023-10-25T23:37:37.570 INFO:tasks.workunit.client.0.smithi081.stdout: create 181/32 file after the snapshot 2023-10-25T23:37:37.571 INFO:tasks.workunit.client.0.smithi081.stdout: create 181/33 file after the snapshot 2023-10-25T23:37:37.571 INFO:tasks.workunit.client.0.smithi081.stdout: create 181/34 file after the snapshot 2023-10-25T23:37:37.572 INFO:tasks.workunit.client.0.smithi081.stdout: create 181/35 file after the snapshot 2023-10-25T23:37:37.572 INFO:tasks.workunit.client.0.smithi081.stdout: create 181/36 file after the snapshot 2023-10-25T23:37:37.573 INFO:tasks.workunit.client.0.smithi081.stdout: create 181/37 file after the snapshot 2023-10-25T23:37:37.574 INFO:tasks.workunit.client.0.smithi081.stdout: create 181/38 file after the snapshot 2023-10-25T23:37:37.574 INFO:tasks.workunit.client.0.smithi081.stdout: create 181/39 file after the snapshot 2023-10-25T23:37:37.575 INFO:tasks.workunit.client.0.smithi081.stdout: create 182/.snap/snap-subdir-test 2023-10-25T23:37:37.603 INFO:tasks.workunit.client.0.smithi081.stdout: create 182/30 file after the snapshot 2023-10-25T23:37:37.604 INFO:tasks.workunit.client.0.smithi081.stdout: create 182/31 file after the snapshot 2023-10-25T23:37:37.605 INFO:tasks.workunit.client.0.smithi081.stdout: create 182/32 file after the snapshot 2023-10-25T23:37:37.606 INFO:tasks.workunit.client.0.smithi081.stdout: create 182/33 file after the snapshot 2023-10-25T23:37:37.607 INFO:tasks.workunit.client.0.smithi081.stdout: create 182/34 file after the snapshot 2023-10-25T23:37:37.608 INFO:tasks.workunit.client.0.smithi081.stdout: create 182/35 file after the snapshot 2023-10-25T23:37:37.609 INFO:tasks.workunit.client.0.smithi081.stdout: create 182/36 file after the snapshot 2023-10-25T23:37:37.609 INFO:tasks.workunit.client.0.smithi081.stdout: create 182/37 file after the snapshot 2023-10-25T23:37:37.610 INFO:tasks.workunit.client.0.smithi081.stdout: create 182/38 file after the snapshot 2023-10-25T23:37:37.612 INFO:tasks.workunit.client.0.smithi081.stdout: create 182/39 file after the snapshot 2023-10-25T23:37:37.612 INFO:tasks.workunit.client.0.smithi081.stdout: create 183/.snap/snap-subdir-test 2023-10-25T23:37:37.644 INFO:tasks.workunit.client.0.smithi081.stdout: create 183/30 file after the snapshot 2023-10-25T23:37:37.646 INFO:tasks.workunit.client.0.smithi081.stdout: create 183/31 file after the snapshot 2023-10-25T23:37:37.648 INFO:tasks.workunit.client.0.smithi081.stdout: create 183/32 file after the snapshot 2023-10-25T23:37:37.649 INFO:tasks.workunit.client.0.smithi081.stdout: create 183/33 file after the snapshot 2023-10-25T23:37:37.651 INFO:tasks.workunit.client.0.smithi081.stdout: create 183/34 file after the snapshot 2023-10-25T23:37:37.652 INFO:tasks.workunit.client.0.smithi081.stdout: create 183/35 file after the snapshot 2023-10-25T23:37:37.653 INFO:tasks.workunit.client.0.smithi081.stdout: create 183/36 file after the snapshot 2023-10-25T23:37:37.655 INFO:tasks.workunit.client.0.smithi081.stdout: create 183/37 file after the snapshot 2023-10-25T23:37:37.656 INFO:tasks.workunit.client.0.smithi081.stdout: create 183/38 file after the snapshot 2023-10-25T23:37:37.657 INFO:tasks.workunit.client.0.smithi081.stdout: create 183/39 file after the snapshot 2023-10-25T23:37:37.658 INFO:tasks.workunit.client.0.smithi081.stdout: create 184/.snap/snap-subdir-test 2023-10-25T23:37:37.689 INFO:tasks.workunit.client.0.smithi081.stdout: create 184/30 file after the snapshot 2023-10-25T23:37:37.692 INFO:tasks.workunit.client.0.smithi081.stdout: create 184/31 file after the snapshot 2023-10-25T23:37:37.694 INFO:tasks.workunit.client.0.smithi081.stdout: create 184/32 file after the snapshot 2023-10-25T23:37:37.697 INFO:tasks.workunit.client.0.smithi081.stdout: create 184/33 file after the snapshot 2023-10-25T23:37:37.699 INFO:tasks.workunit.client.0.smithi081.stdout: create 184/34 file after the snapshot 2023-10-25T23:37:37.701 INFO:tasks.workunit.client.0.smithi081.stdout: create 184/35 file after the snapshot 2023-10-25T23:37:37.702 INFO:tasks.workunit.client.0.smithi081.stdout: create 184/36 file after the snapshot 2023-10-25T23:37:37.703 INFO:tasks.workunit.client.0.smithi081.stdout: create 184/37 file after the snapshot 2023-10-25T23:37:37.704 INFO:tasks.workunit.client.0.smithi081.stdout: create 184/38 file after the snapshot 2023-10-25T23:37:37.705 INFO:tasks.workunit.client.0.smithi081.stdout: create 184/39 file after the snapshot 2023-10-25T23:37:37.706 INFO:tasks.workunit.client.0.smithi081.stdout: create 185/.snap/snap-subdir-test 2023-10-25T23:37:37.735 INFO:tasks.workunit.client.0.smithi081.stdout: create 185/30 file after the snapshot 2023-10-25T23:37:37.737 INFO:tasks.workunit.client.0.smithi081.stdout: create 185/31 file after the snapshot 2023-10-25T23:37:37.738 INFO:tasks.workunit.client.0.smithi081.stdout: create 185/32 file after the snapshot 2023-10-25T23:37:37.739 INFO:tasks.workunit.client.0.smithi081.stdout: create 185/33 file after the snapshot 2023-10-25T23:37:37.741 INFO:tasks.workunit.client.0.smithi081.stdout: create 185/34 file after the snapshot 2023-10-25T23:37:37.742 INFO:tasks.workunit.client.0.smithi081.stdout: create 185/35 file after the snapshot 2023-10-25T23:37:37.743 INFO:tasks.workunit.client.0.smithi081.stdout: create 185/36 file after the snapshot 2023-10-25T23:37:37.745 INFO:tasks.workunit.client.0.smithi081.stdout: create 185/37 file after the snapshot 2023-10-25T23:37:37.746 INFO:tasks.workunit.client.0.smithi081.stdout: create 185/38 file after the snapshot 2023-10-25T23:37:37.747 INFO:tasks.workunit.client.0.smithi081.stdout: create 185/39 file after the snapshot 2023-10-25T23:37:37.748 INFO:tasks.workunit.client.0.smithi081.stdout: create 186/.snap/snap-subdir-test 2023-10-25T23:37:37.777 INFO:tasks.workunit.client.0.smithi081.stdout: create 186/30 file after the snapshot 2023-10-25T23:37:37.779 INFO:tasks.workunit.client.0.smithi081.stdout: create 186/31 file after the snapshot 2023-10-25T23:37:37.780 INFO:tasks.workunit.client.0.smithi081.stdout: create 186/32 file after the snapshot 2023-10-25T23:37:37.782 INFO:tasks.workunit.client.0.smithi081.stdout: create 186/33 file after the snapshot 2023-10-25T23:37:37.783 INFO:tasks.workunit.client.0.smithi081.stdout: create 186/34 file after the snapshot 2023-10-25T23:37:37.784 INFO:tasks.workunit.client.0.smithi081.stdout: create 186/35 file after the snapshot 2023-10-25T23:37:37.785 INFO:tasks.workunit.client.0.smithi081.stdout: create 186/36 file after the snapshot 2023-10-25T23:37:37.787 INFO:tasks.workunit.client.0.smithi081.stdout: create 186/37 file after the snapshot 2023-10-25T23:37:37.788 INFO:tasks.workunit.client.0.smithi081.stdout: create 186/38 file after the snapshot 2023-10-25T23:37:37.790 INFO:tasks.workunit.client.0.smithi081.stdout: create 186/39 file after the snapshot 2023-10-25T23:37:37.792 INFO:tasks.workunit.client.0.smithi081.stdout: create 187/.snap/snap-subdir-test 2023-10-25T23:37:37.822 INFO:tasks.workunit.client.0.smithi081.stdout: create 187/30 file after the snapshot 2023-10-25T23:37:37.824 INFO:tasks.workunit.client.0.smithi081.stdout: create 187/31 file after the snapshot 2023-10-25T23:37:37.825 INFO:tasks.workunit.client.0.smithi081.stdout: create 187/32 file after the snapshot 2023-10-25T23:37:37.826 INFO:tasks.workunit.client.0.smithi081.stdout: create 187/33 file after the snapshot 2023-10-25T23:37:37.828 INFO:tasks.workunit.client.0.smithi081.stdout: create 187/34 file after the snapshot 2023-10-25T23:37:37.829 INFO:tasks.workunit.client.0.smithi081.stdout: create 187/35 file after the snapshot 2023-10-25T23:37:37.831 INFO:tasks.workunit.client.0.smithi081.stdout: create 187/36 file after the snapshot 2023-10-25T23:37:37.832 INFO:tasks.workunit.client.0.smithi081.stdout: create 187/37 file after the snapshot 2023-10-25T23:37:37.834 INFO:tasks.workunit.client.0.smithi081.stdout: create 187/38 file after the snapshot 2023-10-25T23:37:37.835 INFO:tasks.workunit.client.0.smithi081.stdout: create 187/39 file after the snapshot 2023-10-25T23:37:37.836 INFO:tasks.workunit.client.0.smithi081.stdout: create 188/.snap/snap-subdir-test 2023-10-25T23:37:37.867 INFO:tasks.workunit.client.0.smithi081.stdout: create 188/30 file after the snapshot 2023-10-25T23:37:37.869 INFO:tasks.workunit.client.0.smithi081.stdout: create 188/31 file after the snapshot 2023-10-25T23:37:37.870 INFO:tasks.workunit.client.0.smithi081.stdout: create 188/32 file after the snapshot 2023-10-25T23:37:37.872 INFO:tasks.workunit.client.0.smithi081.stdout: create 188/33 file after the snapshot 2023-10-25T23:37:37.873 INFO:tasks.workunit.client.0.smithi081.stdout: create 188/34 file after the snapshot 2023-10-25T23:37:37.874 INFO:tasks.workunit.client.0.smithi081.stdout: create 188/35 file after the snapshot 2023-10-25T23:37:37.875 INFO:tasks.workunit.client.0.smithi081.stdout: create 188/36 file after the snapshot 2023-10-25T23:37:37.877 INFO:tasks.workunit.client.0.smithi081.stdout: create 188/37 file after the snapshot 2023-10-25T23:37:37.878 INFO:tasks.workunit.client.0.smithi081.stdout: create 188/38 file after the snapshot 2023-10-25T23:37:37.879 INFO:tasks.workunit.client.0.smithi081.stdout: create 188/39 file after the snapshot 2023-10-25T23:37:37.880 INFO:tasks.workunit.client.0.smithi081.stdout: create 189/.snap/snap-subdir-test 2023-10-25T23:37:37.907 INFO:tasks.workunit.client.0.smithi081.stdout: create 189/30 file after the snapshot 2023-10-25T23:37:37.909 INFO:tasks.workunit.client.0.smithi081.stdout: create 189/31 file after the snapshot 2023-10-25T23:37:37.910 INFO:tasks.workunit.client.0.smithi081.stdout: create 189/32 file after the snapshot 2023-10-25T23:37:37.911 INFO:tasks.workunit.client.0.smithi081.stdout: create 189/33 file after the snapshot 2023-10-25T23:37:37.911 INFO:tasks.workunit.client.0.smithi081.stdout: create 189/34 file after the snapshot 2023-10-25T23:37:37.912 INFO:tasks.workunit.client.0.smithi081.stdout: create 189/35 file after the snapshot 2023-10-25T23:37:37.913 INFO:tasks.workunit.client.0.smithi081.stdout: create 189/36 file after the snapshot 2023-10-25T23:37:37.914 INFO:tasks.workunit.client.0.smithi081.stdout: create 189/37 file after the snapshot 2023-10-25T23:37:37.915 INFO:tasks.workunit.client.0.smithi081.stdout: create 189/38 file after the snapshot 2023-10-25T23:37:37.916 INFO:tasks.workunit.client.0.smithi081.stdout: create 189/39 file after the snapshot 2023-10-25T23:37:37.917 INFO:tasks.workunit.client.0.smithi081.stdout: create 190/.snap/snap-subdir-test 2023-10-25T23:37:37.945 INFO:tasks.workunit.client.0.smithi081.stdout: create 190/30 file after the snapshot 2023-10-25T23:37:37.946 INFO:tasks.workunit.client.0.smithi081.stdout: create 190/31 file after the snapshot 2023-10-25T23:37:37.947 INFO:tasks.workunit.client.0.smithi081.stdout: create 190/32 file after the snapshot 2023-10-25T23:37:37.948 INFO:tasks.workunit.client.0.smithi081.stdout: create 190/33 file after the snapshot 2023-10-25T23:37:37.949 INFO:tasks.workunit.client.0.smithi081.stdout: create 190/34 file after the snapshot 2023-10-25T23:37:37.949 INFO:tasks.workunit.client.0.smithi081.stdout: create 190/35 file after the snapshot 2023-10-25T23:37:37.950 INFO:tasks.workunit.client.0.smithi081.stdout: create 190/36 file after the snapshot 2023-10-25T23:37:37.951 INFO:tasks.workunit.client.0.smithi081.stdout: create 190/37 file after the snapshot 2023-10-25T23:37:37.952 INFO:tasks.workunit.client.0.smithi081.stdout: create 190/38 file after the snapshot 2023-10-25T23:37:37.953 INFO:tasks.workunit.client.0.smithi081.stdout: create 190/39 file after the snapshot 2023-10-25T23:37:37.954 INFO:tasks.workunit.client.0.smithi081.stdout: create 191/.snap/snap-subdir-test 2023-10-25T23:37:37.981 INFO:tasks.workunit.client.0.smithi081.stdout: create 191/30 file after the snapshot 2023-10-25T23:37:37.983 INFO:tasks.workunit.client.0.smithi081.stdout: create 191/31 file after the snapshot 2023-10-25T23:37:37.984 INFO:tasks.workunit.client.0.smithi081.stdout: create 191/32 file after the snapshot 2023-10-25T23:37:37.985 INFO:tasks.workunit.client.0.smithi081.stdout: create 191/33 file after the snapshot 2023-10-25T23:37:37.986 INFO:tasks.workunit.client.0.smithi081.stdout: create 191/34 file after the snapshot 2023-10-25T23:37:37.987 INFO:tasks.workunit.client.0.smithi081.stdout: create 191/35 file after the snapshot 2023-10-25T23:37:37.988 INFO:tasks.workunit.client.0.smithi081.stdout: create 191/36 file after the snapshot 2023-10-25T23:37:37.989 INFO:tasks.workunit.client.0.smithi081.stdout: create 191/37 file after the snapshot 2023-10-25T23:37:37.990 INFO:tasks.workunit.client.0.smithi081.stdout: create 191/38 file after the snapshot 2023-10-25T23:37:37.992 INFO:tasks.workunit.client.0.smithi081.stdout: create 191/39 file after the snapshot 2023-10-25T23:37:37.993 INFO:tasks.workunit.client.0.smithi081.stdout: create 192/.snap/snap-subdir-test 2023-10-25T23:37:38.023 INFO:tasks.workunit.client.0.smithi081.stdout: create 192/30 file after the snapshot 2023-10-25T23:37:38.024 INFO:tasks.workunit.client.0.smithi081.stdout: create 192/31 file after the snapshot 2023-10-25T23:37:38.025 INFO:tasks.workunit.client.0.smithi081.stdout: create 192/32 file after the snapshot 2023-10-25T23:37:38.026 INFO:tasks.workunit.client.0.smithi081.stdout: create 192/33 file after the snapshot 2023-10-25T23:37:38.027 INFO:tasks.workunit.client.0.smithi081.stdout: create 192/34 file after the snapshot 2023-10-25T23:37:38.028 INFO:tasks.workunit.client.0.smithi081.stdout: create 192/35 file after the snapshot 2023-10-25T23:37:38.029 INFO:tasks.workunit.client.0.smithi081.stdout: create 192/36 file after the snapshot 2023-10-25T23:37:38.030 INFO:tasks.workunit.client.0.smithi081.stdout: create 192/37 file after the snapshot 2023-10-25T23:37:38.031 INFO:tasks.workunit.client.0.smithi081.stdout: create 192/38 file after the snapshot 2023-10-25T23:37:38.032 INFO:tasks.workunit.client.0.smithi081.stdout: create 192/39 file after the snapshot 2023-10-25T23:37:38.033 INFO:tasks.workunit.client.0.smithi081.stdout: create 193/.snap/snap-subdir-test 2023-10-25T23:37:38.059 INFO:tasks.workunit.client.0.smithi081.stdout: create 193/30 file after the snapshot 2023-10-25T23:37:38.061 INFO:tasks.workunit.client.0.smithi081.stdout: create 193/31 file after the snapshot 2023-10-25T23:37:38.062 INFO:tasks.workunit.client.0.smithi081.stdout: create 193/32 file after the snapshot 2023-10-25T23:37:38.063 INFO:tasks.workunit.client.0.smithi081.stdout: create 193/33 file after the snapshot 2023-10-25T23:37:38.064 INFO:tasks.workunit.client.0.smithi081.stdout: create 193/34 file after the snapshot 2023-10-25T23:37:38.064 INFO:tasks.workunit.client.0.smithi081.stdout: create 193/35 file after the snapshot 2023-10-25T23:37:38.065 INFO:tasks.workunit.client.0.smithi081.stdout: create 193/36 file after the snapshot 2023-10-25T23:37:38.066 INFO:tasks.workunit.client.0.smithi081.stdout: create 193/37 file after the snapshot 2023-10-25T23:37:38.067 INFO:tasks.workunit.client.0.smithi081.stdout: create 193/38 file after the snapshot 2023-10-25T23:37:38.068 INFO:tasks.workunit.client.0.smithi081.stdout: create 193/39 file after the snapshot 2023-10-25T23:37:38.069 INFO:tasks.workunit.client.0.smithi081.stdout: create 194/.snap/snap-subdir-test 2023-10-25T23:37:38.097 INFO:tasks.workunit.client.0.smithi081.stdout: create 194/30 file after the snapshot 2023-10-25T23:37:38.098 INFO:tasks.workunit.client.0.smithi081.stdout: create 194/31 file after the snapshot 2023-10-25T23:37:38.099 INFO:tasks.workunit.client.0.smithi081.stdout: create 194/32 file after the snapshot 2023-10-25T23:37:38.100 INFO:tasks.workunit.client.0.smithi081.stdout: create 194/33 file after the snapshot 2023-10-25T23:37:38.101 INFO:tasks.workunit.client.0.smithi081.stdout: create 194/34 file after the snapshot 2023-10-25T23:37:38.102 INFO:tasks.workunit.client.0.smithi081.stdout: create 194/35 file after the snapshot 2023-10-25T23:37:38.103 INFO:tasks.workunit.client.0.smithi081.stdout: create 194/36 file after the snapshot 2023-10-25T23:37:38.105 INFO:tasks.workunit.client.0.smithi081.stdout: create 194/37 file after the snapshot 2023-10-25T23:37:38.106 INFO:tasks.workunit.client.0.smithi081.stdout: create 194/38 file after the snapshot 2023-10-25T23:37:38.107 INFO:tasks.workunit.client.0.smithi081.stdout: create 194/39 file after the snapshot 2023-10-25T23:37:38.108 INFO:tasks.workunit.client.0.smithi081.stdout: create 195/.snap/snap-subdir-test 2023-10-25T23:37:38.137 INFO:tasks.workunit.client.0.smithi081.stdout: create 195/30 file after the snapshot 2023-10-25T23:37:38.138 INFO:tasks.workunit.client.0.smithi081.stdout: create 195/31 file after the snapshot 2023-10-25T23:37:38.139 INFO:tasks.workunit.client.0.smithi081.stdout: create 195/32 file after the snapshot 2023-10-25T23:37:38.140 INFO:tasks.workunit.client.0.smithi081.stdout: create 195/33 file after the snapshot 2023-10-25T23:37:38.141 INFO:tasks.workunit.client.0.smithi081.stdout: create 195/34 file after the snapshot 2023-10-25T23:37:38.142 INFO:tasks.workunit.client.0.smithi081.stdout: create 195/35 file after the snapshot 2023-10-25T23:37:38.143 INFO:tasks.workunit.client.0.smithi081.stdout: create 195/36 file after the snapshot 2023-10-25T23:37:38.144 INFO:tasks.workunit.client.0.smithi081.stdout: create 195/37 file after the snapshot 2023-10-25T23:37:38.145 INFO:tasks.workunit.client.0.smithi081.stdout: create 195/38 file after the snapshot 2023-10-25T23:37:38.146 INFO:tasks.workunit.client.0.smithi081.stdout: create 195/39 file after the snapshot 2023-10-25T23:37:38.147 INFO:tasks.workunit.client.0.smithi081.stdout: create 196/.snap/snap-subdir-test 2023-10-25T23:37:38.174 INFO:tasks.workunit.client.0.smithi081.stdout: create 196/30 file after the snapshot 2023-10-25T23:37:38.175 INFO:tasks.workunit.client.0.smithi081.stdout: create 196/31 file after the snapshot 2023-10-25T23:37:38.176 INFO:tasks.workunit.client.0.smithi081.stdout: create 196/32 file after the snapshot 2023-10-25T23:37:38.177 INFO:tasks.workunit.client.0.smithi081.stdout: create 196/33 file after the snapshot 2023-10-25T23:37:38.178 INFO:tasks.workunit.client.0.smithi081.stdout: create 196/34 file after the snapshot 2023-10-25T23:37:38.179 INFO:tasks.workunit.client.0.smithi081.stdout: create 196/35 file after the snapshot 2023-10-25T23:37:38.180 INFO:tasks.workunit.client.0.smithi081.stdout: create 196/36 file after the snapshot 2023-10-25T23:37:38.181 INFO:tasks.workunit.client.0.smithi081.stdout: create 196/37 file after the snapshot 2023-10-25T23:37:38.182 INFO:tasks.workunit.client.0.smithi081.stdout: create 196/38 file after the snapshot 2023-10-25T23:37:38.183 INFO:tasks.workunit.client.0.smithi081.stdout: create 196/39 file after the snapshot 2023-10-25T23:37:38.184 INFO:tasks.workunit.client.0.smithi081.stdout: create 197/.snap/snap-subdir-test 2023-10-25T23:37:38.211 INFO:tasks.workunit.client.0.smithi081.stdout: create 197/30 file after the snapshot 2023-10-25T23:37:38.212 INFO:tasks.workunit.client.0.smithi081.stdout: create 197/31 file after the snapshot 2023-10-25T23:37:38.213 INFO:tasks.workunit.client.0.smithi081.stdout: create 197/32 file after the snapshot 2023-10-25T23:37:38.214 INFO:tasks.workunit.client.0.smithi081.stdout: create 197/33 file after the snapshot 2023-10-25T23:37:38.215 INFO:tasks.workunit.client.0.smithi081.stdout: create 197/34 file after the snapshot 2023-10-25T23:37:38.216 INFO:tasks.workunit.client.0.smithi081.stdout: create 197/35 file after the snapshot 2023-10-25T23:37:38.217 INFO:tasks.workunit.client.0.smithi081.stdout: create 197/36 file after the snapshot 2023-10-25T23:37:38.218 INFO:tasks.workunit.client.0.smithi081.stdout: create 197/37 file after the snapshot 2023-10-25T23:37:38.218 INFO:tasks.workunit.client.0.smithi081.stdout: create 197/38 file after the snapshot 2023-10-25T23:37:38.220 INFO:tasks.workunit.client.0.smithi081.stdout: create 197/39 file after the snapshot 2023-10-25T23:37:38.220 INFO:tasks.workunit.client.0.smithi081.stdout: create 198/.snap/snap-subdir-test 2023-10-25T23:37:38.248 INFO:tasks.workunit.client.0.smithi081.stdout: create 198/30 file after the snapshot 2023-10-25T23:37:38.249 INFO:tasks.workunit.client.0.smithi081.stdout: create 198/31 file after the snapshot 2023-10-25T23:37:38.250 INFO:tasks.workunit.client.0.smithi081.stdout: create 198/32 file after the snapshot 2023-10-25T23:37:38.251 INFO:tasks.workunit.client.0.smithi081.stdout: create 198/33 file after the snapshot 2023-10-25T23:37:38.252 INFO:tasks.workunit.client.0.smithi081.stdout: create 198/34 file after the snapshot 2023-10-25T23:37:38.253 INFO:tasks.workunit.client.0.smithi081.stdout: create 198/35 file after the snapshot 2023-10-25T23:37:38.253 INFO:tasks.workunit.client.0.smithi081.stdout: create 198/36 file after the snapshot 2023-10-25T23:37:38.255 INFO:tasks.workunit.client.0.smithi081.stdout: create 198/37 file after the snapshot 2023-10-25T23:37:38.255 INFO:tasks.workunit.client.0.smithi081.stdout: create 198/38 file after the snapshot 2023-10-25T23:37:38.256 INFO:tasks.workunit.client.0.smithi081.stdout: create 198/39 file after the snapshot 2023-10-25T23:37:38.257 INFO:tasks.workunit.client.0.smithi081.stdout: create 199/.snap/snap-subdir-test 2023-10-25T23:37:38.285 INFO:tasks.workunit.client.0.smithi081.stdout: create 199/30 file after the snapshot 2023-10-25T23:37:38.286 INFO:tasks.workunit.client.0.smithi081.stdout: create 199/31 file after the snapshot 2023-10-25T23:37:38.287 INFO:tasks.workunit.client.0.smithi081.stdout: create 199/32 file after the snapshot 2023-10-25T23:37:38.287 INFO:tasks.workunit.client.0.smithi081.stdout: create 199/33 file after the snapshot 2023-10-25T23:37:38.300 INFO:tasks.workunit.client.0.smithi081.stdout: create 199/34 file after the snapshot 2023-10-25T23:37:38.301 INFO:tasks.workunit.client.0.smithi081.stdout: create 199/35 file after the snapshot 2023-10-25T23:37:38.302 INFO:tasks.workunit.client.0.smithi081.stdout: create 199/36 file after the snapshot 2023-10-25T23:37:38.302 INFO:tasks.workunit.client.0.smithi081.stdout: create 199/37 file after the snapshot 2023-10-25T23:37:38.303 INFO:tasks.workunit.client.0.smithi081.stdout: create 199/38 file after the snapshot 2023-10-25T23:37:38.303 INFO:tasks.workunit.client.0.smithi081.stdout: create 199/39 file after the snapshot 2023-10-25T23:37:38.304 INFO:tasks.workunit.client.0.smithi081.stdout: create 200/.snap/snap-subdir-test 2023-10-25T23:37:38.333 INFO:tasks.workunit.client.0.smithi081.stdout: create 200/30 file after the snapshot 2023-10-25T23:37:38.334 INFO:tasks.workunit.client.0.smithi081.stdout: create 200/31 file after the snapshot 2023-10-25T23:37:38.335 INFO:tasks.workunit.client.0.smithi081.stdout: create 200/32 file after the snapshot 2023-10-25T23:37:38.336 INFO:tasks.workunit.client.0.smithi081.stdout: create 200/33 file after the snapshot 2023-10-25T23:37:38.337 INFO:tasks.workunit.client.0.smithi081.stdout: create 200/34 file after the snapshot 2023-10-25T23:37:38.337 INFO:tasks.workunit.client.0.smithi081.stdout: create 200/35 file after the snapshot 2023-10-25T23:37:38.338 INFO:tasks.workunit.client.0.smithi081.stdout: create 200/36 file after the snapshot 2023-10-25T23:37:38.339 INFO:tasks.workunit.client.0.smithi081.stdout: create 200/37 file after the snapshot 2023-10-25T23:37:38.340 INFO:tasks.workunit.client.0.smithi081.stdout: create 200/38 file after the snapshot 2023-10-25T23:37:38.386 INFO:tasks.workunit.client.0.smithi081.stdout: create 200/39 file after the snapshot 2023-10-25T23:37:38.386 INFO:tasks.workunit.client.0.smithi081.stdout: create 201/.snap/snap-subdir-test 2023-10-25T23:37:38.418 INFO:tasks.workunit.client.0.smithi081.stdout: create 201/30 file after the snapshot 2023-10-25T23:37:38.419 INFO:tasks.workunit.client.0.smithi081.stdout: create 201/31 file after the snapshot 2023-10-25T23:37:38.420 INFO:tasks.workunit.client.0.smithi081.stdout: create 201/32 file after the snapshot 2023-10-25T23:37:38.421 INFO:tasks.workunit.client.0.smithi081.stdout: create 201/33 file after the snapshot 2023-10-25T23:37:38.422 INFO:tasks.workunit.client.0.smithi081.stdout: create 201/34 file after the snapshot 2023-10-25T23:37:38.423 INFO:tasks.workunit.client.0.smithi081.stdout: create 201/35 file after the snapshot 2023-10-25T23:37:38.424 INFO:tasks.workunit.client.0.smithi081.stdout: create 201/36 file after the snapshot 2023-10-25T23:37:38.424 INFO:tasks.workunit.client.0.smithi081.stdout: create 201/37 file after the snapshot 2023-10-25T23:37:38.425 INFO:tasks.workunit.client.0.smithi081.stdout: create 201/38 file after the snapshot 2023-10-25T23:37:38.426 INFO:tasks.workunit.client.0.smithi081.stdout: create 201/39 file after the snapshot 2023-10-25T23:37:38.427 INFO:tasks.workunit.client.0.smithi081.stdout: create 202/.snap/snap-subdir-test 2023-10-25T23:37:38.467 INFO:tasks.workunit.client.0.smithi081.stdout: create 202/30 file after the snapshot 2023-10-25T23:37:38.470 INFO:tasks.workunit.client.0.smithi081.stdout: create 202/31 file after the snapshot 2023-10-25T23:37:38.472 INFO:tasks.workunit.client.0.smithi081.stdout: create 202/32 file after the snapshot 2023-10-25T23:37:38.474 INFO:tasks.workunit.client.0.smithi081.stdout: create 202/33 file after the snapshot 2023-10-25T23:37:38.476 INFO:tasks.workunit.client.0.smithi081.stdout: create 202/34 file after the snapshot 2023-10-25T23:37:38.478 INFO:tasks.workunit.client.0.smithi081.stdout: create 202/35 file after the snapshot 2023-10-25T23:37:38.479 INFO:tasks.workunit.client.0.smithi081.stdout: create 202/36 file after the snapshot 2023-10-25T23:37:38.480 INFO:tasks.workunit.client.0.smithi081.stdout: create 202/37 file after the snapshot 2023-10-25T23:37:38.481 INFO:tasks.workunit.client.0.smithi081.stdout: create 202/38 file after the snapshot 2023-10-25T23:37:38.481 INFO:tasks.workunit.client.0.smithi081.stdout: create 202/39 file after the snapshot 2023-10-25T23:37:38.482 INFO:tasks.workunit.client.0.smithi081.stdout: create 203/.snap/snap-subdir-test 2023-10-25T23:37:38.518 INFO:tasks.workunit.client.0.smithi081.stdout: create 203/30 file after the snapshot 2023-10-25T23:37:38.520 INFO:tasks.workunit.client.0.smithi081.stdout: create 203/31 file after the snapshot 2023-10-25T23:37:38.522 INFO:tasks.workunit.client.0.smithi081.stdout: create 203/32 file after the snapshot 2023-10-25T23:37:38.524 INFO:tasks.workunit.client.0.smithi081.stdout: create 203/33 file after the snapshot 2023-10-25T23:37:38.526 INFO:tasks.workunit.client.0.smithi081.stdout: create 203/34 file after the snapshot 2023-10-25T23:37:38.528 INFO:tasks.workunit.client.0.smithi081.stdout: create 203/35 file after the snapshot 2023-10-25T23:37:38.529 INFO:tasks.workunit.client.0.smithi081.stdout: create 203/36 file after the snapshot 2023-10-25T23:37:38.530 INFO:tasks.workunit.client.0.smithi081.stdout: create 203/37 file after the snapshot 2023-10-25T23:37:38.531 INFO:tasks.workunit.client.0.smithi081.stdout: create 203/38 file after the snapshot 2023-10-25T23:37:38.531 INFO:tasks.workunit.client.0.smithi081.stdout: create 203/39 file after the snapshot 2023-10-25T23:37:38.532 INFO:tasks.workunit.client.0.smithi081.stdout: create 204/.snap/snap-subdir-test 2023-10-25T23:37:38.570 INFO:tasks.workunit.client.0.smithi081.stdout: create 204/30 file after the snapshot 2023-10-25T23:37:38.572 INFO:tasks.workunit.client.0.smithi081.stdout: create 204/31 file after the snapshot 2023-10-25T23:37:38.574 INFO:tasks.workunit.client.0.smithi081.stdout: create 204/32 file after the snapshot 2023-10-25T23:37:38.576 INFO:tasks.workunit.client.0.smithi081.stdout: create 204/33 file after the snapshot 2023-10-25T23:37:38.578 INFO:tasks.workunit.client.0.smithi081.stdout: create 204/34 file after the snapshot 2023-10-25T23:37:38.580 INFO:tasks.workunit.client.0.smithi081.stdout: create 204/35 file after the snapshot 2023-10-25T23:37:38.582 INFO:tasks.workunit.client.0.smithi081.stdout: create 204/36 file after the snapshot 2023-10-25T23:37:38.582 INFO:tasks.workunit.client.0.smithi081.stdout: create 204/37 file after the snapshot 2023-10-25T23:37:38.583 INFO:tasks.workunit.client.0.smithi081.stdout: create 204/38 file after the snapshot 2023-10-25T23:37:38.584 INFO:tasks.workunit.client.0.smithi081.stdout: create 204/39 file after the snapshot 2023-10-25T23:37:38.584 INFO:tasks.workunit.client.0.smithi081.stdout: create 205/.snap/snap-subdir-test 2023-10-25T23:37:38.623 INFO:tasks.workunit.client.0.smithi081.stdout: create 205/30 file after the snapshot 2023-10-25T23:37:38.625 INFO:tasks.workunit.client.0.smithi081.stdout: create 205/31 file after the snapshot 2023-10-25T23:37:38.626 INFO:tasks.workunit.client.0.smithi081.stdout: create 205/32 file after the snapshot 2023-10-25T23:37:38.627 INFO:tasks.workunit.client.0.smithi081.stdout: create 205/33 file after the snapshot 2023-10-25T23:37:38.628 INFO:tasks.workunit.client.0.smithi081.stdout: create 205/34 file after the snapshot 2023-10-25T23:37:38.629 INFO:tasks.workunit.client.0.smithi081.stdout: create 205/35 file after the snapshot 2023-10-25T23:37:38.630 INFO:tasks.workunit.client.0.smithi081.stdout: create 205/36 file after the snapshot 2023-10-25T23:37:38.630 INFO:tasks.workunit.client.0.smithi081.stdout: create 205/37 file after the snapshot 2023-10-25T23:37:38.631 INFO:tasks.workunit.client.0.smithi081.stdout: create 205/38 file after the snapshot 2023-10-25T23:37:38.632 INFO:tasks.workunit.client.0.smithi081.stdout: create 205/39 file after the snapshot 2023-10-25T23:37:38.633 INFO:tasks.workunit.client.0.smithi081.stdout: create 206/.snap/snap-subdir-test 2023-10-25T23:37:38.667 INFO:tasks.workunit.client.0.smithi081.stdout: create 206/30 file after the snapshot 2023-10-25T23:37:38.668 INFO:tasks.workunit.client.0.smithi081.stdout: create 206/31 file after the snapshot 2023-10-25T23:37:38.669 INFO:tasks.workunit.client.0.smithi081.stdout: create 206/32 file after the snapshot 2023-10-25T23:37:38.670 INFO:tasks.workunit.client.0.smithi081.stdout: create 206/33 file after the snapshot 2023-10-25T23:37:38.671 INFO:tasks.workunit.client.0.smithi081.stdout: create 206/34 file after the snapshot 2023-10-25T23:37:38.672 INFO:tasks.workunit.client.0.smithi081.stdout: create 206/35 file after the snapshot 2023-10-25T23:37:38.673 INFO:tasks.workunit.client.0.smithi081.stdout: create 206/36 file after the snapshot 2023-10-25T23:37:38.674 INFO:tasks.workunit.client.0.smithi081.stdout: create 206/37 file after the snapshot 2023-10-25T23:37:38.675 INFO:tasks.workunit.client.0.smithi081.stdout: create 206/38 file after the snapshot 2023-10-25T23:37:38.676 INFO:tasks.workunit.client.0.smithi081.stdout: create 206/39 file after the snapshot 2023-10-25T23:37:38.676 INFO:tasks.workunit.client.0.smithi081.stdout: create 207/.snap/snap-subdir-test 2023-10-25T23:37:38.713 INFO:tasks.workunit.client.0.smithi081.stdout: create 207/30 file after the snapshot 2023-10-25T23:37:38.714 INFO:tasks.workunit.client.0.smithi081.stdout: create 207/31 file after the snapshot 2023-10-25T23:37:38.715 INFO:tasks.workunit.client.0.smithi081.stdout: create 207/32 file after the snapshot 2023-10-25T23:37:38.716 INFO:tasks.workunit.client.0.smithi081.stdout: create 207/33 file after the snapshot 2023-10-25T23:37:38.716 INFO:tasks.workunit.client.0.smithi081.stdout: create 207/34 file after the snapshot 2023-10-25T23:37:38.717 INFO:tasks.workunit.client.0.smithi081.stdout: create 207/35 file after the snapshot 2023-10-25T23:37:38.718 INFO:tasks.workunit.client.0.smithi081.stdout: create 207/36 file after the snapshot 2023-10-25T23:37:38.719 INFO:tasks.workunit.client.0.smithi081.stdout: create 207/37 file after the snapshot 2023-10-25T23:37:38.720 INFO:tasks.workunit.client.0.smithi081.stdout: create 207/38 file after the snapshot 2023-10-25T23:37:38.722 INFO:tasks.workunit.client.0.smithi081.stdout: create 207/39 file after the snapshot 2023-10-25T23:37:38.723 INFO:tasks.workunit.client.0.smithi081.stdout: create 208/.snap/snap-subdir-test 2023-10-25T23:37:38.754 INFO:tasks.workunit.client.0.smithi081.stdout: create 208/30 file after the snapshot 2023-10-25T23:37:38.755 INFO:tasks.workunit.client.0.smithi081.stdout: create 208/31 file after the snapshot 2023-10-25T23:37:38.756 INFO:tasks.workunit.client.0.smithi081.stdout: create 208/32 file after the snapshot 2023-10-25T23:37:38.757 INFO:tasks.workunit.client.0.smithi081.stdout: create 208/33 file after the snapshot 2023-10-25T23:37:38.758 INFO:tasks.workunit.client.0.smithi081.stdout: create 208/34 file after the snapshot 2023-10-25T23:37:38.759 INFO:tasks.workunit.client.0.smithi081.stdout: create 208/35 file after the snapshot 2023-10-25T23:37:38.759 INFO:tasks.workunit.client.0.smithi081.stdout: create 208/36 file after the snapshot 2023-10-25T23:37:38.760 INFO:tasks.workunit.client.0.smithi081.stdout: create 208/37 file after the snapshot 2023-10-25T23:37:38.761 INFO:tasks.workunit.client.0.smithi081.stdout: create 208/38 file after the snapshot 2023-10-25T23:37:38.762 INFO:tasks.workunit.client.0.smithi081.stdout: create 208/39 file after the snapshot 2023-10-25T23:37:38.763 INFO:tasks.workunit.client.0.smithi081.stdout: create 209/.snap/snap-subdir-test 2023-10-25T23:37:38.791 INFO:tasks.workunit.client.0.smithi081.stdout: create 209/30 file after the snapshot 2023-10-25T23:37:38.792 INFO:tasks.workunit.client.0.smithi081.stdout: create 209/31 file after the snapshot 2023-10-25T23:37:38.793 INFO:tasks.workunit.client.0.smithi081.stdout: create 209/32 file after the snapshot 2023-10-25T23:37:38.794 INFO:tasks.workunit.client.0.smithi081.stdout: create 209/33 file after the snapshot 2023-10-25T23:37:38.795 INFO:tasks.workunit.client.0.smithi081.stdout: create 209/34 file after the snapshot 2023-10-25T23:37:38.796 INFO:tasks.workunit.client.0.smithi081.stdout: create 209/35 file after the snapshot 2023-10-25T23:37:38.796 INFO:tasks.workunit.client.0.smithi081.stdout: create 209/36 file after the snapshot 2023-10-25T23:37:38.797 INFO:tasks.workunit.client.0.smithi081.stdout: create 209/37 file after the snapshot 2023-10-25T23:37:38.798 INFO:tasks.workunit.client.0.smithi081.stdout: create 209/38 file after the snapshot 2023-10-25T23:37:38.801 INFO:tasks.workunit.client.0.smithi081.stdout: create 209/39 file after the snapshot 2023-10-25T23:37:38.801 INFO:tasks.workunit.client.0.smithi081.stdout: create 210/.snap/snap-subdir-test 2023-10-25T23:37:38.831 INFO:tasks.workunit.client.0.smithi081.stdout: create 210/30 file after the snapshot 2023-10-25T23:37:38.834 INFO:tasks.workunit.client.0.smithi081.stdout: create 210/31 file after the snapshot 2023-10-25T23:37:38.837 INFO:tasks.workunit.client.0.smithi081.stdout: create 210/32 file after the snapshot 2023-10-25T23:37:38.839 INFO:tasks.workunit.client.0.smithi081.stdout: create 210/33 file after the snapshot 2023-10-25T23:37:38.841 INFO:tasks.workunit.client.0.smithi081.stdout: create 210/34 file after the snapshot 2023-10-25T23:37:38.843 INFO:tasks.workunit.client.0.smithi081.stdout: create 210/35 file after the snapshot 2023-10-25T23:37:38.844 INFO:tasks.workunit.client.0.smithi081.stdout: create 210/36 file after the snapshot 2023-10-25T23:37:38.845 INFO:tasks.workunit.client.0.smithi081.stdout: create 210/37 file after the snapshot 2023-10-25T23:37:38.846 INFO:tasks.workunit.client.0.smithi081.stdout: create 210/38 file after the snapshot 2023-10-25T23:37:38.847 INFO:tasks.workunit.client.0.smithi081.stdout: create 210/39 file after the snapshot 2023-10-25T23:37:38.848 INFO:tasks.workunit.client.0.smithi081.stdout: create 211/.snap/snap-subdir-test 2023-10-25T23:37:38.878 INFO:tasks.workunit.client.0.smithi081.stdout: create 211/30 file after the snapshot 2023-10-25T23:37:38.881 INFO:tasks.workunit.client.0.smithi081.stdout: create 211/31 file after the snapshot 2023-10-25T23:37:38.883 INFO:tasks.workunit.client.0.smithi081.stdout: create 211/32 file after the snapshot 2023-10-25T23:37:38.886 INFO:tasks.workunit.client.0.smithi081.stdout: create 211/33 file after the snapshot 2023-10-25T23:37:38.888 INFO:tasks.workunit.client.0.smithi081.stdout: create 211/34 file after the snapshot 2023-10-25T23:37:38.890 INFO:tasks.workunit.client.0.smithi081.stdout: create 211/35 file after the snapshot 2023-10-25T23:37:38.891 INFO:tasks.workunit.client.0.smithi081.stdout: create 211/36 file after the snapshot 2023-10-25T23:37:38.892 INFO:tasks.workunit.client.0.smithi081.stdout: create 211/37 file after the snapshot 2023-10-25T23:37:38.892 INFO:tasks.workunit.client.0.smithi081.stdout: create 211/38 file after the snapshot 2023-10-25T23:37:38.893 INFO:tasks.workunit.client.0.smithi081.stdout: create 211/39 file after the snapshot 2023-10-25T23:37:38.894 INFO:tasks.workunit.client.0.smithi081.stdout: create 212/.snap/snap-subdir-test 2023-10-25T23:37:38.926 INFO:tasks.workunit.client.0.smithi081.stdout: create 212/30 file after the snapshot 2023-10-25T23:37:38.927 INFO:tasks.workunit.client.0.smithi081.stdout: create 212/31 file after the snapshot 2023-10-25T23:37:38.928 INFO:tasks.workunit.client.0.smithi081.stdout: create 212/32 file after the snapshot 2023-10-25T23:37:38.929 INFO:tasks.workunit.client.0.smithi081.stdout: create 212/33 file after the snapshot 2023-10-25T23:37:38.929 INFO:tasks.workunit.client.0.smithi081.stdout: create 212/34 file after the snapshot 2023-10-25T23:37:38.930 INFO:tasks.workunit.client.0.smithi081.stdout: create 212/35 file after the snapshot 2023-10-25T23:37:38.931 INFO:tasks.workunit.client.0.smithi081.stdout: create 212/36 file after the snapshot 2023-10-25T23:37:38.932 INFO:tasks.workunit.client.0.smithi081.stdout: create 212/37 file after the snapshot 2023-10-25T23:37:38.933 INFO:tasks.workunit.client.0.smithi081.stdout: create 212/38 file after the snapshot 2023-10-25T23:37:38.934 INFO:tasks.workunit.client.0.smithi081.stdout: create 212/39 file after the snapshot 2023-10-25T23:37:38.935 INFO:tasks.workunit.client.0.smithi081.stdout: create 213/.snap/snap-subdir-test 2023-10-25T23:37:38.965 INFO:tasks.workunit.client.0.smithi081.stdout: create 213/30 file after the snapshot 2023-10-25T23:37:38.967 INFO:tasks.workunit.client.0.smithi081.stdout: create 213/31 file after the snapshot 2023-10-25T23:37:38.968 INFO:tasks.workunit.client.0.smithi081.stdout: create 213/32 file after the snapshot 2023-10-25T23:37:38.969 INFO:tasks.workunit.client.0.smithi081.stdout: create 213/33 file after the snapshot 2023-10-25T23:37:38.969 INFO:tasks.workunit.client.0.smithi081.stdout: create 213/34 file after the snapshot 2023-10-25T23:37:38.970 INFO:tasks.workunit.client.0.smithi081.stdout: create 213/35 file after the snapshot 2023-10-25T23:37:38.971 INFO:tasks.workunit.client.0.smithi081.stdout: create 213/36 file after the snapshot 2023-10-25T23:37:38.972 INFO:tasks.workunit.client.0.smithi081.stdout: create 213/37 file after the snapshot 2023-10-25T23:37:38.973 INFO:tasks.workunit.client.0.smithi081.stdout: create 213/38 file after the snapshot 2023-10-25T23:37:38.974 INFO:tasks.workunit.client.0.smithi081.stdout: create 213/39 file after the snapshot 2023-10-25T23:37:38.975 INFO:tasks.workunit.client.0.smithi081.stdout: create 214/.snap/snap-subdir-test 2023-10-25T23:37:39.004 INFO:tasks.workunit.client.0.smithi081.stdout: create 214/30 file after the snapshot 2023-10-25T23:37:39.007 INFO:tasks.workunit.client.0.smithi081.stdout: create 214/31 file after the snapshot 2023-10-25T23:37:39.009 INFO:tasks.workunit.client.0.smithi081.stdout: create 214/32 file after the snapshot 2023-10-25T23:37:39.011 INFO:tasks.workunit.client.0.smithi081.stdout: create 214/33 file after the snapshot 2023-10-25T23:37:39.012 INFO:tasks.workunit.client.0.smithi081.stdout: create 214/34 file after the snapshot 2023-10-25T23:37:39.013 INFO:tasks.workunit.client.0.smithi081.stdout: create 214/35 file after the snapshot 2023-10-25T23:37:39.014 INFO:tasks.workunit.client.0.smithi081.stdout: create 214/36 file after the snapshot 2023-10-25T23:37:39.015 INFO:tasks.workunit.client.0.smithi081.stdout: create 214/37 file after the snapshot 2023-10-25T23:37:39.016 INFO:tasks.workunit.client.0.smithi081.stdout: create 214/38 file after the snapshot 2023-10-25T23:37:39.017 INFO:tasks.workunit.client.0.smithi081.stdout: create 214/39 file after the snapshot 2023-10-25T23:37:39.018 INFO:tasks.workunit.client.0.smithi081.stdout: create 215/.snap/snap-subdir-test 2023-10-25T23:37:39.046 INFO:tasks.workunit.client.0.smithi081.stdout: create 215/30 file after the snapshot 2023-10-25T23:37:39.049 INFO:tasks.workunit.client.0.smithi081.stdout: create 215/31 file after the snapshot 2023-10-25T23:37:39.051 INFO:tasks.workunit.client.0.smithi081.stdout: create 215/32 file after the snapshot 2023-10-25T23:37:39.053 INFO:tasks.workunit.client.0.smithi081.stdout: create 215/33 file after the snapshot 2023-10-25T23:37:39.055 INFO:tasks.workunit.client.0.smithi081.stdout: create 215/34 file after the snapshot 2023-10-25T23:37:39.057 INFO:tasks.workunit.client.0.smithi081.stdout: create 215/35 file after the snapshot 2023-10-25T23:37:39.058 INFO:tasks.workunit.client.0.smithi081.stdout: create 215/36 file after the snapshot 2023-10-25T23:37:39.059 INFO:tasks.workunit.client.0.smithi081.stdout: create 215/37 file after the snapshot 2023-10-25T23:37:39.060 INFO:tasks.workunit.client.0.smithi081.stdout: create 215/38 file after the snapshot 2023-10-25T23:37:39.060 INFO:tasks.workunit.client.0.smithi081.stdout: create 215/39 file after the snapshot 2023-10-25T23:37:39.061 INFO:tasks.workunit.client.0.smithi081.stdout: create 216/.snap/snap-subdir-test 2023-10-25T23:37:39.089 INFO:tasks.workunit.client.0.smithi081.stdout: create 216/30 file after the snapshot 2023-10-25T23:37:39.091 INFO:tasks.workunit.client.0.smithi081.stdout: create 216/31 file after the snapshot 2023-10-25T23:37:39.091 INFO:tasks.workunit.client.0.smithi081.stdout: create 216/32 file after the snapshot 2023-10-25T23:37:39.092 INFO:tasks.workunit.client.0.smithi081.stdout: create 216/33 file after the snapshot 2023-10-25T23:37:39.093 INFO:tasks.workunit.client.0.smithi081.stdout: create 216/34 file after the snapshot 2023-10-25T23:37:39.094 INFO:tasks.workunit.client.0.smithi081.stdout: create 216/35 file after the snapshot 2023-10-25T23:37:39.095 INFO:tasks.workunit.client.0.smithi081.stdout: create 216/36 file after the snapshot 2023-10-25T23:37:39.096 INFO:tasks.workunit.client.0.smithi081.stdout: create 216/37 file after the snapshot 2023-10-25T23:37:39.097 INFO:tasks.workunit.client.0.smithi081.stdout: create 216/38 file after the snapshot 2023-10-25T23:37:39.097 INFO:tasks.workunit.client.0.smithi081.stdout: create 216/39 file after the snapshot 2023-10-25T23:37:39.098 INFO:tasks.workunit.client.0.smithi081.stdout: create 217/.snap/snap-subdir-test 2023-10-25T23:37:39.126 INFO:tasks.workunit.client.0.smithi081.stdout: create 217/30 file after the snapshot 2023-10-25T23:37:39.128 INFO:tasks.workunit.client.0.smithi081.stdout: create 217/31 file after the snapshot 2023-10-25T23:37:39.129 INFO:tasks.workunit.client.0.smithi081.stdout: create 217/32 file after the snapshot 2023-10-25T23:37:39.130 INFO:tasks.workunit.client.0.smithi081.stdout: create 217/33 file after the snapshot 2023-10-25T23:37:39.132 INFO:tasks.workunit.client.0.smithi081.stdout: create 217/34 file after the snapshot 2023-10-25T23:37:39.133 INFO:tasks.workunit.client.0.smithi081.stdout: create 217/35 file after the snapshot 2023-10-25T23:37:39.134 INFO:tasks.workunit.client.0.smithi081.stdout: create 217/36 file after the snapshot 2023-10-25T23:37:39.136 INFO:tasks.workunit.client.0.smithi081.stdout: create 217/37 file after the snapshot 2023-10-25T23:37:39.137 INFO:tasks.workunit.client.0.smithi081.stdout: create 217/38 file after the snapshot 2023-10-25T23:37:39.138 INFO:tasks.workunit.client.0.smithi081.stdout: create 217/39 file after the snapshot 2023-10-25T23:37:39.140 INFO:tasks.workunit.client.0.smithi081.stdout: create 218/.snap/snap-subdir-test 2023-10-25T23:37:39.167 INFO:tasks.workunit.client.0.smithi081.stdout: create 218/30 file after the snapshot 2023-10-25T23:37:39.168 INFO:tasks.workunit.client.0.smithi081.stdout: create 218/31 file after the snapshot 2023-10-25T23:37:39.170 INFO:tasks.workunit.client.0.smithi081.stdout: create 218/32 file after the snapshot 2023-10-25T23:37:39.171 INFO:tasks.workunit.client.0.smithi081.stdout: create 218/33 file after the snapshot 2023-10-25T23:37:39.172 INFO:tasks.workunit.client.0.smithi081.stdout: create 218/34 file after the snapshot 2023-10-25T23:37:39.174 INFO:tasks.workunit.client.0.smithi081.stdout: create 218/35 file after the snapshot 2023-10-25T23:37:39.175 INFO:tasks.workunit.client.0.smithi081.stdout: create 218/36 file after the snapshot 2023-10-25T23:37:39.177 INFO:tasks.workunit.client.0.smithi081.stdout: create 218/37 file after the snapshot 2023-10-25T23:37:39.178 INFO:tasks.workunit.client.0.smithi081.stdout: create 218/38 file after the snapshot 2023-10-25T23:37:39.179 INFO:tasks.workunit.client.0.smithi081.stdout: create 218/39 file after the snapshot 2023-10-25T23:37:39.181 INFO:tasks.workunit.client.0.smithi081.stdout: create 219/.snap/snap-subdir-test 2023-10-25T23:37:39.207 INFO:tasks.workunit.client.0.smithi081.stdout: create 219/30 file after the snapshot 2023-10-25T23:37:39.209 INFO:tasks.workunit.client.0.smithi081.stdout: create 219/31 file after the snapshot 2023-10-25T23:37:39.210 INFO:tasks.workunit.client.0.smithi081.stdout: create 219/32 file after the snapshot 2023-10-25T23:37:39.211 INFO:tasks.workunit.client.0.smithi081.stdout: create 219/33 file after the snapshot 2023-10-25T23:37:39.213 INFO:tasks.workunit.client.0.smithi081.stdout: create 219/34 file after the snapshot 2023-10-25T23:37:39.214 INFO:tasks.workunit.client.0.smithi081.stdout: create 219/35 file after the snapshot 2023-10-25T23:37:39.215 INFO:tasks.workunit.client.0.smithi081.stdout: create 219/36 file after the snapshot 2023-10-25T23:37:39.217 INFO:tasks.workunit.client.0.smithi081.stdout: create 219/37 file after the snapshot 2023-10-25T23:37:39.218 INFO:tasks.workunit.client.0.smithi081.stdout: create 219/38 file after the snapshot 2023-10-25T23:37:39.219 INFO:tasks.workunit.client.0.smithi081.stdout: create 219/39 file after the snapshot 2023-10-25T23:37:39.221 INFO:tasks.workunit.client.0.smithi081.stdout: create 220/.snap/snap-subdir-test 2023-10-25T23:37:39.247 INFO:tasks.workunit.client.0.smithi081.stdout: create 220/30 file after the snapshot 2023-10-25T23:37:39.249 INFO:tasks.workunit.client.0.smithi081.stdout: create 220/31 file after the snapshot 2023-10-25T23:37:39.250 INFO:tasks.workunit.client.0.smithi081.stdout: create 220/32 file after the snapshot 2023-10-25T23:37:39.252 INFO:tasks.workunit.client.0.smithi081.stdout: create 220/33 file after the snapshot 2023-10-25T23:37:39.253 INFO:tasks.workunit.client.0.smithi081.stdout: create 220/34 file after the snapshot 2023-10-25T23:37:39.254 INFO:tasks.workunit.client.0.smithi081.stdout: create 220/35 file after the snapshot 2023-10-25T23:37:39.256 INFO:tasks.workunit.client.0.smithi081.stdout: create 220/36 file after the snapshot 2023-10-25T23:37:39.257 INFO:tasks.workunit.client.0.smithi081.stdout: create 220/37 file after the snapshot 2023-10-25T23:37:39.258 INFO:tasks.workunit.client.0.smithi081.stdout: create 220/38 file after the snapshot 2023-10-25T23:37:39.260 INFO:tasks.workunit.client.0.smithi081.stdout: create 220/39 file after the snapshot 2023-10-25T23:37:39.261 INFO:tasks.workunit.client.0.smithi081.stdout: create 221/.snap/snap-subdir-test 2023-10-25T23:37:39.288 INFO:tasks.workunit.client.0.smithi081.stdout: create 221/30 file after the snapshot 2023-10-25T23:37:39.290 INFO:tasks.workunit.client.0.smithi081.stdout: create 221/31 file after the snapshot 2023-10-25T23:37:39.291 INFO:tasks.workunit.client.0.smithi081.stdout: create 221/32 file after the snapshot 2023-10-25T23:37:39.292 INFO:tasks.workunit.client.0.smithi081.stdout: create 221/33 file after the snapshot 2023-10-25T23:37:39.294 INFO:tasks.workunit.client.0.smithi081.stdout: create 221/34 file after the snapshot 2023-10-25T23:37:39.295 INFO:tasks.workunit.client.0.smithi081.stdout: create 221/35 file after the snapshot 2023-10-25T23:37:39.296 INFO:tasks.workunit.client.0.smithi081.stdout: create 221/36 file after the snapshot 2023-10-25T23:37:39.298 INFO:tasks.workunit.client.0.smithi081.stdout: create 221/37 file after the snapshot 2023-10-25T23:37:39.299 INFO:tasks.workunit.client.0.smithi081.stdout: create 221/38 file after the snapshot 2023-10-25T23:37:39.300 INFO:tasks.workunit.client.0.smithi081.stdout: create 221/39 file after the snapshot 2023-10-25T23:37:39.302 INFO:tasks.workunit.client.0.smithi081.stdout: create 222/.snap/snap-subdir-test 2023-10-25T23:37:39.328 INFO:tasks.workunit.client.0.smithi081.stdout: create 222/30 file after the snapshot 2023-10-25T23:37:39.329 INFO:tasks.workunit.client.0.smithi081.stdout: create 222/31 file after the snapshot 2023-10-25T23:37:39.330 INFO:tasks.workunit.client.0.smithi081.stdout: create 222/32 file after the snapshot 2023-10-25T23:37:39.331 INFO:tasks.workunit.client.0.smithi081.stdout: create 222/33 file after the snapshot 2023-10-25T23:37:39.331 INFO:tasks.workunit.client.0.smithi081.stdout: create 222/34 file after the snapshot 2023-10-25T23:37:39.332 INFO:tasks.workunit.client.0.smithi081.stdout: create 222/35 file after the snapshot 2023-10-25T23:37:39.333 INFO:tasks.workunit.client.0.smithi081.stdout: create 222/36 file after the snapshot 2023-10-25T23:37:39.334 INFO:tasks.workunit.client.0.smithi081.stdout: create 222/37 file after the snapshot 2023-10-25T23:37:39.335 INFO:tasks.workunit.client.0.smithi081.stdout: create 222/38 file after the snapshot 2023-10-25T23:37:39.336 INFO:tasks.workunit.client.0.smithi081.stdout: create 222/39 file after the snapshot 2023-10-25T23:37:39.337 INFO:tasks.workunit.client.0.smithi081.stdout: create 223/.snap/snap-subdir-test 2023-10-25T23:37:39.368 INFO:tasks.workunit.client.0.smithi081.stdout: create 223/30 file after the snapshot 2023-10-25T23:37:39.384 INFO:tasks.workunit.client.0.smithi081.stdout: create 223/31 file after the snapshot 2023-10-25T23:37:39.385 INFO:tasks.workunit.client.0.smithi081.stdout: create 223/32 file after the snapshot 2023-10-25T23:37:39.385 INFO:tasks.workunit.client.0.smithi081.stdout: create 223/33 file after the snapshot 2023-10-25T23:37:39.386 INFO:tasks.workunit.client.0.smithi081.stdout: create 223/34 file after the snapshot 2023-10-25T23:37:39.387 INFO:tasks.workunit.client.0.smithi081.stdout: create 223/35 file after the snapshot 2023-10-25T23:37:39.387 INFO:tasks.workunit.client.0.smithi081.stdout: create 223/36 file after the snapshot 2023-10-25T23:37:39.388 INFO:tasks.workunit.client.0.smithi081.stdout: create 223/37 file after the snapshot 2023-10-25T23:37:39.389 INFO:tasks.workunit.client.0.smithi081.stdout: create 223/38 file after the snapshot 2023-10-25T23:37:39.389 INFO:tasks.workunit.client.0.smithi081.stdout: create 223/39 file after the snapshot 2023-10-25T23:37:39.390 INFO:tasks.workunit.client.0.smithi081.stdout: create 224/.snap/snap-subdir-test 2023-10-25T23:37:39.420 INFO:tasks.workunit.client.0.smithi081.stdout: create 224/30 file after the snapshot 2023-10-25T23:37:39.421 INFO:tasks.workunit.client.0.smithi081.stdout: create 224/31 file after the snapshot 2023-10-25T23:37:39.422 INFO:tasks.workunit.client.0.smithi081.stdout: create 224/32 file after the snapshot 2023-10-25T23:37:39.423 INFO:tasks.workunit.client.0.smithi081.stdout: create 224/33 file after the snapshot 2023-10-25T23:37:39.424 INFO:tasks.workunit.client.0.smithi081.stdout: create 224/34 file after the snapshot 2023-10-25T23:37:39.425 INFO:tasks.workunit.client.0.smithi081.stdout: create 224/35 file after the snapshot 2023-10-25T23:37:39.426 INFO:tasks.workunit.client.0.smithi081.stdout: create 224/36 file after the snapshot 2023-10-25T23:37:39.426 INFO:tasks.workunit.client.0.smithi081.stdout: create 224/37 file after the snapshot 2023-10-25T23:37:39.427 INFO:tasks.workunit.client.0.smithi081.stdout: create 224/38 file after the snapshot 2023-10-25T23:37:39.428 INFO:tasks.workunit.client.0.smithi081.stdout: create 224/39 file after the snapshot 2023-10-25T23:37:39.429 INFO:tasks.workunit.client.0.smithi081.stdout: create 225/.snap/snap-subdir-test 2023-10-25T23:37:39.463 INFO:tasks.workunit.client.0.smithi081.stdout: create 225/30 file after the snapshot 2023-10-25T23:37:39.464 INFO:tasks.workunit.client.0.smithi081.stdout: create 225/31 file after the snapshot 2023-10-25T23:37:39.465 INFO:tasks.workunit.client.0.smithi081.stdout: create 225/32 file after the snapshot 2023-10-25T23:37:39.465 INFO:tasks.workunit.client.0.smithi081.stdout: create 225/33 file after the snapshot 2023-10-25T23:37:39.466 INFO:tasks.workunit.client.0.smithi081.stdout: create 225/34 file after the snapshot 2023-10-25T23:37:39.467 INFO:tasks.workunit.client.0.smithi081.stdout: create 225/35 file after the snapshot 2023-10-25T23:37:39.468 INFO:tasks.workunit.client.0.smithi081.stdout: create 225/36 file after the snapshot 2023-10-25T23:37:39.468 INFO:tasks.workunit.client.0.smithi081.stdout: create 225/37 file after the snapshot 2023-10-25T23:37:39.469 INFO:tasks.workunit.client.0.smithi081.stdout: create 225/38 file after the snapshot 2023-10-25T23:37:39.470 INFO:tasks.workunit.client.0.smithi081.stdout: create 225/39 file after the snapshot 2023-10-25T23:37:39.471 INFO:tasks.workunit.client.0.smithi081.stdout: create 226/.snap/snap-subdir-test 2023-10-25T23:37:39.504 INFO:tasks.workunit.client.0.smithi081.stdout: create 226/30 file after the snapshot 2023-10-25T23:37:39.505 INFO:tasks.workunit.client.0.smithi081.stdout: create 226/31 file after the snapshot 2023-10-25T23:37:39.506 INFO:tasks.workunit.client.0.smithi081.stdout: create 226/32 file after the snapshot 2023-10-25T23:37:39.507 INFO:tasks.workunit.client.0.smithi081.stdout: create 226/33 file after the snapshot 2023-10-25T23:37:39.508 INFO:tasks.workunit.client.0.smithi081.stdout: create 226/34 file after the snapshot 2023-10-25T23:37:39.509 INFO:tasks.workunit.client.0.smithi081.stdout: create 226/35 file after the snapshot 2023-10-25T23:37:39.510 INFO:tasks.workunit.client.0.smithi081.stdout: create 226/36 file after the snapshot 2023-10-25T23:37:39.511 INFO:tasks.workunit.client.0.smithi081.stdout: create 226/37 file after the snapshot 2023-10-25T23:37:39.511 INFO:tasks.workunit.client.0.smithi081.stdout: create 226/38 file after the snapshot 2023-10-25T23:37:39.512 INFO:tasks.workunit.client.0.smithi081.stdout: create 226/39 file after the snapshot 2023-10-25T23:37:39.513 INFO:tasks.workunit.client.0.smithi081.stdout: create 227/.snap/snap-subdir-test 2023-10-25T23:37:39.546 INFO:tasks.workunit.client.0.smithi081.stdout: create 227/30 file after the snapshot 2023-10-25T23:37:39.547 INFO:tasks.workunit.client.0.smithi081.stdout: create 227/31 file after the snapshot 2023-10-25T23:37:39.548 INFO:tasks.workunit.client.0.smithi081.stdout: create 227/32 file after the snapshot 2023-10-25T23:37:39.549 INFO:tasks.workunit.client.0.smithi081.stdout: create 227/33 file after the snapshot 2023-10-25T23:37:39.550 INFO:tasks.workunit.client.0.smithi081.stdout: create 227/34 file after the snapshot 2023-10-25T23:37:39.551 INFO:tasks.workunit.client.0.smithi081.stdout: create 227/35 file after the snapshot 2023-10-25T23:37:39.552 INFO:tasks.workunit.client.0.smithi081.stdout: create 227/36 file after the snapshot 2023-10-25T23:37:39.553 INFO:tasks.workunit.client.0.smithi081.stdout: create 227/37 file after the snapshot 2023-10-25T23:37:39.553 INFO:tasks.workunit.client.0.smithi081.stdout: create 227/38 file after the snapshot 2023-10-25T23:37:39.554 INFO:tasks.workunit.client.0.smithi081.stdout: create 227/39 file after the snapshot 2023-10-25T23:37:39.555 INFO:tasks.workunit.client.0.smithi081.stdout: create 228/.snap/snap-subdir-test 2023-10-25T23:37:39.588 INFO:tasks.workunit.client.0.smithi081.stdout: create 228/30 file after the snapshot 2023-10-25T23:37:39.589 INFO:tasks.workunit.client.0.smithi081.stdout: create 228/31 file after the snapshot 2023-10-25T23:37:39.590 INFO:tasks.workunit.client.0.smithi081.stdout: create 228/32 file after the snapshot 2023-10-25T23:37:39.591 INFO:tasks.workunit.client.0.smithi081.stdout: create 228/33 file after the snapshot 2023-10-25T23:37:39.592 INFO:tasks.workunit.client.0.smithi081.stdout: create 228/34 file after the snapshot 2023-10-25T23:37:39.593 INFO:tasks.workunit.client.0.smithi081.stdout: create 228/35 file after the snapshot 2023-10-25T23:37:39.594 INFO:tasks.workunit.client.0.smithi081.stdout: create 228/36 file after the snapshot 2023-10-25T23:37:39.595 INFO:tasks.workunit.client.0.smithi081.stdout: create 228/37 file after the snapshot 2023-10-25T23:37:39.595 INFO:tasks.workunit.client.0.smithi081.stdout: create 228/38 file after the snapshot 2023-10-25T23:37:39.596 INFO:tasks.workunit.client.0.smithi081.stdout: create 228/39 file after the snapshot 2023-10-25T23:37:39.597 INFO:tasks.workunit.client.0.smithi081.stdout: create 229/.snap/snap-subdir-test 2023-10-25T23:37:39.633 INFO:tasks.workunit.client.0.smithi081.stdout: create 229/30 file after the snapshot 2023-10-25T23:37:39.634 INFO:tasks.workunit.client.0.smithi081.stdout: create 229/31 file after the snapshot 2023-10-25T23:37:39.635 INFO:tasks.workunit.client.0.smithi081.stdout: create 229/32 file after the snapshot 2023-10-25T23:37:39.636 INFO:tasks.workunit.client.0.smithi081.stdout: create 229/33 file after the snapshot 2023-10-25T23:37:39.637 INFO:tasks.workunit.client.0.smithi081.stdout: create 229/34 file after the snapshot 2023-10-25T23:37:39.638 INFO:tasks.workunit.client.0.smithi081.stdout: create 229/35 file after the snapshot 2023-10-25T23:37:39.639 INFO:tasks.workunit.client.0.smithi081.stdout: create 229/36 file after the snapshot 2023-10-25T23:37:39.640 INFO:tasks.workunit.client.0.smithi081.stdout: create 229/37 file after the snapshot 2023-10-25T23:37:39.642 INFO:tasks.workunit.client.0.smithi081.stdout: create 229/38 file after the snapshot 2023-10-25T23:37:39.643 INFO:tasks.workunit.client.0.smithi081.stdout: create 229/39 file after the snapshot 2023-10-25T23:37:39.644 INFO:tasks.workunit.client.0.smithi081.stdout: create 230/.snap/snap-subdir-test 2023-10-25T23:37:39.676 INFO:tasks.workunit.client.0.smithi081.stdout: create 230/30 file after the snapshot 2023-10-25T23:37:39.677 INFO:tasks.workunit.client.0.smithi081.stdout: create 230/31 file after the snapshot 2023-10-25T23:37:39.678 INFO:tasks.workunit.client.0.smithi081.stdout: create 230/32 file after the snapshot 2023-10-25T23:37:39.680 INFO:tasks.workunit.client.0.smithi081.stdout: create 230/33 file after the snapshot 2023-10-25T23:37:39.681 INFO:tasks.workunit.client.0.smithi081.stdout: create 230/34 file after the snapshot 2023-10-25T23:37:39.682 INFO:tasks.workunit.client.0.smithi081.stdout: create 230/35 file after the snapshot 2023-10-25T23:37:39.684 INFO:tasks.workunit.client.0.smithi081.stdout: create 230/36 file after the snapshot 2023-10-25T23:37:39.685 INFO:tasks.workunit.client.0.smithi081.stdout: create 230/37 file after the snapshot 2023-10-25T23:37:39.686 INFO:tasks.workunit.client.0.smithi081.stdout: create 230/38 file after the snapshot 2023-10-25T23:37:39.687 INFO:tasks.workunit.client.0.smithi081.stdout: create 230/39 file after the snapshot 2023-10-25T23:37:39.688 INFO:tasks.workunit.client.0.smithi081.stdout: create 231/.snap/snap-subdir-test 2023-10-25T23:37:39.715 INFO:tasks.workunit.client.0.smithi081.stdout: create 231/30 file after the snapshot 2023-10-25T23:37:39.716 INFO:tasks.workunit.client.0.smithi081.stdout: create 231/31 file after the snapshot 2023-10-25T23:37:39.718 INFO:tasks.workunit.client.0.smithi081.stdout: create 231/32 file after the snapshot 2023-10-25T23:37:39.719 INFO:tasks.workunit.client.0.smithi081.stdout: create 231/33 file after the snapshot 2023-10-25T23:37:39.720 INFO:tasks.workunit.client.0.smithi081.stdout: create 231/34 file after the snapshot 2023-10-25T23:37:39.722 INFO:tasks.workunit.client.0.smithi081.stdout: create 231/35 file after the snapshot 2023-10-25T23:37:39.723 INFO:tasks.workunit.client.0.smithi081.stdout: create 231/36 file after the snapshot 2023-10-25T23:37:39.724 INFO:tasks.workunit.client.0.smithi081.stdout: create 231/37 file after the snapshot 2023-10-25T23:37:39.726 INFO:tasks.workunit.client.0.smithi081.stdout: create 231/38 file after the snapshot 2023-10-25T23:37:39.727 INFO:tasks.workunit.client.0.smithi081.stdout: create 231/39 file after the snapshot 2023-10-25T23:37:39.728 INFO:tasks.workunit.client.0.smithi081.stdout: create 232/.snap/snap-subdir-test 2023-10-25T23:37:39.754 INFO:tasks.workunit.client.0.smithi081.stdout: create 232/30 file after the snapshot 2023-10-25T23:37:39.756 INFO:tasks.workunit.client.0.smithi081.stdout: create 232/31 file after the snapshot 2023-10-25T23:37:39.757 INFO:tasks.workunit.client.0.smithi081.stdout: create 232/32 file after the snapshot 2023-10-25T23:37:39.759 INFO:tasks.workunit.client.0.smithi081.stdout: create 232/33 file after the snapshot 2023-10-25T23:37:39.760 INFO:tasks.workunit.client.0.smithi081.stdout: create 232/34 file after the snapshot 2023-10-25T23:37:39.761 INFO:tasks.workunit.client.0.smithi081.stdout: create 232/35 file after the snapshot 2023-10-25T23:37:39.763 INFO:tasks.workunit.client.0.smithi081.stdout: create 232/36 file after the snapshot 2023-10-25T23:37:39.764 INFO:tasks.workunit.client.0.smithi081.stdout: create 232/37 file after the snapshot 2023-10-25T23:37:39.765 INFO:tasks.workunit.client.0.smithi081.stdout: create 232/38 file after the snapshot 2023-10-25T23:37:39.767 INFO:tasks.workunit.client.0.smithi081.stdout: create 232/39 file after the snapshot 2023-10-25T23:37:39.768 INFO:tasks.workunit.client.0.smithi081.stdout: create 233/.snap/snap-subdir-test 2023-10-25T23:37:39.797 INFO:tasks.workunit.client.0.smithi081.stdout: create 233/30 file after the snapshot 2023-10-25T23:37:39.799 INFO:tasks.workunit.client.0.smithi081.stdout: create 233/31 file after the snapshot 2023-10-25T23:37:39.800 INFO:tasks.workunit.client.0.smithi081.stdout: create 233/32 file after the snapshot 2023-10-25T23:37:39.801 INFO:tasks.workunit.client.0.smithi081.stdout: create 233/33 file after the snapshot 2023-10-25T23:37:39.803 INFO:tasks.workunit.client.0.smithi081.stdout: create 233/34 file after the snapshot 2023-10-25T23:37:39.804 INFO:tasks.workunit.client.0.smithi081.stdout: create 233/35 file after the snapshot 2023-10-25T23:37:39.805 INFO:tasks.workunit.client.0.smithi081.stdout: create 233/36 file after the snapshot 2023-10-25T23:37:39.807 INFO:tasks.workunit.client.0.smithi081.stdout: create 233/37 file after the snapshot 2023-10-25T23:37:39.808 INFO:tasks.workunit.client.0.smithi081.stdout: create 233/38 file after the snapshot 2023-10-25T23:37:39.810 INFO:tasks.workunit.client.0.smithi081.stdout: create 233/39 file after the snapshot 2023-10-25T23:37:39.811 INFO:tasks.workunit.client.0.smithi081.stdout: create 234/.snap/snap-subdir-test 2023-10-25T23:37:39.837 INFO:tasks.workunit.client.0.smithi081.stdout: create 234/30 file after the snapshot 2023-10-25T23:37:39.838 INFO:tasks.workunit.client.0.smithi081.stdout: create 234/31 file after the snapshot 2023-10-25T23:37:39.839 INFO:tasks.workunit.client.0.smithi081.stdout: create 234/32 file after the snapshot 2023-10-25T23:37:39.840 INFO:tasks.workunit.client.0.smithi081.stdout: create 234/33 file after the snapshot 2023-10-25T23:37:39.841 INFO:tasks.workunit.client.0.smithi081.stdout: create 234/34 file after the snapshot 2023-10-25T23:37:39.842 INFO:tasks.workunit.client.0.smithi081.stdout: create 234/35 file after the snapshot 2023-10-25T23:37:39.843 INFO:tasks.workunit.client.0.smithi081.stdout: create 234/36 file after the snapshot 2023-10-25T23:37:39.843 INFO:tasks.workunit.client.0.smithi081.stdout: create 234/37 file after the snapshot 2023-10-25T23:37:39.844 INFO:tasks.workunit.client.0.smithi081.stdout: create 234/38 file after the snapshot 2023-10-25T23:37:39.845 INFO:tasks.workunit.client.0.smithi081.stdout: create 234/39 file after the snapshot 2023-10-25T23:37:39.846 INFO:tasks.workunit.client.0.smithi081.stdout: create 235/.snap/snap-subdir-test 2023-10-25T23:37:39.877 INFO:tasks.workunit.client.0.smithi081.stdout: create 235/30 file after the snapshot 2023-10-25T23:37:39.878 INFO:tasks.workunit.client.0.smithi081.stdout: create 235/31 file after the snapshot 2023-10-25T23:37:39.880 INFO:tasks.workunit.client.0.smithi081.stdout: create 235/32 file after the snapshot 2023-10-25T23:37:39.881 INFO:tasks.workunit.client.0.smithi081.stdout: create 235/33 file after the snapshot 2023-10-25T23:37:39.882 INFO:tasks.workunit.client.0.smithi081.stdout: create 235/34 file after the snapshot 2023-10-25T23:37:39.884 INFO:tasks.workunit.client.0.smithi081.stdout: create 235/35 file after the snapshot 2023-10-25T23:37:39.885 INFO:tasks.workunit.client.0.smithi081.stdout: create 235/36 file after the snapshot 2023-10-25T23:37:39.886 INFO:tasks.workunit.client.0.smithi081.stdout: create 235/37 file after the snapshot 2023-10-25T23:37:39.888 INFO:tasks.workunit.client.0.smithi081.stdout: create 235/38 file after the snapshot 2023-10-25T23:37:39.889 INFO:tasks.workunit.client.0.smithi081.stdout: create 235/39 file after the snapshot 2023-10-25T23:37:39.890 INFO:tasks.workunit.client.0.smithi081.stdout: create 236/.snap/snap-subdir-test 2023-10-25T23:37:39.918 INFO:tasks.workunit.client.0.smithi081.stdout: create 236/30 file after the snapshot 2023-10-25T23:37:39.918 INFO:tasks.workunit.client.0.smithi081.stdout: create 236/31 file after the snapshot 2023-10-25T23:37:39.919 INFO:tasks.workunit.client.0.smithi081.stdout: create 236/32 file after the snapshot 2023-10-25T23:37:39.921 INFO:tasks.workunit.client.0.smithi081.stdout: create 236/33 file after the snapshot 2023-10-25T23:37:39.922 INFO:tasks.workunit.client.0.smithi081.stdout: create 236/34 file after the snapshot 2023-10-25T23:37:39.923 INFO:tasks.workunit.client.0.smithi081.stdout: create 236/35 file after the snapshot 2023-10-25T23:37:39.925 INFO:tasks.workunit.client.0.smithi081.stdout: create 236/36 file after the snapshot 2023-10-25T23:37:39.926 INFO:tasks.workunit.client.0.smithi081.stdout: create 236/37 file after the snapshot 2023-10-25T23:37:39.927 INFO:tasks.workunit.client.0.smithi081.stdout: create 236/38 file after the snapshot 2023-10-25T23:37:39.929 INFO:tasks.workunit.client.0.smithi081.stdout: create 236/39 file after the snapshot 2023-10-25T23:37:39.930 INFO:tasks.workunit.client.0.smithi081.stdout: create 237/.snap/snap-subdir-test 2023-10-25T23:37:39.957 INFO:tasks.workunit.client.0.smithi081.stdout: create 237/30 file after the snapshot 2023-10-25T23:37:39.959 INFO:tasks.workunit.client.0.smithi081.stdout: create 237/31 file after the snapshot 2023-10-25T23:37:39.960 INFO:tasks.workunit.client.0.smithi081.stdout: create 237/32 file after the snapshot 2023-10-25T23:37:39.962 INFO:tasks.workunit.client.0.smithi081.stdout: create 237/33 file after the snapshot 2023-10-25T23:37:39.963 INFO:tasks.workunit.client.0.smithi081.stdout: create 237/34 file after the snapshot 2023-10-25T23:37:39.964 INFO:tasks.workunit.client.0.smithi081.stdout: create 237/35 file after the snapshot 2023-10-25T23:37:39.966 INFO:tasks.workunit.client.0.smithi081.stdout: create 237/36 file after the snapshot 2023-10-25T23:37:39.967 INFO:tasks.workunit.client.0.smithi081.stdout: create 237/37 file after the snapshot 2023-10-25T23:37:39.968 INFO:tasks.workunit.client.0.smithi081.stdout: create 237/38 file after the snapshot 2023-10-25T23:37:39.970 INFO:tasks.workunit.client.0.smithi081.stdout: create 237/39 file after the snapshot 2023-10-25T23:37:39.971 INFO:tasks.workunit.client.0.smithi081.stdout: create 238/.snap/snap-subdir-test 2023-10-25T23:37:39.998 INFO:tasks.workunit.client.0.smithi081.stdout: create 238/30 file after the snapshot 2023-10-25T23:37:39.999 INFO:tasks.workunit.client.0.smithi081.stdout: create 238/31 file after the snapshot 2023-10-25T23:37:40.000 INFO:tasks.workunit.client.0.smithi081.stdout: create 238/32 file after the snapshot 2023-10-25T23:37:40.001 INFO:tasks.workunit.client.0.smithi081.stdout: create 238/33 file after the snapshot 2023-10-25T23:37:40.001 INFO:tasks.workunit.client.0.smithi081.stdout: create 238/34 file after the snapshot 2023-10-25T23:37:40.002 INFO:tasks.workunit.client.0.smithi081.stdout: create 238/35 file after the snapshot 2023-10-25T23:37:40.003 INFO:tasks.workunit.client.0.smithi081.stdout: create 238/36 file after the snapshot 2023-10-25T23:37:40.004 INFO:tasks.workunit.client.0.smithi081.stdout: create 238/37 file after the snapshot 2023-10-25T23:37:40.005 INFO:tasks.workunit.client.0.smithi081.stdout: create 238/38 file after the snapshot 2023-10-25T23:37:40.007 INFO:tasks.workunit.client.0.smithi081.stdout: create 238/39 file after the snapshot 2023-10-25T23:37:40.008 INFO:tasks.workunit.client.0.smithi081.stdout: create 239/.snap/snap-subdir-test 2023-10-25T23:37:40.036 INFO:tasks.workunit.client.0.smithi081.stdout: create 239/30 file after the snapshot 2023-10-25T23:37:40.037 INFO:tasks.workunit.client.0.smithi081.stdout: create 239/31 file after the snapshot 2023-10-25T23:37:40.037 INFO:tasks.workunit.client.0.smithi081.stdout: create 239/32 file after the snapshot 2023-10-25T23:37:40.038 INFO:tasks.workunit.client.0.smithi081.stdout: create 239/33 file after the snapshot 2023-10-25T23:37:40.039 INFO:tasks.workunit.client.0.smithi081.stdout: create 239/34 file after the snapshot 2023-10-25T23:37:40.040 INFO:tasks.workunit.client.0.smithi081.stdout: create 239/35 file after the snapshot 2023-10-25T23:37:40.041 INFO:tasks.workunit.client.0.smithi081.stdout: create 239/36 file after the snapshot 2023-10-25T23:37:40.042 INFO:tasks.workunit.client.0.smithi081.stdout: create 239/37 file after the snapshot 2023-10-25T23:37:40.043 INFO:tasks.workunit.client.0.smithi081.stdout: create 239/38 file after the snapshot 2023-10-25T23:37:40.043 INFO:tasks.workunit.client.0.smithi081.stdout: create 239/39 file after the snapshot 2023-10-25T23:37:40.044 INFO:tasks.workunit.client.0.smithi081.stdout: create 240/.snap/snap-subdir-test 2023-10-25T23:37:40.071 INFO:tasks.workunit.client.0.smithi081.stdout: create 240/30 file after the snapshot 2023-10-25T23:37:40.072 INFO:tasks.workunit.client.0.smithi081.stdout: create 240/31 file after the snapshot 2023-10-25T23:37:40.073 INFO:tasks.workunit.client.0.smithi081.stdout: create 240/32 file after the snapshot 2023-10-25T23:37:40.074 INFO:tasks.workunit.client.0.smithi081.stdout: create 240/33 file after the snapshot 2023-10-25T23:37:40.075 INFO:tasks.workunit.client.0.smithi081.stdout: create 240/34 file after the snapshot 2023-10-25T23:37:40.076 INFO:tasks.workunit.client.0.smithi081.stdout: create 240/35 file after the snapshot 2023-10-25T23:37:40.077 INFO:tasks.workunit.client.0.smithi081.stdout: create 240/36 file after the snapshot 2023-10-25T23:37:40.078 INFO:tasks.workunit.client.0.smithi081.stdout: create 240/37 file after the snapshot 2023-10-25T23:37:40.079 INFO:tasks.workunit.client.0.smithi081.stdout: create 240/38 file after the snapshot 2023-10-25T23:37:40.080 INFO:tasks.workunit.client.0.smithi081.stdout: create 240/39 file after the snapshot 2023-10-25T23:37:40.080 INFO:tasks.workunit.client.0.smithi081.stdout: create 241/.snap/snap-subdir-test 2023-10-25T23:37:40.110 INFO:tasks.workunit.client.0.smithi081.stdout: create 241/30 file after the snapshot 2023-10-25T23:37:40.111 INFO:tasks.workunit.client.0.smithi081.stdout: create 241/31 file after the snapshot 2023-10-25T23:37:40.112 INFO:tasks.workunit.client.0.smithi081.stdout: create 241/32 file after the snapshot 2023-10-25T23:37:40.112 INFO:tasks.workunit.client.0.smithi081.stdout: create 241/33 file after the snapshot 2023-10-25T23:37:40.113 INFO:tasks.workunit.client.0.smithi081.stdout: create 241/34 file after the snapshot 2023-10-25T23:37:40.114 INFO:tasks.workunit.client.0.smithi081.stdout: create 241/35 file after the snapshot 2023-10-25T23:37:40.115 INFO:tasks.workunit.client.0.smithi081.stdout: create 241/36 file after the snapshot 2023-10-25T23:37:40.116 INFO:tasks.workunit.client.0.smithi081.stdout: create 241/37 file after the snapshot 2023-10-25T23:37:40.117 INFO:tasks.workunit.client.0.smithi081.stdout: create 241/38 file after the snapshot 2023-10-25T23:37:40.118 INFO:tasks.workunit.client.0.smithi081.stdout: create 241/39 file after the snapshot 2023-10-25T23:37:40.119 INFO:tasks.workunit.client.0.smithi081.stdout: create 242/.snap/snap-subdir-test 2023-10-25T23:37:40.145 INFO:tasks.workunit.client.0.smithi081.stdout: create 242/30 file after the snapshot 2023-10-25T23:37:40.146 INFO:tasks.workunit.client.0.smithi081.stdout: create 242/31 file after the snapshot 2023-10-25T23:37:40.147 INFO:tasks.workunit.client.0.smithi081.stdout: create 242/32 file after the snapshot 2023-10-25T23:37:40.148 INFO:tasks.workunit.client.0.smithi081.stdout: create 242/33 file after the snapshot 2023-10-25T23:37:40.148 INFO:tasks.workunit.client.0.smithi081.stdout: create 242/34 file after the snapshot 2023-10-25T23:37:40.149 INFO:tasks.workunit.client.0.smithi081.stdout: create 242/35 file after the snapshot 2023-10-25T23:37:40.150 INFO:tasks.workunit.client.0.smithi081.stdout: create 242/36 file after the snapshot 2023-10-25T23:37:40.151 INFO:tasks.workunit.client.0.smithi081.stdout: create 242/37 file after the snapshot 2023-10-25T23:37:40.152 INFO:tasks.workunit.client.0.smithi081.stdout: create 242/38 file after the snapshot 2023-10-25T23:37:40.153 INFO:tasks.workunit.client.0.smithi081.stdout: create 242/39 file after the snapshot 2023-10-25T23:37:40.154 INFO:tasks.workunit.client.0.smithi081.stdout: create 243/.snap/snap-subdir-test 2023-10-25T23:37:40.183 INFO:tasks.workunit.client.0.smithi081.stdout: create 243/30 file after the snapshot 2023-10-25T23:37:40.184 INFO:tasks.workunit.client.0.smithi081.stdout: create 243/31 file after the snapshot 2023-10-25T23:37:40.185 INFO:tasks.workunit.client.0.smithi081.stdout: create 243/32 file after the snapshot 2023-10-25T23:37:40.187 INFO:tasks.workunit.client.0.smithi081.stdout: create 243/33 file after the snapshot 2023-10-25T23:37:40.188 INFO:tasks.workunit.client.0.smithi081.stdout: create 243/34 file after the snapshot 2023-10-25T23:37:40.189 INFO:tasks.workunit.client.0.smithi081.stdout: create 243/35 file after the snapshot 2023-10-25T23:37:40.190 INFO:tasks.workunit.client.0.smithi081.stdout: create 243/36 file after the snapshot 2023-10-25T23:37:40.191 INFO:tasks.workunit.client.0.smithi081.stdout: create 243/37 file after the snapshot 2023-10-25T23:37:40.192 INFO:tasks.workunit.client.0.smithi081.stdout: create 243/38 file after the snapshot 2023-10-25T23:37:40.193 INFO:tasks.workunit.client.0.smithi081.stdout: create 243/39 file after the snapshot 2023-10-25T23:37:40.194 INFO:tasks.workunit.client.0.smithi081.stdout: create 244/.snap/snap-subdir-test 2023-10-25T23:37:40.220 INFO:tasks.workunit.client.0.smithi081.stdout: create 244/30 file after the snapshot 2023-10-25T23:37:40.221 INFO:tasks.workunit.client.0.smithi081.stdout: create 244/31 file after the snapshot 2023-10-25T23:37:40.223 INFO:tasks.workunit.client.0.smithi081.stdout: create 244/32 file after the snapshot 2023-10-25T23:37:40.224 INFO:tasks.workunit.client.0.smithi081.stdout: create 244/33 file after the snapshot 2023-10-25T23:37:40.225 INFO:tasks.workunit.client.0.smithi081.stdout: create 244/34 file after the snapshot 2023-10-25T23:37:40.226 INFO:tasks.workunit.client.0.smithi081.stdout: create 244/35 file after the snapshot 2023-10-25T23:37:40.227 INFO:tasks.workunit.client.0.smithi081.stdout: create 244/36 file after the snapshot 2023-10-25T23:37:40.228 INFO:tasks.workunit.client.0.smithi081.stdout: create 244/37 file after the snapshot 2023-10-25T23:37:40.229 INFO:tasks.workunit.client.0.smithi081.stdout: create 244/38 file after the snapshot 2023-10-25T23:37:40.230 INFO:tasks.workunit.client.0.smithi081.stdout: create 244/39 file after the snapshot 2023-10-25T23:37:40.231 INFO:tasks.workunit.client.0.smithi081.stdout: create 245/.snap/snap-subdir-test 2023-10-25T23:37:40.260 INFO:tasks.workunit.client.0.smithi081.stdout: create 245/30 file after the snapshot 2023-10-25T23:37:40.261 INFO:tasks.workunit.client.0.smithi081.stdout: create 245/31 file after the snapshot 2023-10-25T23:37:40.263 INFO:tasks.workunit.client.0.smithi081.stdout: create 245/32 file after the snapshot 2023-10-25T23:37:40.264 INFO:tasks.workunit.client.0.smithi081.stdout: create 245/33 file after the snapshot 2023-10-25T23:37:40.265 INFO:tasks.workunit.client.0.smithi081.stdout: create 245/34 file after the snapshot 2023-10-25T23:37:40.266 INFO:tasks.workunit.client.0.smithi081.stdout: create 245/35 file after the snapshot 2023-10-25T23:37:40.268 INFO:tasks.workunit.client.0.smithi081.stdout: create 245/36 file after the snapshot 2023-10-25T23:37:40.269 INFO:tasks.workunit.client.0.smithi081.stdout: create 245/37 file after the snapshot 2023-10-25T23:37:40.271 INFO:tasks.workunit.client.0.smithi081.stdout: create 245/38 file after the snapshot 2023-10-25T23:37:40.272 INFO:tasks.workunit.client.0.smithi081.stdout: create 245/39 file after the snapshot 2023-10-25T23:37:40.273 INFO:tasks.workunit.client.0.smithi081.stdout: create 246/.snap/snap-subdir-test 2023-10-25T23:37:40.299 INFO:tasks.workunit.client.0.smithi081.stdout: create 246/30 file after the snapshot 2023-10-25T23:37:40.300 INFO:tasks.workunit.client.0.smithi081.stdout: create 246/31 file after the snapshot 2023-10-25T23:37:40.301 INFO:tasks.workunit.client.0.smithi081.stdout: create 246/32 file after the snapshot 2023-10-25T23:37:40.303 INFO:tasks.workunit.client.0.smithi081.stdout: create 246/33 file after the snapshot 2023-10-25T23:37:40.304 INFO:tasks.workunit.client.0.smithi081.stdout: create 246/34 file after the snapshot 2023-10-25T23:37:40.305 INFO:tasks.workunit.client.0.smithi081.stdout: create 246/35 file after the snapshot 2023-10-25T23:37:40.307 INFO:tasks.workunit.client.0.smithi081.stdout: create 246/36 file after the snapshot 2023-10-25T23:37:40.307 INFO:tasks.workunit.client.0.smithi081.stdout: create 246/37 file after the snapshot 2023-10-25T23:37:40.308 INFO:tasks.workunit.client.0.smithi081.stdout: create 246/38 file after the snapshot 2023-10-25T23:37:40.309 INFO:tasks.workunit.client.0.smithi081.stdout: create 246/39 file after the snapshot 2023-10-25T23:37:40.311 INFO:tasks.workunit.client.0.smithi081.stdout: create 247/.snap/snap-subdir-test 2023-10-25T23:37:40.336 INFO:tasks.workunit.client.0.smithi081.stdout: create 247/30 file after the snapshot 2023-10-25T23:37:40.337 INFO:tasks.workunit.client.0.smithi081.stdout: create 247/31 file after the snapshot 2023-10-25T23:37:40.338 INFO:tasks.workunit.client.0.smithi081.stdout: create 247/32 file after the snapshot 2023-10-25T23:37:40.339 INFO:tasks.workunit.client.0.smithi081.stdout: create 247/33 file after the snapshot 2023-10-25T23:37:40.340 INFO:tasks.workunit.client.0.smithi081.stdout: create 247/34 file after the snapshot 2023-10-25T23:37:40.341 INFO:tasks.workunit.client.0.smithi081.stdout: create 247/35 file after the snapshot 2023-10-25T23:37:40.342 INFO:tasks.workunit.client.0.smithi081.stdout: create 247/36 file after the snapshot 2023-10-25T23:37:40.343 INFO:tasks.workunit.client.0.smithi081.stdout: create 247/37 file after the snapshot 2023-10-25T23:37:40.343 INFO:tasks.workunit.client.0.smithi081.stdout: create 247/38 file after the snapshot 2023-10-25T23:37:40.344 INFO:tasks.workunit.client.0.smithi081.stdout: create 247/39 file after the snapshot 2023-10-25T23:37:40.345 INFO:tasks.workunit.client.0.smithi081.stdout: create 248/.snap/snap-subdir-test 2023-10-25T23:37:40.373 INFO:tasks.workunit.client.0.smithi081.stdout: create 248/30 file after the snapshot 2023-10-25T23:37:40.373 INFO:tasks.workunit.client.0.smithi081.stdout: create 248/31 file after the snapshot 2023-10-25T23:37:40.374 INFO:tasks.workunit.client.0.smithi081.stdout: create 248/32 file after the snapshot 2023-10-25T23:37:40.375 INFO:tasks.workunit.client.0.smithi081.stdout: create 248/33 file after the snapshot 2023-10-25T23:37:40.375 INFO:tasks.workunit.client.0.smithi081.stdout: create 248/34 file after the snapshot 2023-10-25T23:37:40.376 INFO:tasks.workunit.client.0.smithi081.stdout: create 248/35 file after the snapshot 2023-10-25T23:37:40.377 INFO:tasks.workunit.client.0.smithi081.stdout: create 248/36 file after the snapshot 2023-10-25T23:37:40.378 INFO:tasks.workunit.client.0.smithi081.stdout: create 248/37 file after the snapshot 2023-10-25T23:37:40.379 INFO:tasks.workunit.client.0.smithi081.stdout: create 248/38 file after the snapshot 2023-10-25T23:37:40.380 INFO:tasks.workunit.client.0.smithi081.stdout: create 248/39 file after the snapshot 2023-10-25T23:37:40.381 INFO:tasks.workunit.client.0.smithi081.stdout: create 249/.snap/snap-subdir-test 2023-10-25T23:37:40.411 INFO:tasks.workunit.client.0.smithi081.stdout: create 249/30 file after the snapshot 2023-10-25T23:37:40.412 INFO:tasks.workunit.client.0.smithi081.stdout: create 249/31 file after the snapshot 2023-10-25T23:37:40.413 INFO:tasks.workunit.client.0.smithi081.stdout: create 249/32 file after the snapshot 2023-10-25T23:37:40.414 INFO:tasks.workunit.client.0.smithi081.stdout: create 249/33 file after the snapshot 2023-10-25T23:37:40.414 INFO:tasks.workunit.client.0.smithi081.stdout: create 249/34 file after the snapshot 2023-10-25T23:37:40.415 INFO:tasks.workunit.client.0.smithi081.stdout: create 249/35 file after the snapshot 2023-10-25T23:37:40.416 INFO:tasks.workunit.client.0.smithi081.stdout: create 249/36 file after the snapshot 2023-10-25T23:37:40.417 INFO:tasks.workunit.client.0.smithi081.stdout: create 249/37 file after the snapshot 2023-10-25T23:37:40.418 INFO:tasks.workunit.client.0.smithi081.stdout: create 249/38 file after the snapshot 2023-10-25T23:37:40.419 INFO:tasks.workunit.client.0.smithi081.stdout: create 249/39 file after the snapshot 2023-10-25T23:37:40.420 INFO:tasks.workunit.client.0.smithi081.stdout: create 250/.snap/snap-subdir-test 2023-10-25T23:37:40.450 INFO:tasks.workunit.client.0.smithi081.stdout: create 250/30 file after the snapshot 2023-10-25T23:37:40.451 INFO:tasks.workunit.client.0.smithi081.stdout: create 250/31 file after the snapshot 2023-10-25T23:37:40.452 INFO:tasks.workunit.client.0.smithi081.stdout: create 250/32 file after the snapshot 2023-10-25T23:37:40.452 INFO:tasks.workunit.client.0.smithi081.stdout: create 250/33 file after the snapshot 2023-10-25T23:37:40.453 INFO:tasks.workunit.client.0.smithi081.stdout: create 250/34 file after the snapshot 2023-10-25T23:37:40.454 INFO:tasks.workunit.client.0.smithi081.stdout: create 250/35 file after the snapshot 2023-10-25T23:37:40.455 INFO:tasks.workunit.client.0.smithi081.stdout: create 250/36 file after the snapshot 2023-10-25T23:37:40.456 INFO:tasks.workunit.client.0.smithi081.stdout: create 250/37 file after the snapshot 2023-10-25T23:37:40.456 INFO:tasks.workunit.client.0.smithi081.stdout: create 250/38 file after the snapshot 2023-10-25T23:37:40.457 INFO:tasks.workunit.client.0.smithi081.stdout: create 250/39 file after the snapshot 2023-10-25T23:37:40.458 INFO:tasks.workunit.client.0.smithi081.stdout: create 251/.snap/snap-subdir-test 2023-10-25T23:37:40.488 INFO:tasks.workunit.client.0.smithi081.stdout: create 251/30 file after the snapshot 2023-10-25T23:37:40.489 INFO:tasks.workunit.client.0.smithi081.stdout: create 251/31 file after the snapshot 2023-10-25T23:37:40.490 INFO:tasks.workunit.client.0.smithi081.stdout: create 251/32 file after the snapshot 2023-10-25T23:37:40.491 INFO:tasks.workunit.client.0.smithi081.stdout: create 251/33 file after the snapshot 2023-10-25T23:37:40.492 INFO:tasks.workunit.client.0.smithi081.stdout: create 251/34 file after the snapshot 2023-10-25T23:37:40.493 INFO:tasks.workunit.client.0.smithi081.stdout: create 251/35 file after the snapshot 2023-10-25T23:37:40.494 INFO:tasks.workunit.client.0.smithi081.stdout: create 251/36 file after the snapshot 2023-10-25T23:37:40.495 INFO:tasks.workunit.client.0.smithi081.stdout: create 251/37 file after the snapshot 2023-10-25T23:37:40.496 INFO:tasks.workunit.client.0.smithi081.stdout: create 251/38 file after the snapshot 2023-10-25T23:37:40.497 INFO:tasks.workunit.client.0.smithi081.stdout: create 251/39 file after the snapshot 2023-10-25T23:37:40.498 INFO:tasks.workunit.client.0.smithi081.stdout: create 252/.snap/snap-subdir-test 2023-10-25T23:37:40.528 INFO:tasks.workunit.client.0.smithi081.stdout: create 252/30 file after the snapshot 2023-10-25T23:37:40.529 INFO:tasks.workunit.client.0.smithi081.stdout: create 252/31 file after the snapshot 2023-10-25T23:37:40.530 INFO:tasks.workunit.client.0.smithi081.stdout: create 252/32 file after the snapshot 2023-10-25T23:37:40.531 INFO:tasks.workunit.client.0.smithi081.stdout: create 252/33 file after the snapshot 2023-10-25T23:37:40.532 INFO:tasks.workunit.client.0.smithi081.stdout: create 252/34 file after the snapshot 2023-10-25T23:37:40.533 INFO:tasks.workunit.client.0.smithi081.stdout: create 252/35 file after the snapshot 2023-10-25T23:37:40.534 INFO:tasks.workunit.client.0.smithi081.stdout: create 252/36 file after the snapshot 2023-10-25T23:37:40.534 INFO:tasks.workunit.client.0.smithi081.stdout: create 252/37 file after the snapshot 2023-10-25T23:37:40.535 INFO:tasks.workunit.client.0.smithi081.stdout: create 252/38 file after the snapshot 2023-10-25T23:37:40.536 INFO:tasks.workunit.client.0.smithi081.stdout: create 252/39 file after the snapshot 2023-10-25T23:37:40.537 INFO:tasks.workunit.client.0.smithi081.stdout: create 253/.snap/snap-subdir-test 2023-10-25T23:37:40.567 INFO:tasks.workunit.client.0.smithi081.stdout: create 253/30 file after the snapshot 2023-10-25T23:37:40.568 INFO:tasks.workunit.client.0.smithi081.stdout: create 253/31 file after the snapshot 2023-10-25T23:37:40.569 INFO:tasks.workunit.client.0.smithi081.stdout: create 253/32 file after the snapshot 2023-10-25T23:37:40.570 INFO:tasks.workunit.client.0.smithi081.stdout: create 253/33 file after the snapshot 2023-10-25T23:37:40.571 INFO:tasks.workunit.client.0.smithi081.stdout: create 253/34 file after the snapshot 2023-10-25T23:37:40.572 INFO:tasks.workunit.client.0.smithi081.stdout: create 253/35 file after the snapshot 2023-10-25T23:37:40.572 INFO:tasks.workunit.client.0.smithi081.stdout: create 253/36 file after the snapshot 2023-10-25T23:37:40.573 INFO:tasks.workunit.client.0.smithi081.stdout: create 253/37 file after the snapshot 2023-10-25T23:37:40.574 INFO:tasks.workunit.client.0.smithi081.stdout: create 253/38 file after the snapshot 2023-10-25T23:37:40.575 INFO:tasks.workunit.client.0.smithi081.stdout: create 253/39 file after the snapshot 2023-10-25T23:37:40.576 INFO:tasks.workunit.client.0.smithi081.stdout: create 254/.snap/snap-subdir-test 2023-10-25T23:37:40.608 INFO:tasks.workunit.client.0.smithi081.stdout: create 254/30 file after the snapshot 2023-10-25T23:37:40.610 INFO:tasks.workunit.client.0.smithi081.stdout: create 254/31 file after the snapshot 2023-10-25T23:37:40.611 INFO:tasks.workunit.client.0.smithi081.stdout: create 254/32 file after the snapshot 2023-10-25T23:37:40.613 INFO:tasks.workunit.client.0.smithi081.stdout: create 254/33 file after the snapshot 2023-10-25T23:37:40.614 INFO:tasks.workunit.client.0.smithi081.stdout: create 254/34 file after the snapshot 2023-10-25T23:37:40.615 INFO:tasks.workunit.client.0.smithi081.stdout: create 254/35 file after the snapshot 2023-10-25T23:37:40.617 INFO:tasks.workunit.client.0.smithi081.stdout: create 254/36 file after the snapshot 2023-10-25T23:37:40.618 INFO:tasks.workunit.client.0.smithi081.stdout: create 254/37 file after the snapshot 2023-10-25T23:37:40.619 INFO:tasks.workunit.client.0.smithi081.stdout: create 254/38 file after the snapshot 2023-10-25T23:37:40.621 INFO:tasks.workunit.client.0.smithi081.stdout: create 254/39 file after the snapshot 2023-10-25T23:37:40.622 INFO:tasks.workunit.client.0.smithi081.stdout: create 255/.snap/snap-subdir-test 2023-10-25T23:37:40.659 INFO:tasks.workunit.client.0.smithi081.stdout: create 255/30 file after the snapshot 2023-10-25T23:37:40.660 INFO:tasks.workunit.client.0.smithi081.stdout: create 255/31 file after the snapshot 2023-10-25T23:37:40.661 INFO:tasks.workunit.client.0.smithi081.stdout: create 255/32 file after the snapshot 2023-10-25T23:37:40.661 INFO:tasks.workunit.client.0.smithi081.stdout: create 255/33 file after the snapshot 2023-10-25T23:37:40.662 INFO:tasks.workunit.client.0.smithi081.stdout: create 255/34 file after the snapshot 2023-10-25T23:37:40.663 INFO:tasks.workunit.client.0.smithi081.stdout: create 255/35 file after the snapshot 2023-10-25T23:37:40.664 INFO:tasks.workunit.client.0.smithi081.stdout: create 255/36 file after the snapshot 2023-10-25T23:37:40.665 INFO:tasks.workunit.client.0.smithi081.stdout: create 255/37 file after the snapshot 2023-10-25T23:37:40.666 INFO:tasks.workunit.client.0.smithi081.stdout: create 255/38 file after the snapshot 2023-10-25T23:37:40.667 INFO:tasks.workunit.client.0.smithi081.stdout: create 255/39 file after the snapshot 2023-10-25T23:37:40.668 INFO:tasks.workunit.client.0.smithi081.stdout: create 256/.snap/snap-subdir-test 2023-10-25T23:37:40.695 INFO:tasks.workunit.client.0.smithi081.stdout: create 256/30 file after the snapshot 2023-10-25T23:37:40.696 INFO:tasks.workunit.client.0.smithi081.stdout: create 256/31 file after the snapshot 2023-10-25T23:37:40.697 INFO:tasks.workunit.client.0.smithi081.stdout: create 256/32 file after the snapshot 2023-10-25T23:37:40.698 INFO:tasks.workunit.client.0.smithi081.stdout: create 256/33 file after the snapshot 2023-10-25T23:37:40.699 INFO:tasks.workunit.client.0.smithi081.stdout: create 256/34 file after the snapshot 2023-10-25T23:37:40.700 INFO:tasks.workunit.client.0.smithi081.stdout: create 256/35 file after the snapshot 2023-10-25T23:37:40.701 INFO:tasks.workunit.client.0.smithi081.stdout: create 256/36 file after the snapshot 2023-10-25T23:37:40.702 INFO:tasks.workunit.client.0.smithi081.stdout: create 256/37 file after the snapshot 2023-10-25T23:37:40.703 INFO:tasks.workunit.client.0.smithi081.stdout: create 256/38 file after the snapshot 2023-10-25T23:37:40.704 INFO:tasks.workunit.client.0.smithi081.stdout: create 256/39 file after the snapshot 2023-10-25T23:37:40.704 INFO:tasks.workunit.client.0.smithi081.stdout: create 257/.snap/snap-subdir-test 2023-10-25T23:37:40.734 INFO:tasks.workunit.client.0.smithi081.stdout: create 257/30 file after the snapshot 2023-10-25T23:37:40.736 INFO:tasks.workunit.client.0.smithi081.stdout: create 257/31 file after the snapshot 2023-10-25T23:37:40.736 INFO:tasks.workunit.client.0.smithi081.stdout: create 257/32 file after the snapshot 2023-10-25T23:37:40.737 INFO:tasks.workunit.client.0.smithi081.stdout: create 257/33 file after the snapshot 2023-10-25T23:37:40.738 INFO:tasks.workunit.client.0.smithi081.stdout: create 257/34 file after the snapshot 2023-10-25T23:37:40.738 INFO:tasks.workunit.client.0.smithi081.stdout: create 257/35 file after the snapshot 2023-10-25T23:37:40.739 INFO:tasks.workunit.client.0.smithi081.stdout: create 257/36 file after the snapshot 2023-10-25T23:37:40.740 INFO:tasks.workunit.client.0.smithi081.stdout: create 257/37 file after the snapshot 2023-10-25T23:37:40.741 INFO:tasks.workunit.client.0.smithi081.stdout: create 257/38 file after the snapshot 2023-10-25T23:37:40.743 INFO:tasks.workunit.client.0.smithi081.stdout: create 257/39 file after the snapshot 2023-10-25T23:37:40.743 INFO:tasks.workunit.client.0.smithi081.stdout: create 258/.snap/snap-subdir-test 2023-10-25T23:37:40.771 INFO:tasks.workunit.client.0.smithi081.stdout: create 258/30 file after the snapshot 2023-10-25T23:37:40.771 INFO:tasks.workunit.client.0.smithi081.stdout: create 258/31 file after the snapshot 2023-10-25T23:37:40.772 INFO:tasks.workunit.client.0.smithi081.stdout: create 258/32 file after the snapshot 2023-10-25T23:37:40.773 INFO:tasks.workunit.client.0.smithi081.stdout: create 258/33 file after the snapshot 2023-10-25T23:37:40.774 INFO:tasks.workunit.client.0.smithi081.stdout: create 258/34 file after the snapshot 2023-10-25T23:37:40.775 INFO:tasks.workunit.client.0.smithi081.stdout: create 258/35 file after the snapshot 2023-10-25T23:37:40.776 INFO:tasks.workunit.client.0.smithi081.stdout: create 258/36 file after the snapshot 2023-10-25T23:37:40.777 INFO:tasks.workunit.client.0.smithi081.stdout: create 258/37 file after the snapshot 2023-10-25T23:37:40.778 INFO:tasks.workunit.client.0.smithi081.stdout: create 258/38 file after the snapshot 2023-10-25T23:37:40.779 INFO:tasks.workunit.client.0.smithi081.stdout: create 258/39 file after the snapshot 2023-10-25T23:37:40.779 INFO:tasks.workunit.client.0.smithi081.stdout: create 259/.snap/snap-subdir-test 2023-10-25T23:37:40.808 INFO:tasks.workunit.client.0.smithi081.stdout: create 259/30 file after the snapshot 2023-10-25T23:37:40.808 INFO:tasks.workunit.client.0.smithi081.stdout: create 259/31 file after the snapshot 2023-10-25T23:37:40.809 INFO:tasks.workunit.client.0.smithi081.stdout: create 259/32 file after the snapshot 2023-10-25T23:37:40.810 INFO:tasks.workunit.client.0.smithi081.stdout: create 259/33 file after the snapshot 2023-10-25T23:37:40.811 INFO:tasks.workunit.client.0.smithi081.stdout: create 259/34 file after the snapshot 2023-10-25T23:37:40.812 INFO:tasks.workunit.client.0.smithi081.stdout: create 259/35 file after the snapshot 2023-10-25T23:37:40.813 INFO:tasks.workunit.client.0.smithi081.stdout: create 259/36 file after the snapshot 2023-10-25T23:37:40.814 INFO:tasks.workunit.client.0.smithi081.stdout: create 259/37 file after the snapshot 2023-10-25T23:37:40.814 INFO:tasks.workunit.client.0.smithi081.stdout: create 259/38 file after the snapshot 2023-10-25T23:37:40.815 INFO:tasks.workunit.client.0.smithi081.stdout: create 259/39 file after the snapshot 2023-10-25T23:37:40.816 INFO:tasks.workunit.client.0.smithi081.stdout: create 260/.snap/snap-subdir-test 2023-10-25T23:37:40.845 INFO:tasks.workunit.client.0.smithi081.stdout: create 260/30 file after the snapshot 2023-10-25T23:37:40.847 INFO:tasks.workunit.client.0.smithi081.stdout: create 260/31 file after the snapshot 2023-10-25T23:37:40.850 INFO:tasks.workunit.client.0.smithi081.stdout: create 260/32 file after the snapshot 2023-10-25T23:37:40.851 INFO:tasks.workunit.client.0.smithi081.stdout: create 260/33 file after the snapshot 2023-10-25T23:37:40.853 INFO:tasks.workunit.client.0.smithi081.stdout: create 260/34 file after the snapshot 2023-10-25T23:37:40.855 INFO:tasks.workunit.client.0.smithi081.stdout: create 260/35 file after the snapshot 2023-10-25T23:37:40.857 INFO:tasks.workunit.client.0.smithi081.stdout: create 260/36 file after the snapshot 2023-10-25T23:37:40.858 INFO:tasks.workunit.client.0.smithi081.stdout: create 260/37 file after the snapshot 2023-10-25T23:37:40.858 INFO:tasks.workunit.client.0.smithi081.stdout: create 260/38 file after the snapshot 2023-10-25T23:37:40.859 INFO:tasks.workunit.client.0.smithi081.stdout: create 260/39 file after the snapshot 2023-10-25T23:37:40.860 INFO:tasks.workunit.client.0.smithi081.stdout: create 261/.snap/snap-subdir-test 2023-10-25T23:37:40.891 INFO:tasks.workunit.client.0.smithi081.stdout: create 261/30 file after the snapshot 2023-10-25T23:37:40.892 INFO:tasks.workunit.client.0.smithi081.stdout: create 261/31 file after the snapshot 2023-10-25T23:37:40.893 INFO:tasks.workunit.client.0.smithi081.stdout: create 261/32 file after the snapshot 2023-10-25T23:37:40.894 INFO:tasks.workunit.client.0.smithi081.stdout: create 261/33 file after the snapshot 2023-10-25T23:37:40.895 INFO:tasks.workunit.client.0.smithi081.stdout: create 261/34 file after the snapshot 2023-10-25T23:37:40.896 INFO:tasks.workunit.client.0.smithi081.stdout: create 261/35 file after the snapshot 2023-10-25T23:37:40.897 INFO:tasks.workunit.client.0.smithi081.stdout: create 261/36 file after the snapshot 2023-10-25T23:37:40.897 INFO:tasks.workunit.client.0.smithi081.stdout: create 261/37 file after the snapshot 2023-10-25T23:37:40.898 INFO:tasks.workunit.client.0.smithi081.stdout: create 261/38 file after the snapshot 2023-10-25T23:37:40.899 INFO:tasks.workunit.client.0.smithi081.stdout: create 261/39 file after the snapshot 2023-10-25T23:37:40.900 INFO:tasks.workunit.client.0.smithi081.stdout: create 262/.snap/snap-subdir-test 2023-10-25T23:37:40.932 INFO:tasks.workunit.client.0.smithi081.stdout: create 262/30 file after the snapshot 2023-10-25T23:37:40.933 INFO:tasks.workunit.client.0.smithi081.stdout: create 262/31 file after the snapshot 2023-10-25T23:37:40.934 INFO:tasks.workunit.client.0.smithi081.stdout: create 262/32 file after the snapshot 2023-10-25T23:37:40.935 INFO:tasks.workunit.client.0.smithi081.stdout: create 262/33 file after the snapshot 2023-10-25T23:37:40.936 INFO:tasks.workunit.client.0.smithi081.stdout: create 262/34 file after the snapshot 2023-10-25T23:37:40.936 INFO:tasks.workunit.client.0.smithi081.stdout: create 262/35 file after the snapshot 2023-10-25T23:37:40.937 INFO:tasks.workunit.client.0.smithi081.stdout: create 262/36 file after the snapshot 2023-10-25T23:37:40.938 INFO:tasks.workunit.client.0.smithi081.stdout: create 262/37 file after the snapshot 2023-10-25T23:37:40.939 INFO:tasks.workunit.client.0.smithi081.stdout: create 262/38 file after the snapshot 2023-10-25T23:37:40.940 INFO:tasks.workunit.client.0.smithi081.stdout: create 262/39 file after the snapshot 2023-10-25T23:37:40.941 INFO:tasks.workunit.client.0.smithi081.stdout: create 263/.snap/snap-subdir-test 2023-10-25T23:37:40.968 INFO:tasks.workunit.client.0.smithi081.stdout: create 263/30 file after the snapshot 2023-10-25T23:37:40.969 INFO:tasks.workunit.client.0.smithi081.stdout: create 263/31 file after the snapshot 2023-10-25T23:37:40.970 INFO:tasks.workunit.client.0.smithi081.stdout: create 263/32 file after the snapshot 2023-10-25T23:37:40.970 INFO:tasks.workunit.client.0.smithi081.stdout: create 263/33 file after the snapshot 2023-10-25T23:37:40.971 INFO:tasks.workunit.client.0.smithi081.stdout: create 263/34 file after the snapshot 2023-10-25T23:37:40.972 INFO:tasks.workunit.client.0.smithi081.stdout: create 263/35 file after the snapshot 2023-10-25T23:37:40.973 INFO:tasks.workunit.client.0.smithi081.stdout: create 263/36 file after the snapshot 2023-10-25T23:37:40.974 INFO:tasks.workunit.client.0.smithi081.stdout: create 263/37 file after the snapshot 2023-10-25T23:37:40.975 INFO:tasks.workunit.client.0.smithi081.stdout: create 263/38 file after the snapshot 2023-10-25T23:37:40.976 INFO:tasks.workunit.client.0.smithi081.stdout: create 263/39 file after the snapshot 2023-10-25T23:37:40.977 INFO:tasks.workunit.client.0.smithi081.stdout: create 264/.snap/snap-subdir-test 2023-10-25T23:37:41.004 INFO:tasks.workunit.client.0.smithi081.stdout: create 264/30 file after the snapshot 2023-10-25T23:37:41.005 INFO:tasks.workunit.client.0.smithi081.stdout: create 264/31 file after the snapshot 2023-10-25T23:37:41.006 INFO:tasks.workunit.client.0.smithi081.stdout: create 264/32 file after the snapshot 2023-10-25T23:37:41.007 INFO:tasks.workunit.client.0.smithi081.stdout: create 264/33 file after the snapshot 2023-10-25T23:37:41.008 INFO:tasks.workunit.client.0.smithi081.stdout: create 264/34 file after the snapshot 2023-10-25T23:37:41.009 INFO:tasks.workunit.client.0.smithi081.stdout: create 264/35 file after the snapshot 2023-10-25T23:37:41.010 INFO:tasks.workunit.client.0.smithi081.stdout: create 264/36 file after the snapshot 2023-10-25T23:37:41.011 INFO:tasks.workunit.client.0.smithi081.stdout: create 264/37 file after the snapshot 2023-10-25T23:37:41.012 INFO:tasks.workunit.client.0.smithi081.stdout: create 264/38 file after the snapshot 2023-10-25T23:37:41.013 INFO:tasks.workunit.client.0.smithi081.stdout: create 264/39 file after the snapshot 2023-10-25T23:37:41.013 INFO:tasks.workunit.client.0.smithi081.stdout: create 265/.snap/snap-subdir-test 2023-10-25T23:37:41.041 INFO:tasks.workunit.client.0.smithi081.stdout: create 265/30 file after the snapshot 2023-10-25T23:37:41.043 INFO:tasks.workunit.client.0.smithi081.stdout: create 265/31 file after the snapshot 2023-10-25T23:37:41.043 INFO:tasks.workunit.client.0.smithi081.stdout: create 265/32 file after the snapshot 2023-10-25T23:37:41.044 INFO:tasks.workunit.client.0.smithi081.stdout: create 265/33 file after the snapshot 2023-10-25T23:37:41.045 INFO:tasks.workunit.client.0.smithi081.stdout: create 265/34 file after the snapshot 2023-10-25T23:37:41.046 INFO:tasks.workunit.client.0.smithi081.stdout: create 265/35 file after the snapshot 2023-10-25T23:37:41.047 INFO:tasks.workunit.client.0.smithi081.stdout: create 265/36 file after the snapshot 2023-10-25T23:37:41.048 INFO:tasks.workunit.client.0.smithi081.stdout: create 265/37 file after the snapshot 2023-10-25T23:37:41.049 INFO:tasks.workunit.client.0.smithi081.stdout: create 265/38 file after the snapshot 2023-10-25T23:37:41.050 INFO:tasks.workunit.client.0.smithi081.stdout: create 265/39 file after the snapshot 2023-10-25T23:37:41.050 INFO:tasks.workunit.client.0.smithi081.stdout: create 266/.snap/snap-subdir-test 2023-10-25T23:37:41.077 INFO:tasks.workunit.client.0.smithi081.stdout: create 266/30 file after the snapshot 2023-10-25T23:37:41.079 INFO:tasks.workunit.client.0.smithi081.stdout: create 266/31 file after the snapshot 2023-10-25T23:37:41.079 INFO:tasks.workunit.client.0.smithi081.stdout: create 266/32 file after the snapshot 2023-10-25T23:37:41.080 INFO:tasks.workunit.client.0.smithi081.stdout: create 266/33 file after the snapshot 2023-10-25T23:37:41.081 INFO:tasks.workunit.client.0.smithi081.stdout: create 266/34 file after the snapshot 2023-10-25T23:37:41.082 INFO:tasks.workunit.client.0.smithi081.stdout: create 266/35 file after the snapshot 2023-10-25T23:37:41.083 INFO:tasks.workunit.client.0.smithi081.stdout: create 266/36 file after the snapshot 2023-10-25T23:37:41.084 INFO:tasks.workunit.client.0.smithi081.stdout: create 266/37 file after the snapshot 2023-10-25T23:37:41.085 INFO:tasks.workunit.client.0.smithi081.stdout: create 266/38 file after the snapshot 2023-10-25T23:37:41.086 INFO:tasks.workunit.client.0.smithi081.stdout: create 266/39 file after the snapshot 2023-10-25T23:37:41.087 INFO:tasks.workunit.client.0.smithi081.stdout: create 267/.snap/snap-subdir-test 2023-10-25T23:37:41.112 INFO:tasks.workunit.client.0.smithi081.stdout: create 267/30 file after the snapshot 2023-10-25T23:37:41.113 INFO:tasks.workunit.client.0.smithi081.stdout: create 267/31 file after the snapshot 2023-10-25T23:37:41.114 INFO:tasks.workunit.client.0.smithi081.stdout: create 267/32 file after the snapshot 2023-10-25T23:37:41.115 INFO:tasks.workunit.client.0.smithi081.stdout: create 267/33 file after the snapshot 2023-10-25T23:37:41.116 INFO:tasks.workunit.client.0.smithi081.stdout: create 267/34 file after the snapshot 2023-10-25T23:37:41.117 INFO:tasks.workunit.client.0.smithi081.stdout: create 267/35 file after the snapshot 2023-10-25T23:37:41.117 INFO:tasks.workunit.client.0.smithi081.stdout: create 267/36 file after the snapshot 2023-10-25T23:37:41.118 INFO:tasks.workunit.client.0.smithi081.stdout: create 267/37 file after the snapshot 2023-10-25T23:37:41.119 INFO:tasks.workunit.client.0.smithi081.stdout: create 267/38 file after the snapshot 2023-10-25T23:37:41.120 INFO:tasks.workunit.client.0.smithi081.stdout: create 267/39 file after the snapshot 2023-10-25T23:37:41.121 INFO:tasks.workunit.client.0.smithi081.stdout: create 268/.snap/snap-subdir-test 2023-10-25T23:37:41.159 INFO:tasks.workunit.client.0.smithi081.stdout: create 268/30 file after the snapshot 2023-10-25T23:37:41.160 INFO:tasks.workunit.client.0.smithi081.stdout: create 268/31 file after the snapshot 2023-10-25T23:37:41.161 INFO:tasks.workunit.client.0.smithi081.stdout: create 268/32 file after the snapshot 2023-10-25T23:37:41.162 INFO:tasks.workunit.client.0.smithi081.stdout: create 268/33 file after the snapshot 2023-10-25T23:37:41.163 INFO:tasks.workunit.client.0.smithi081.stdout: create 268/34 file after the snapshot 2023-10-25T23:37:41.164 INFO:tasks.workunit.client.0.smithi081.stdout: create 268/35 file after the snapshot 2023-10-25T23:37:41.165 INFO:tasks.workunit.client.0.smithi081.stdout: create 268/36 file after the snapshot 2023-10-25T23:37:41.166 INFO:tasks.workunit.client.0.smithi081.stdout: create 268/37 file after the snapshot 2023-10-25T23:37:41.167 INFO:tasks.workunit.client.0.smithi081.stdout: create 268/38 file after the snapshot 2023-10-25T23:37:41.168 INFO:tasks.workunit.client.0.smithi081.stdout: create 268/39 file after the snapshot 2023-10-25T23:37:41.168 INFO:tasks.workunit.client.0.smithi081.stdout: create 269/.snap/snap-subdir-test 2023-10-25T23:37:41.203 INFO:tasks.workunit.client.0.smithi081.stdout: create 269/30 file after the snapshot 2023-10-25T23:37:41.204 INFO:tasks.workunit.client.0.smithi081.stdout: create 269/31 file after the snapshot 2023-10-25T23:37:41.204 INFO:tasks.workunit.client.0.smithi081.stdout: create 269/32 file after the snapshot 2023-10-25T23:37:41.205 INFO:tasks.workunit.client.0.smithi081.stdout: create 269/33 file after the snapshot 2023-10-25T23:37:41.206 INFO:tasks.workunit.client.0.smithi081.stdout: create 269/34 file after the snapshot 2023-10-25T23:37:41.207 INFO:tasks.workunit.client.0.smithi081.stdout: create 269/35 file after the snapshot 2023-10-25T23:37:41.208 INFO:tasks.workunit.client.0.smithi081.stdout: create 269/36 file after the snapshot 2023-10-25T23:37:41.209 INFO:tasks.workunit.client.0.smithi081.stdout: create 269/37 file after the snapshot 2023-10-25T23:37:41.210 INFO:tasks.workunit.client.0.smithi081.stdout: create 269/38 file after the snapshot 2023-10-25T23:37:41.211 INFO:tasks.workunit.client.0.smithi081.stdout: create 269/39 file after the snapshot 2023-10-25T23:37:41.211 INFO:tasks.workunit.client.0.smithi081.stdout: create 270/.snap/snap-subdir-test 2023-10-25T23:37:41.245 INFO:tasks.workunit.client.0.smithi081.stdout: create 270/30 file after the snapshot 2023-10-25T23:37:41.246 INFO:tasks.workunit.client.0.smithi081.stdout: create 270/31 file after the snapshot 2023-10-25T23:37:41.247 INFO:tasks.workunit.client.0.smithi081.stdout: create 270/32 file after the snapshot 2023-10-25T23:37:41.248 INFO:tasks.workunit.client.0.smithi081.stdout: create 270/33 file after the snapshot 2023-10-25T23:37:41.249 INFO:tasks.workunit.client.0.smithi081.stdout: create 270/34 file after the snapshot 2023-10-25T23:37:41.250 INFO:tasks.workunit.client.0.smithi081.stdout: create 270/35 file after the snapshot 2023-10-25T23:37:41.250 INFO:tasks.workunit.client.0.smithi081.stdout: create 270/36 file after the snapshot 2023-10-25T23:37:41.252 INFO:tasks.workunit.client.0.smithi081.stdout: create 270/37 file after the snapshot 2023-10-25T23:37:41.252 INFO:tasks.workunit.client.0.smithi081.stdout: create 270/38 file after the snapshot 2023-10-25T23:37:41.253 INFO:tasks.workunit.client.0.smithi081.stdout: create 270/39 file after the snapshot 2023-10-25T23:37:41.254 INFO:tasks.workunit.client.0.smithi081.stdout: create 271/.snap/snap-subdir-test 2023-10-25T23:37:41.289 INFO:tasks.workunit.client.0.smithi081.stdout: create 271/30 file after the snapshot 2023-10-25T23:37:41.290 INFO:tasks.workunit.client.0.smithi081.stdout: create 271/31 file after the snapshot 2023-10-25T23:37:41.291 INFO:tasks.workunit.client.0.smithi081.stdout: create 271/32 file after the snapshot 2023-10-25T23:37:41.292 INFO:tasks.workunit.client.0.smithi081.stdout: create 271/33 file after the snapshot 2023-10-25T23:37:41.293 INFO:tasks.workunit.client.0.smithi081.stdout: create 271/34 file after the snapshot 2023-10-25T23:37:41.293 INFO:tasks.workunit.client.0.smithi081.stdout: create 271/35 file after the snapshot 2023-10-25T23:37:41.294 INFO:tasks.workunit.client.0.smithi081.stdout: create 271/36 file after the snapshot 2023-10-25T23:37:41.295 INFO:tasks.workunit.client.0.smithi081.stdout: create 271/37 file after the snapshot 2023-10-25T23:37:41.296 INFO:tasks.workunit.client.0.smithi081.stdout: create 271/38 file after the snapshot 2023-10-25T23:37:41.297 INFO:tasks.workunit.client.0.smithi081.stdout: create 271/39 file after the snapshot 2023-10-25T23:37:41.298 INFO:tasks.workunit.client.0.smithi081.stdout: create 272/.snap/snap-subdir-test 2023-10-25T23:37:41.331 INFO:tasks.workunit.client.0.smithi081.stdout: create 272/30 file after the snapshot 2023-10-25T23:37:41.332 INFO:tasks.workunit.client.0.smithi081.stdout: create 272/31 file after the snapshot 2023-10-25T23:37:41.333 INFO:tasks.workunit.client.0.smithi081.stdout: create 272/32 file after the snapshot 2023-10-25T23:37:41.334 INFO:tasks.workunit.client.0.smithi081.stdout: create 272/33 file after the snapshot 2023-10-25T23:37:41.335 INFO:tasks.workunit.client.0.smithi081.stdout: create 272/34 file after the snapshot 2023-10-25T23:37:41.336 INFO:tasks.workunit.client.0.smithi081.stdout: create 272/35 file after the snapshot 2023-10-25T23:37:41.337 INFO:tasks.workunit.client.0.smithi081.stdout: create 272/36 file after the snapshot 2023-10-25T23:37:41.338 INFO:tasks.workunit.client.0.smithi081.stdout: create 272/37 file after the snapshot 2023-10-25T23:37:41.338 INFO:tasks.workunit.client.0.smithi081.stdout: create 272/38 file after the snapshot 2023-10-25T23:37:41.339 INFO:tasks.workunit.client.0.smithi081.stdout: create 272/39 file after the snapshot 2023-10-25T23:37:41.340 INFO:tasks.workunit.client.0.smithi081.stdout: create 273/.snap/snap-subdir-test 2023-10-25T23:37:41.374 INFO:tasks.workunit.client.0.smithi081.stdout: create 273/30 file after the snapshot 2023-10-25T23:37:41.375 INFO:tasks.workunit.client.0.smithi081.stdout: create 273/31 file after the snapshot 2023-10-25T23:37:41.376 INFO:tasks.workunit.client.0.smithi081.stdout: create 273/32 file after the snapshot 2023-10-25T23:37:41.377 INFO:tasks.workunit.client.0.smithi081.stdout: create 273/33 file after the snapshot 2023-10-25T23:37:41.378 INFO:tasks.workunit.client.0.smithi081.stdout: create 273/34 file after the snapshot 2023-10-25T23:37:41.378 INFO:tasks.workunit.client.0.smithi081.stdout: create 273/35 file after the snapshot 2023-10-25T23:37:41.379 INFO:tasks.workunit.client.0.smithi081.stdout: create 273/36 file after the snapshot 2023-10-25T23:37:41.380 INFO:tasks.workunit.client.0.smithi081.stdout: create 273/37 file after the snapshot 2023-10-25T23:37:41.381 INFO:tasks.workunit.client.0.smithi081.stdout: create 273/38 file after the snapshot 2023-10-25T23:37:41.382 INFO:tasks.workunit.client.0.smithi081.stdout: create 273/39 file after the snapshot 2023-10-25T23:37:41.383 INFO:tasks.workunit.client.0.smithi081.stdout: create 274/.snap/snap-subdir-test 2023-10-25T23:37:41.416 INFO:tasks.workunit.client.0.smithi081.stdout: create 274/30 file after the snapshot 2023-10-25T23:37:41.417 INFO:tasks.workunit.client.0.smithi081.stdout: create 274/31 file after the snapshot 2023-10-25T23:37:41.418 INFO:tasks.workunit.client.0.smithi081.stdout: create 274/32 file after the snapshot 2023-10-25T23:37:41.419 INFO:tasks.workunit.client.0.smithi081.stdout: create 274/33 file after the snapshot 2023-10-25T23:37:41.420 INFO:tasks.workunit.client.0.smithi081.stdout: create 274/34 file after the snapshot 2023-10-25T23:37:41.421 INFO:tasks.workunit.client.0.smithi081.stdout: create 274/35 file after the snapshot 2023-10-25T23:37:41.422 INFO:tasks.workunit.client.0.smithi081.stdout: create 274/36 file after the snapshot 2023-10-25T23:37:41.422 INFO:tasks.workunit.client.0.smithi081.stdout: create 274/37 file after the snapshot 2023-10-25T23:37:41.423 INFO:tasks.workunit.client.0.smithi081.stdout: create 274/38 file after the snapshot 2023-10-25T23:37:41.424 INFO:tasks.workunit.client.0.smithi081.stdout: create 274/39 file after the snapshot 2023-10-25T23:37:41.425 INFO:tasks.workunit.client.0.smithi081.stdout: create 275/.snap/snap-subdir-test 2023-10-25T23:37:41.461 INFO:tasks.workunit.client.0.smithi081.stdout: create 275/30 file after the snapshot 2023-10-25T23:37:41.462 INFO:tasks.workunit.client.0.smithi081.stdout: create 275/31 file after the snapshot 2023-10-25T23:37:41.463 INFO:tasks.workunit.client.0.smithi081.stdout: create 275/32 file after the snapshot 2023-10-25T23:37:41.464 INFO:tasks.workunit.client.0.smithi081.stdout: create 275/33 file after the snapshot 2023-10-25T23:37:41.465 INFO:tasks.workunit.client.0.smithi081.stdout: create 275/34 file after the snapshot 2023-10-25T23:37:41.466 INFO:tasks.workunit.client.0.smithi081.stdout: create 275/35 file after the snapshot 2023-10-25T23:37:41.466 INFO:tasks.workunit.client.0.smithi081.stdout: create 275/36 file after the snapshot 2023-10-25T23:37:41.470 INFO:tasks.workunit.client.0.smithi081.stdout: create 275/37 file after the snapshot 2023-10-25T23:37:41.470 INFO:tasks.workunit.client.0.smithi081.stdout: create 275/38 file after the snapshot 2023-10-25T23:37:41.470 INFO:tasks.workunit.client.0.smithi081.stdout: create 275/39 file after the snapshot 2023-10-25T23:37:41.471 INFO:tasks.workunit.client.0.smithi081.stdout: create 276/.snap/snap-subdir-test 2023-10-25T23:37:41.510 INFO:tasks.workunit.client.0.smithi081.stdout: create 276/30 file after the snapshot 2023-10-25T23:37:41.510 INFO:tasks.workunit.client.0.smithi081.stdout: create 276/31 file after the snapshot 2023-10-25T23:37:41.511 INFO:tasks.workunit.client.0.smithi081.stdout: create 276/32 file after the snapshot 2023-10-25T23:37:41.511 INFO:tasks.workunit.client.0.smithi081.stdout: create 276/33 file after the snapshot 2023-10-25T23:37:41.512 INFO:tasks.workunit.client.0.smithi081.stdout: create 276/34 file after the snapshot 2023-10-25T23:37:41.513 INFO:tasks.workunit.client.0.smithi081.stdout: create 276/35 file after the snapshot 2023-10-25T23:37:41.514 INFO:tasks.workunit.client.0.smithi081.stdout: create 276/36 file after the snapshot 2023-10-25T23:37:41.514 INFO:tasks.workunit.client.0.smithi081.stdout: create 276/37 file after the snapshot 2023-10-25T23:37:41.515 INFO:tasks.workunit.client.0.smithi081.stdout: create 276/38 file after the snapshot 2023-10-25T23:37:41.516 INFO:tasks.workunit.client.0.smithi081.stdout: create 276/39 file after the snapshot 2023-10-25T23:37:41.517 INFO:tasks.workunit.client.0.smithi081.stdout: create 277/.snap/snap-subdir-test 2023-10-25T23:37:41.554 INFO:tasks.workunit.client.0.smithi081.stdout: create 277/30 file after the snapshot 2023-10-25T23:37:41.555 INFO:tasks.workunit.client.0.smithi081.stdout: create 277/31 file after the snapshot 2023-10-25T23:37:41.556 INFO:tasks.workunit.client.0.smithi081.stdout: create 277/32 file after the snapshot 2023-10-25T23:37:41.557 INFO:tasks.workunit.client.0.smithi081.stdout: create 277/33 file after the snapshot 2023-10-25T23:37:41.557 INFO:tasks.workunit.client.0.smithi081.stdout: create 277/34 file after the snapshot 2023-10-25T23:37:41.558 INFO:tasks.workunit.client.0.smithi081.stdout: create 277/35 file after the snapshot 2023-10-25T23:37:41.559 INFO:tasks.workunit.client.0.smithi081.stdout: create 277/36 file after the snapshot 2023-10-25T23:37:41.560 INFO:tasks.workunit.client.0.smithi081.stdout: create 277/37 file after the snapshot 2023-10-25T23:37:41.561 INFO:tasks.workunit.client.0.smithi081.stdout: create 277/38 file after the snapshot 2023-10-25T23:37:41.562 INFO:tasks.workunit.client.0.smithi081.stdout: create 277/39 file after the snapshot 2023-10-25T23:37:41.563 INFO:tasks.workunit.client.0.smithi081.stdout: create 278/.snap/snap-subdir-test 2023-10-25T23:37:41.593 INFO:tasks.workunit.client.0.smithi081.stdout: create 278/30 file after the snapshot 2023-10-25T23:37:41.596 INFO:tasks.workunit.client.0.smithi081.stdout: create 278/31 file after the snapshot 2023-10-25T23:37:41.597 INFO:tasks.workunit.client.0.smithi081.stdout: create 278/32 file after the snapshot 2023-10-25T23:37:41.599 INFO:tasks.workunit.client.0.smithi081.stdout: create 278/33 file after the snapshot 2023-10-25T23:37:41.600 INFO:tasks.workunit.client.0.smithi081.stdout: create 278/34 file after the snapshot 2023-10-25T23:37:41.601 INFO:tasks.workunit.client.0.smithi081.stdout: create 278/35 file after the snapshot 2023-10-25T23:37:41.603 INFO:tasks.workunit.client.0.smithi081.stdout: create 278/36 file after the snapshot 2023-10-25T23:37:41.604 INFO:tasks.workunit.client.0.smithi081.stdout: create 278/37 file after the snapshot 2023-10-25T23:37:41.605 INFO:tasks.workunit.client.0.smithi081.stdout: create 278/38 file after the snapshot 2023-10-25T23:37:41.606 INFO:tasks.workunit.client.0.smithi081.stdout: create 278/39 file after the snapshot 2023-10-25T23:37:41.607 INFO:tasks.workunit.client.0.smithi081.stdout: create 279/.snap/snap-subdir-test 2023-10-25T23:37:41.639 INFO:tasks.workunit.client.0.smithi081.stdout: create 279/30 file after the snapshot 2023-10-25T23:37:41.641 INFO:tasks.workunit.client.0.smithi081.stdout: create 279/31 file after the snapshot 2023-10-25T23:37:41.642 INFO:tasks.workunit.client.0.smithi081.stdout: create 279/32 file after the snapshot 2023-10-25T23:37:41.643 INFO:tasks.workunit.client.0.smithi081.stdout: create 279/33 file after the snapshot 2023-10-25T23:37:41.645 INFO:tasks.workunit.client.0.smithi081.stdout: create 279/34 file after the snapshot 2023-10-25T23:37:41.646 INFO:tasks.workunit.client.0.smithi081.stdout: create 279/35 file after the snapshot 2023-10-25T23:37:41.647 INFO:tasks.workunit.client.0.smithi081.stdout: create 279/36 file after the snapshot 2023-10-25T23:37:41.648 INFO:tasks.workunit.client.0.smithi081.stdout: create 279/37 file after the snapshot 2023-10-25T23:37:41.649 INFO:tasks.workunit.client.0.smithi081.stdout: create 279/38 file after the snapshot 2023-10-25T23:37:41.650 INFO:tasks.workunit.client.0.smithi081.stdout: create 279/39 file after the snapshot 2023-10-25T23:37:41.651 INFO:tasks.workunit.client.0.smithi081.stdout: create 280/.snap/snap-subdir-test 2023-10-25T23:37:41.678 INFO:tasks.workunit.client.0.smithi081.stdout: create 280/30 file after the snapshot 2023-10-25T23:37:41.679 INFO:tasks.workunit.client.0.smithi081.stdout: create 280/31 file after the snapshot 2023-10-25T23:37:41.680 INFO:tasks.workunit.client.0.smithi081.stdout: create 280/32 file after the snapshot 2023-10-25T23:37:41.681 INFO:tasks.workunit.client.0.smithi081.stdout: create 280/33 file after the snapshot 2023-10-25T23:37:41.682 INFO:tasks.workunit.client.0.smithi081.stdout: create 280/34 file after the snapshot 2023-10-25T23:37:41.683 INFO:tasks.workunit.client.0.smithi081.stdout: create 280/35 file after the snapshot 2023-10-25T23:37:41.684 INFO:tasks.workunit.client.0.smithi081.stdout: create 280/36 file after the snapshot 2023-10-25T23:37:41.684 INFO:tasks.workunit.client.0.smithi081.stdout: create 280/37 file after the snapshot 2023-10-25T23:37:41.685 INFO:tasks.workunit.client.0.smithi081.stdout: create 280/38 file after the snapshot 2023-10-25T23:37:41.687 INFO:tasks.workunit.client.0.smithi081.stdout: create 280/39 file after the snapshot 2023-10-25T23:37:41.687 INFO:tasks.workunit.client.0.smithi081.stdout: create 281/.snap/snap-subdir-test 2023-10-25T23:37:41.714 INFO:tasks.workunit.client.0.smithi081.stdout: create 281/30 file after the snapshot 2023-10-25T23:37:41.715 INFO:tasks.workunit.client.0.smithi081.stdout: create 281/31 file after the snapshot 2023-10-25T23:37:41.716 INFO:tasks.workunit.client.0.smithi081.stdout: create 281/32 file after the snapshot 2023-10-25T23:37:41.717 INFO:tasks.workunit.client.0.smithi081.stdout: create 281/33 file after the snapshot 2023-10-25T23:37:41.717 INFO:tasks.workunit.client.0.smithi081.stdout: create 281/34 file after the snapshot 2023-10-25T23:37:41.718 INFO:tasks.workunit.client.0.smithi081.stdout: create 281/35 file after the snapshot 2023-10-25T23:37:41.719 INFO:tasks.workunit.client.0.smithi081.stdout: create 281/36 file after the snapshot 2023-10-25T23:37:41.721 INFO:tasks.workunit.client.0.smithi081.stdout: create 281/37 file after the snapshot 2023-10-25T23:37:41.721 INFO:tasks.workunit.client.0.smithi081.stdout: create 281/38 file after the snapshot 2023-10-25T23:37:41.722 INFO:tasks.workunit.client.0.smithi081.stdout: create 281/39 file after the snapshot 2023-10-25T23:37:41.723 INFO:tasks.workunit.client.0.smithi081.stdout: create 282/.snap/snap-subdir-test 2023-10-25T23:37:41.750 INFO:tasks.workunit.client.0.smithi081.stdout: create 282/30 file after the snapshot 2023-10-25T23:37:41.751 INFO:tasks.workunit.client.0.smithi081.stdout: create 282/31 file after the snapshot 2023-10-25T23:37:41.752 INFO:tasks.workunit.client.0.smithi081.stdout: create 282/32 file after the snapshot 2023-10-25T23:37:41.753 INFO:tasks.workunit.client.0.smithi081.stdout: create 282/33 file after the snapshot 2023-10-25T23:37:41.754 INFO:tasks.workunit.client.0.smithi081.stdout: create 282/34 file after the snapshot 2023-10-25T23:37:41.755 INFO:tasks.workunit.client.0.smithi081.stdout: create 282/35 file after the snapshot 2023-10-25T23:37:41.756 INFO:tasks.workunit.client.0.smithi081.stdout: create 282/36 file after the snapshot 2023-10-25T23:37:41.757 INFO:tasks.workunit.client.0.smithi081.stdout: create 282/37 file after the snapshot 2023-10-25T23:37:41.759 INFO:tasks.workunit.client.0.smithi081.stdout: create 282/38 file after the snapshot 2023-10-25T23:37:41.760 INFO:tasks.workunit.client.0.smithi081.stdout: create 282/39 file after the snapshot 2023-10-25T23:37:41.762 INFO:tasks.workunit.client.0.smithi081.stdout: create 283/.snap/snap-subdir-test 2023-10-25T23:37:41.789 INFO:tasks.workunit.client.0.smithi081.stdout: create 283/30 file after the snapshot 2023-10-25T23:37:41.791 INFO:tasks.workunit.client.0.smithi081.stdout: create 283/31 file after the snapshot 2023-10-25T23:37:41.792 INFO:tasks.workunit.client.0.smithi081.stdout: create 283/32 file after the snapshot 2023-10-25T23:37:41.794 INFO:tasks.workunit.client.0.smithi081.stdout: create 283/33 file after the snapshot 2023-10-25T23:37:41.795 INFO:tasks.workunit.client.0.smithi081.stdout: create 283/34 file after the snapshot 2023-10-25T23:37:41.797 INFO:tasks.workunit.client.0.smithi081.stdout: create 283/35 file after the snapshot 2023-10-25T23:37:41.798 INFO:tasks.workunit.client.0.smithi081.stdout: create 283/36 file after the snapshot 2023-10-25T23:37:41.799 INFO:tasks.workunit.client.0.smithi081.stdout: create 283/37 file after the snapshot 2023-10-25T23:37:41.800 INFO:tasks.workunit.client.0.smithi081.stdout: create 283/38 file after the snapshot 2023-10-25T23:37:41.802 INFO:tasks.workunit.client.0.smithi081.stdout: create 283/39 file after the snapshot 2023-10-25T23:37:41.803 INFO:tasks.workunit.client.0.smithi081.stdout: create 284/.snap/snap-subdir-test 2023-10-25T23:37:41.830 INFO:tasks.workunit.client.0.smithi081.stdout: create 284/30 file after the snapshot 2023-10-25T23:37:41.832 INFO:tasks.workunit.client.0.smithi081.stdout: create 284/31 file after the snapshot 2023-10-25T23:37:41.833 INFO:tasks.workunit.client.0.smithi081.stdout: create 284/32 file after the snapshot 2023-10-25T23:37:41.834 INFO:tasks.workunit.client.0.smithi081.stdout: create 284/33 file after the snapshot 2023-10-25T23:37:41.836 INFO:tasks.workunit.client.0.smithi081.stdout: create 284/34 file after the snapshot 2023-10-25T23:37:41.837 INFO:tasks.workunit.client.0.smithi081.stdout: create 284/35 file after the snapshot 2023-10-25T23:37:41.838 INFO:tasks.workunit.client.0.smithi081.stdout: create 284/36 file after the snapshot 2023-10-25T23:37:41.840 INFO:tasks.workunit.client.0.smithi081.stdout: create 284/37 file after the snapshot 2023-10-25T23:37:41.841 INFO:tasks.workunit.client.0.smithi081.stdout: create 284/38 file after the snapshot 2023-10-25T23:37:41.842 INFO:tasks.workunit.client.0.smithi081.stdout: create 284/39 file after the snapshot 2023-10-25T23:37:41.844 INFO:tasks.workunit.client.0.smithi081.stdout: create 285/.snap/snap-subdir-test 2023-10-25T23:37:41.869 INFO:tasks.workunit.client.0.smithi081.stdout: create 285/30 file after the snapshot 2023-10-25T23:37:41.871 INFO:tasks.workunit.client.0.smithi081.stdout: create 285/31 file after the snapshot 2023-10-25T23:37:41.872 INFO:tasks.workunit.client.0.smithi081.stdout: create 285/32 file after the snapshot 2023-10-25T23:37:41.874 INFO:tasks.workunit.client.0.smithi081.stdout: create 285/33 file after the snapshot 2023-10-25T23:37:41.875 INFO:tasks.workunit.client.0.smithi081.stdout: create 285/34 file after the snapshot 2023-10-25T23:37:41.877 INFO:tasks.workunit.client.0.smithi081.stdout: create 285/35 file after the snapshot 2023-10-25T23:37:41.878 INFO:tasks.workunit.client.0.smithi081.stdout: create 285/36 file after the snapshot 2023-10-25T23:37:41.879 INFO:tasks.workunit.client.0.smithi081.stdout: create 285/37 file after the snapshot 2023-10-25T23:37:41.881 INFO:tasks.workunit.client.0.smithi081.stdout: create 285/38 file after the snapshot 2023-10-25T23:37:41.882 INFO:tasks.workunit.client.0.smithi081.stdout: create 285/39 file after the snapshot 2023-10-25T23:37:41.883 INFO:tasks.workunit.client.0.smithi081.stdout: create 286/.snap/snap-subdir-test 2023-10-25T23:37:41.909 INFO:tasks.workunit.client.0.smithi081.stdout: create 286/30 file after the snapshot 2023-10-25T23:37:41.911 INFO:tasks.workunit.client.0.smithi081.stdout: create 286/31 file after the snapshot 2023-10-25T23:37:41.913 INFO:tasks.workunit.client.0.smithi081.stdout: create 286/32 file after the snapshot 2023-10-25T23:37:41.914 INFO:tasks.workunit.client.0.smithi081.stdout: create 286/33 file after the snapshot 2023-10-25T23:37:41.915 INFO:tasks.workunit.client.0.smithi081.stdout: create 286/34 file after the snapshot 2023-10-25T23:37:41.916 INFO:tasks.workunit.client.0.smithi081.stdout: create 286/35 file after the snapshot 2023-10-25T23:37:41.918 INFO:tasks.workunit.client.0.smithi081.stdout: create 286/36 file after the snapshot 2023-10-25T23:37:41.919 INFO:tasks.workunit.client.0.smithi081.stdout: create 286/37 file after the snapshot 2023-10-25T23:37:41.920 INFO:tasks.workunit.client.0.smithi081.stdout: create 286/38 file after the snapshot 2023-10-25T23:37:41.922 INFO:tasks.workunit.client.0.smithi081.stdout: create 286/39 file after the snapshot 2023-10-25T23:37:41.923 INFO:tasks.workunit.client.0.smithi081.stdout: create 287/.snap/snap-subdir-test 2023-10-25T23:37:41.949 INFO:tasks.workunit.client.0.smithi081.stdout: create 287/30 file after the snapshot 2023-10-25T23:37:41.950 INFO:tasks.workunit.client.0.smithi081.stdout: create 287/31 file after the snapshot 2023-10-25T23:37:41.952 INFO:tasks.workunit.client.0.smithi081.stdout: create 287/32 file after the snapshot 2023-10-25T23:37:41.953 INFO:tasks.workunit.client.0.smithi081.stdout: create 287/33 file after the snapshot 2023-10-25T23:37:41.954 INFO:tasks.workunit.client.0.smithi081.stdout: create 287/34 file after the snapshot 2023-10-25T23:37:41.956 INFO:tasks.workunit.client.0.smithi081.stdout: create 287/35 file after the snapshot 2023-10-25T23:37:41.957 INFO:tasks.workunit.client.0.smithi081.stdout: create 287/36 file after the snapshot 2023-10-25T23:37:41.957 INFO:tasks.workunit.client.0.smithi081.stdout: create 287/37 file after the snapshot 2023-10-25T23:37:41.958 INFO:tasks.workunit.client.0.smithi081.stdout: create 287/38 file after the snapshot 2023-10-25T23:37:41.959 INFO:tasks.workunit.client.0.smithi081.stdout: create 287/39 file after the snapshot 2023-10-25T23:37:41.960 INFO:tasks.workunit.client.0.smithi081.stdout: create 288/.snap/snap-subdir-test 2023-10-25T23:37:41.985 INFO:tasks.workunit.client.0.smithi081.stdout: create 288/30 file after the snapshot 2023-10-25T23:37:41.986 INFO:tasks.workunit.client.0.smithi081.stdout: create 288/31 file after the snapshot 2023-10-25T23:37:41.988 INFO:tasks.workunit.client.0.smithi081.stdout: create 288/32 file after the snapshot 2023-10-25T23:37:41.989 INFO:tasks.workunit.client.0.smithi081.stdout: create 288/33 file after the snapshot 2023-10-25T23:37:41.991 INFO:tasks.workunit.client.0.smithi081.stdout: create 288/34 file after the snapshot 2023-10-25T23:37:41.992 INFO:tasks.workunit.client.0.smithi081.stdout: create 288/35 file after the snapshot 2023-10-25T23:37:41.993 INFO:tasks.workunit.client.0.smithi081.stdout: create 288/36 file after the snapshot 2023-10-25T23:37:41.994 INFO:tasks.workunit.client.0.smithi081.stdout: create 288/37 file after the snapshot 2023-10-25T23:37:41.995 INFO:tasks.workunit.client.0.smithi081.stdout: create 288/38 file after the snapshot 2023-10-25T23:37:41.997 INFO:tasks.workunit.client.0.smithi081.stdout: create 288/39 file after the snapshot 2023-10-25T23:37:41.998 INFO:tasks.workunit.client.0.smithi081.stdout: create 289/.snap/snap-subdir-test 2023-10-25T23:37:42.022 INFO:tasks.workunit.client.0.smithi081.stdout: create 289/30 file after the snapshot 2023-10-25T23:37:42.024 INFO:tasks.workunit.client.0.smithi081.stdout: create 289/31 file after the snapshot 2023-10-25T23:37:42.025 INFO:tasks.workunit.client.0.smithi081.stdout: create 289/32 file after the snapshot 2023-10-25T23:37:42.027 INFO:tasks.workunit.client.0.smithi081.stdout: create 289/33 file after the snapshot 2023-10-25T23:37:42.028 INFO:tasks.workunit.client.0.smithi081.stdout: create 289/34 file after the snapshot 2023-10-25T23:37:42.029 INFO:tasks.workunit.client.0.smithi081.stdout: create 289/35 file after the snapshot 2023-10-25T23:37:42.030 INFO:tasks.workunit.client.0.smithi081.stdout: create 289/36 file after the snapshot 2023-10-25T23:37:42.032 INFO:tasks.workunit.client.0.smithi081.stdout: create 289/37 file after the snapshot 2023-10-25T23:37:42.033 INFO:tasks.workunit.client.0.smithi081.stdout: create 289/38 file after the snapshot 2023-10-25T23:37:42.035 INFO:tasks.workunit.client.0.smithi081.stdout: create 289/39 file after the snapshot 2023-10-25T23:37:42.036 INFO:tasks.workunit.client.0.smithi081.stdout: create 290/.snap/snap-subdir-test 2023-10-25T23:37:42.060 INFO:tasks.workunit.client.0.smithi081.stdout: create 290/30 file after the snapshot 2023-10-25T23:37:42.062 INFO:tasks.workunit.client.0.smithi081.stdout: create 290/31 file after the snapshot 2023-10-25T23:37:42.063 INFO:tasks.workunit.client.0.smithi081.stdout: create 290/32 file after the snapshot 2023-10-25T23:37:42.065 INFO:tasks.workunit.client.0.smithi081.stdout: create 290/33 file after the snapshot 2023-10-25T23:37:42.066 INFO:tasks.workunit.client.0.smithi081.stdout: create 290/34 file after the snapshot 2023-10-25T23:37:42.067 INFO:tasks.workunit.client.0.smithi081.stdout: create 290/35 file after the snapshot 2023-10-25T23:37:42.069 INFO:tasks.workunit.client.0.smithi081.stdout: create 290/36 file after the snapshot 2023-10-25T23:37:42.070 INFO:tasks.workunit.client.0.smithi081.stdout: create 290/37 file after the snapshot 2023-10-25T23:37:42.072 INFO:tasks.workunit.client.0.smithi081.stdout: create 290/38 file after the snapshot 2023-10-25T23:37:42.076 INFO:tasks.workunit.client.0.smithi081.stdout: create 290/39 file after the snapshot 2023-10-25T23:37:42.077 INFO:tasks.workunit.client.0.smithi081.stdout: create 291/.snap/snap-subdir-test 2023-10-25T23:37:42.105 INFO:tasks.workunit.client.0.smithi081.stdout: create 291/30 file after the snapshot 2023-10-25T23:37:42.108 INFO:tasks.workunit.client.0.smithi081.stdout: create 291/31 file after the snapshot 2023-10-25T23:37:42.111 INFO:tasks.workunit.client.0.smithi081.stdout: create 291/32 file after the snapshot 2023-10-25T23:37:42.117 INFO:tasks.workunit.client.0.smithi081.stdout: create 291/33 file after the snapshot 2023-10-25T23:37:42.118 INFO:tasks.workunit.client.0.smithi081.stdout: create 291/34 file after the snapshot 2023-10-25T23:37:42.119 INFO:tasks.workunit.client.0.smithi081.stdout: create 291/35 file after the snapshot 2023-10-25T23:37:42.120 INFO:tasks.workunit.client.0.smithi081.stdout: create 291/36 file after the snapshot 2023-10-25T23:37:42.121 INFO:tasks.workunit.client.0.smithi081.stdout: create 291/37 file after the snapshot 2023-10-25T23:37:42.122 INFO:tasks.workunit.client.0.smithi081.stdout: create 291/38 file after the snapshot 2023-10-25T23:37:42.123 INFO:tasks.workunit.client.0.smithi081.stdout: create 291/39 file after the snapshot 2023-10-25T23:37:42.123 INFO:tasks.workunit.client.0.smithi081.stdout: create 292/.snap/snap-subdir-test 2023-10-25T23:37:42.152 INFO:tasks.workunit.client.0.smithi081.stdout: create 292/30 file after the snapshot 2023-10-25T23:37:42.155 INFO:tasks.workunit.client.0.smithi081.stdout: create 292/31 file after the snapshot 2023-10-25T23:37:42.157 INFO:tasks.workunit.client.0.smithi081.stdout: create 292/32 file after the snapshot 2023-10-25T23:37:42.159 INFO:tasks.workunit.client.0.smithi081.stdout: create 292/33 file after the snapshot 2023-10-25T23:37:42.161 INFO:tasks.workunit.client.0.smithi081.stdout: create 292/34 file after the snapshot 2023-10-25T23:37:42.163 INFO:tasks.workunit.client.0.smithi081.stdout: create 292/35 file after the snapshot 2023-10-25T23:37:42.164 INFO:tasks.workunit.client.0.smithi081.stdout: create 292/36 file after the snapshot 2023-10-25T23:37:42.165 INFO:tasks.workunit.client.0.smithi081.stdout: create 292/37 file after the snapshot 2023-10-25T23:37:42.165 INFO:tasks.workunit.client.0.smithi081.stdout: create 292/38 file after the snapshot 2023-10-25T23:37:42.166 INFO:tasks.workunit.client.0.smithi081.stdout: create 292/39 file after the snapshot 2023-10-25T23:37:42.166 INFO:tasks.workunit.client.0.smithi081.stdout: create 293/.snap/snap-subdir-test 2023-10-25T23:37:42.189 INFO:tasks.workunit.client.0.smithi081.stdout: create 293/30 file after the snapshot 2023-10-25T23:37:42.191 INFO:tasks.workunit.client.0.smithi081.stdout: create 293/31 file after the snapshot 2023-10-25T23:37:42.191 INFO:tasks.workunit.client.0.smithi081.stdout: create 293/32 file after the snapshot 2023-10-25T23:37:42.192 INFO:tasks.workunit.client.0.smithi081.stdout: create 293/33 file after the snapshot 2023-10-25T23:37:42.193 INFO:tasks.workunit.client.0.smithi081.stdout: create 293/34 file after the snapshot 2023-10-25T23:37:42.194 INFO:tasks.workunit.client.0.smithi081.stdout: create 293/35 file after the snapshot 2023-10-25T23:37:42.195 INFO:tasks.workunit.client.0.smithi081.stdout: create 293/36 file after the snapshot 2023-10-25T23:37:42.196 INFO:tasks.workunit.client.0.smithi081.stdout: create 293/37 file after the snapshot 2023-10-25T23:37:42.197 INFO:tasks.workunit.client.0.smithi081.stdout: create 293/38 file after the snapshot 2023-10-25T23:37:42.198 INFO:tasks.workunit.client.0.smithi081.stdout: create 293/39 file after the snapshot 2023-10-25T23:37:42.199 INFO:tasks.workunit.client.0.smithi081.stdout: create 294/.snap/snap-subdir-test 2023-10-25T23:37:42.224 INFO:tasks.workunit.client.0.smithi081.stdout: create 294/30 file after the snapshot 2023-10-25T23:37:42.225 INFO:tasks.workunit.client.0.smithi081.stdout: create 294/31 file after the snapshot 2023-10-25T23:37:42.226 INFO:tasks.workunit.client.0.smithi081.stdout: create 294/32 file after the snapshot 2023-10-25T23:37:42.227 INFO:tasks.workunit.client.0.smithi081.stdout: create 294/33 file after the snapshot 2023-10-25T23:37:42.228 INFO:tasks.workunit.client.0.smithi081.stdout: create 294/34 file after the snapshot 2023-10-25T23:37:42.229 INFO:tasks.workunit.client.0.smithi081.stdout: create 294/35 file after the snapshot 2023-10-25T23:37:42.230 INFO:tasks.workunit.client.0.smithi081.stdout: create 294/36 file after the snapshot 2023-10-25T23:37:42.230 INFO:tasks.workunit.client.0.smithi081.stdout: create 294/37 file after the snapshot 2023-10-25T23:37:42.231 INFO:tasks.workunit.client.0.smithi081.stdout: create 294/38 file after the snapshot 2023-10-25T23:37:42.232 INFO:tasks.workunit.client.0.smithi081.stdout: create 294/39 file after the snapshot 2023-10-25T23:37:42.233 INFO:tasks.workunit.client.0.smithi081.stdout: create 295/.snap/snap-subdir-test 2023-10-25T23:37:42.262 INFO:tasks.workunit.client.0.smithi081.stdout: create 295/30 file after the snapshot 2023-10-25T23:37:42.265 INFO:tasks.workunit.client.0.smithi081.stdout: create 295/31 file after the snapshot 2023-10-25T23:37:42.267 INFO:tasks.workunit.client.0.smithi081.stdout: create 295/32 file after the snapshot 2023-10-25T23:37:42.269 INFO:tasks.workunit.client.0.smithi081.stdout: create 295/33 file after the snapshot 2023-10-25T23:37:42.271 INFO:tasks.workunit.client.0.smithi081.stdout: create 295/34 file after the snapshot 2023-10-25T23:37:42.273 INFO:tasks.workunit.client.0.smithi081.stdout: create 295/35 file after the snapshot 2023-10-25T23:37:42.275 INFO:tasks.workunit.client.0.smithi081.stdout: create 295/36 file after the snapshot 2023-10-25T23:37:42.275 INFO:tasks.workunit.client.0.smithi081.stdout: create 295/37 file after the snapshot 2023-10-25T23:37:42.276 INFO:tasks.workunit.client.0.smithi081.stdout: create 295/38 file after the snapshot 2023-10-25T23:37:42.276 INFO:tasks.workunit.client.0.smithi081.stdout: create 295/39 file after the snapshot 2023-10-25T23:37:42.277 INFO:tasks.workunit.client.0.smithi081.stdout: create 296/.snap/snap-subdir-test 2023-10-25T23:37:42.302 INFO:tasks.workunit.client.0.smithi081.stdout: create 296/30 file after the snapshot 2023-10-25T23:37:42.303 INFO:tasks.workunit.client.0.smithi081.stdout: create 296/31 file after the snapshot 2023-10-25T23:37:42.304 INFO:tasks.workunit.client.0.smithi081.stdout: create 296/32 file after the snapshot 2023-10-25T23:37:42.305 INFO:tasks.workunit.client.0.smithi081.stdout: create 296/33 file after the snapshot 2023-10-25T23:37:42.306 INFO:tasks.workunit.client.0.smithi081.stdout: create 296/34 file after the snapshot 2023-10-25T23:37:42.308 INFO:tasks.workunit.client.0.smithi081.stdout: create 296/35 file after the snapshot 2023-10-25T23:37:42.308 INFO:tasks.workunit.client.0.smithi081.stdout: create 296/36 file after the snapshot 2023-10-25T23:37:42.309 INFO:tasks.workunit.client.0.smithi081.stdout: create 296/37 file after the snapshot 2023-10-25T23:37:42.310 INFO:tasks.workunit.client.0.smithi081.stdout: create 296/38 file after the snapshot 2023-10-25T23:37:42.311 INFO:tasks.workunit.client.0.smithi081.stdout: create 296/39 file after the snapshot 2023-10-25T23:37:42.312 INFO:tasks.workunit.client.0.smithi081.stdout: create 297/.snap/snap-subdir-test 2023-10-25T23:37:42.340 INFO:tasks.workunit.client.0.smithi081.stdout: create 297/30 file after the snapshot 2023-10-25T23:37:42.342 INFO:tasks.workunit.client.0.smithi081.stdout: create 297/31 file after the snapshot 2023-10-25T23:37:42.342 INFO:tasks.workunit.client.0.smithi081.stdout: create 297/32 file after the snapshot 2023-10-25T23:37:42.344 INFO:tasks.workunit.client.0.smithi081.stdout: create 297/33 file after the snapshot 2023-10-25T23:37:42.345 INFO:tasks.workunit.client.0.smithi081.stdout: create 297/34 file after the snapshot 2023-10-25T23:37:42.345 INFO:tasks.workunit.client.0.smithi081.stdout: create 297/35 file after the snapshot 2023-10-25T23:37:42.346 INFO:tasks.workunit.client.0.smithi081.stdout: create 297/36 file after the snapshot 2023-10-25T23:37:42.347 INFO:tasks.workunit.client.0.smithi081.stdout: create 297/37 file after the snapshot 2023-10-25T23:37:42.348 INFO:tasks.workunit.client.0.smithi081.stdout: create 297/38 file after the snapshot 2023-10-25T23:37:42.349 INFO:tasks.workunit.client.0.smithi081.stdout: create 297/39 file after the snapshot 2023-10-25T23:37:42.350 INFO:tasks.workunit.client.0.smithi081.stdout: create 298/.snap/snap-subdir-test 2023-10-25T23:37:42.377 INFO:tasks.workunit.client.0.smithi081.stdout: create 298/30 file after the snapshot 2023-10-25T23:37:42.378 INFO:tasks.workunit.client.0.smithi081.stdout: create 298/31 file after the snapshot 2023-10-25T23:37:42.379 INFO:tasks.workunit.client.0.smithi081.stdout: create 298/32 file after the snapshot 2023-10-25T23:37:42.380 INFO:tasks.workunit.client.0.smithi081.stdout: create 298/33 file after the snapshot 2023-10-25T23:37:42.381 INFO:tasks.workunit.client.0.smithi081.stdout: create 298/34 file after the snapshot 2023-10-25T23:37:42.382 INFO:tasks.workunit.client.0.smithi081.stdout: create 298/35 file after the snapshot 2023-10-25T23:37:42.383 INFO:tasks.workunit.client.0.smithi081.stdout: create 298/36 file after the snapshot 2023-10-25T23:37:42.384 INFO:tasks.workunit.client.0.smithi081.stdout: create 298/37 file after the snapshot 2023-10-25T23:37:42.384 INFO:tasks.workunit.client.0.smithi081.stdout: create 298/38 file after the snapshot 2023-10-25T23:37:42.385 INFO:tasks.workunit.client.0.smithi081.stdout: create 298/39 file after the snapshot 2023-10-25T23:37:42.386 INFO:tasks.workunit.client.0.smithi081.stdout: create 299/.snap/snap-subdir-test 2023-10-25T23:37:42.411 INFO:tasks.workunit.client.0.smithi081.stdout: create 299/30 file after the snapshot 2023-10-25T23:37:42.412 INFO:tasks.workunit.client.0.smithi081.stdout: create 299/31 file after the snapshot 2023-10-25T23:37:42.413 INFO:tasks.workunit.client.0.smithi081.stdout: create 299/32 file after the snapshot 2023-10-25T23:37:42.414 INFO:tasks.workunit.client.0.smithi081.stdout: create 299/33 file after the snapshot 2023-10-25T23:37:42.415 INFO:tasks.workunit.client.0.smithi081.stdout: create 299/34 file after the snapshot 2023-10-25T23:37:42.416 INFO:tasks.workunit.client.0.smithi081.stdout: create 299/35 file after the snapshot 2023-10-25T23:37:42.417 INFO:tasks.workunit.client.0.smithi081.stdout: create 299/36 file after the snapshot 2023-10-25T23:37:42.418 INFO:tasks.workunit.client.0.smithi081.stdout: create 299/37 file after the snapshot 2023-10-25T23:37:42.419 INFO:tasks.workunit.client.0.smithi081.stdout: create 299/38 file after the snapshot 2023-10-25T23:37:42.419 INFO:tasks.workunit.client.0.smithi081.stdout: create 299/39 file after the snapshot 2023-10-25T23:37:42.420 INFO:tasks.workunit.client.0.smithi081.stdout:Take second snapshot .snap/test2 2023-10-25T23:37:42.469 INFO:tasks.workunit.client.0.smithi081.stdout:Copy content of .snap/test1 to copyofsnap1 ... 2023-10-25T23:38:01.373 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1' -> 'copyofsnap1/test1' 2023-10-25T23:38:01.374 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/100' -> 'copyofsnap1/test1/100' 2023-10-25T23:38:01.374 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/100/10' -> 'copyofsnap1/test1/100/10' 2023-10-25T23:38:01.374 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/100/11' -> 'copyofsnap1/test1/100/11' 2023-10-25T23:38:01.374 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/100/12' -> 'copyofsnap1/test1/100/12' 2023-10-25T23:38:01.375 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/100/13' -> 'copyofsnap1/test1/100/13' 2023-10-25T23:38:01.375 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/100/14' -> 'copyofsnap1/test1/100/14' 2023-10-25T23:38:01.375 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/100/15' -> 'copyofsnap1/test1/100/15' 2023-10-25T23:38:01.375 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/100/16' -> 'copyofsnap1/test1/100/16' 2023-10-25T23:38:01.375 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/100/17' -> 'copyofsnap1/test1/100/17' 2023-10-25T23:38:01.376 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/100/18' -> 'copyofsnap1/test1/100/18' 2023-10-25T23:38:01.376 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/100/19' -> 'copyofsnap1/test1/100/19' 2023-10-25T23:38:01.376 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/100/20' -> 'copyofsnap1/test1/100/20' 2023-10-25T23:38:01.376 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/101' -> 'copyofsnap1/test1/101' 2023-10-25T23:38:01.376 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/101/10' -> 'copyofsnap1/test1/101/10' 2023-10-25T23:38:01.377 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/101/11' -> 'copyofsnap1/test1/101/11' 2023-10-25T23:38:01.377 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/101/12' -> 'copyofsnap1/test1/101/12' 2023-10-25T23:38:01.377 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/101/13' -> 'copyofsnap1/test1/101/13' 2023-10-25T23:38:01.377 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/101/14' -> 'copyofsnap1/test1/101/14' 2023-10-25T23:38:01.377 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/101/15' -> 'copyofsnap1/test1/101/15' 2023-10-25T23:38:01.377 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/101/16' -> 'copyofsnap1/test1/101/16' 2023-10-25T23:38:01.378 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/101/17' -> 'copyofsnap1/test1/101/17' 2023-10-25T23:38:01.378 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/101/18' -> 'copyofsnap1/test1/101/18' 2023-10-25T23:38:01.378 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/101/19' -> 'copyofsnap1/test1/101/19' 2023-10-25T23:38:01.378 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/101/20' -> 'copyofsnap1/test1/101/20' 2023-10-25T23:38:01.378 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/102' -> 'copyofsnap1/test1/102' 2023-10-25T23:38:01.379 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/102/10' -> 'copyofsnap1/test1/102/10' 2023-10-25T23:38:01.379 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/102/11' -> 'copyofsnap1/test1/102/11' 2023-10-25T23:38:01.379 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/102/12' -> 'copyofsnap1/test1/102/12' 2023-10-25T23:38:01.379 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/102/13' -> 'copyofsnap1/test1/102/13' 2023-10-25T23:38:01.379 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/102/14' -> 'copyofsnap1/test1/102/14' 2023-10-25T23:38:01.380 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/102/15' -> 'copyofsnap1/test1/102/15' 2023-10-25T23:38:01.380 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/102/16' -> 'copyofsnap1/test1/102/16' 2023-10-25T23:38:01.380 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/102/17' -> 'copyofsnap1/test1/102/17' 2023-10-25T23:38:01.380 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/102/18' -> 'copyofsnap1/test1/102/18' 2023-10-25T23:38:01.380 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/102/19' -> 'copyofsnap1/test1/102/19' 2023-10-25T23:38:01.380 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/102/20' -> 'copyofsnap1/test1/102/20' 2023-10-25T23:38:01.381 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/103' -> 'copyofsnap1/test1/103' 2023-10-25T23:38:01.381 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/103/10' -> 'copyofsnap1/test1/103/10' 2023-10-25T23:38:01.381 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/103/11' -> 'copyofsnap1/test1/103/11' 2023-10-25T23:38:01.381 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/103/12' -> 'copyofsnap1/test1/103/12' 2023-10-25T23:38:01.381 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/103/13' -> 'copyofsnap1/test1/103/13' 2023-10-25T23:38:01.382 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/103/14' -> 'copyofsnap1/test1/103/14' 2023-10-25T23:38:01.382 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/103/15' -> 'copyofsnap1/test1/103/15' 2023-10-25T23:38:01.382 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/103/16' -> 'copyofsnap1/test1/103/16' 2023-10-25T23:38:01.382 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/103/17' -> 'copyofsnap1/test1/103/17' 2023-10-25T23:38:01.382 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/103/18' -> 'copyofsnap1/test1/103/18' 2023-10-25T23:38:01.382 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/103/19' -> 'copyofsnap1/test1/103/19' 2023-10-25T23:38:01.383 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/103/20' -> 'copyofsnap1/test1/103/20' 2023-10-25T23:38:01.383 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/104' -> 'copyofsnap1/test1/104' 2023-10-25T23:38:01.383 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/104/10' -> 'copyofsnap1/test1/104/10' 2023-10-25T23:38:01.383 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/104/11' -> 'copyofsnap1/test1/104/11' 2023-10-25T23:38:01.383 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/104/12' -> 'copyofsnap1/test1/104/12' 2023-10-25T23:38:01.384 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/104/13' -> 'copyofsnap1/test1/104/13' 2023-10-25T23:38:01.384 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/104/14' -> 'copyofsnap1/test1/104/14' 2023-10-25T23:38:01.384 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/104/15' -> 'copyofsnap1/test1/104/15' 2023-10-25T23:38:01.384 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/104/16' -> 'copyofsnap1/test1/104/16' 2023-10-25T23:38:01.384 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/104/17' -> 'copyofsnap1/test1/104/17' 2023-10-25T23:38:01.385 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/104/18' -> 'copyofsnap1/test1/104/18' 2023-10-25T23:38:01.385 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/104/19' -> 'copyofsnap1/test1/104/19' 2023-10-25T23:38:01.385 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/104/20' -> 'copyofsnap1/test1/104/20' 2023-10-25T23:38:01.385 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/105' -> 'copyofsnap1/test1/105' 2023-10-25T23:38:01.385 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/105/10' -> 'copyofsnap1/test1/105/10' 2023-10-25T23:38:01.385 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/105/11' -> 'copyofsnap1/test1/105/11' 2023-10-25T23:38:01.386 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/105/12' -> 'copyofsnap1/test1/105/12' 2023-10-25T23:38:01.386 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/105/13' -> 'copyofsnap1/test1/105/13' 2023-10-25T23:38:01.386 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/105/14' -> 'copyofsnap1/test1/105/14' 2023-10-25T23:38:01.386 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/105/15' -> 'copyofsnap1/test1/105/15' 2023-10-25T23:38:01.386 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/105/16' -> 'copyofsnap1/test1/105/16' 2023-10-25T23:38:01.387 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/105/17' -> 'copyofsnap1/test1/105/17' 2023-10-25T23:38:01.387 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/105/18' -> 'copyofsnap1/test1/105/18' 2023-10-25T23:38:01.387 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/105/19' -> 'copyofsnap1/test1/105/19' 2023-10-25T23:38:01.387 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/105/20' -> 'copyofsnap1/test1/105/20' 2023-10-25T23:38:01.387 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/106' -> 'copyofsnap1/test1/106' 2023-10-25T23:38:01.388 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/106/10' -> 'copyofsnap1/test1/106/10' 2023-10-25T23:38:01.388 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/106/11' -> 'copyofsnap1/test1/106/11' 2023-10-25T23:38:01.388 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/106/12' -> 'copyofsnap1/test1/106/12' 2023-10-25T23:38:01.388 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/106/13' -> 'copyofsnap1/test1/106/13' 2023-10-25T23:38:01.388 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/106/14' -> 'copyofsnap1/test1/106/14' 2023-10-25T23:38:01.388 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/106/15' -> 'copyofsnap1/test1/106/15' 2023-10-25T23:38:01.389 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/106/16' -> 'copyofsnap1/test1/106/16' 2023-10-25T23:38:01.519 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/106/17' -> 'copyofsnap1/test1/106/17' 2023-10-25T23:38:01.520 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/106/18' -> 'copyofsnap1/test1/106/18' 2023-10-25T23:38:01.520 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/106/19' -> 'copyofsnap1/test1/106/19' 2023-10-25T23:38:01.520 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/106/20' -> 'copyofsnap1/test1/106/20' 2023-10-25T23:38:01.520 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/107' -> 'copyofsnap1/test1/107' 2023-10-25T23:38:01.521 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/107/10' -> 'copyofsnap1/test1/107/10' 2023-10-25T23:38:01.521 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/107/11' -> 'copyofsnap1/test1/107/11' 2023-10-25T23:38:01.521 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/107/12' -> 'copyofsnap1/test1/107/12' 2023-10-25T23:38:01.521 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/107/13' -> 'copyofsnap1/test1/107/13' 2023-10-25T23:38:01.521 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/107/14' -> 'copyofsnap1/test1/107/14' 2023-10-25T23:38:01.522 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/107/15' -> 'copyofsnap1/test1/107/15' 2023-10-25T23:38:01.522 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/107/16' -> 'copyofsnap1/test1/107/16' 2023-10-25T23:38:01.522 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/107/17' -> 'copyofsnap1/test1/107/17' 2023-10-25T23:38:01.522 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/107/18' -> 'copyofsnap1/test1/107/18' 2023-10-25T23:38:01.523 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/107/19' -> 'copyofsnap1/test1/107/19' 2023-10-25T23:38:01.523 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/107/20' -> 'copyofsnap1/test1/107/20' 2023-10-25T23:38:01.523 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/108' -> 'copyofsnap1/test1/108' 2023-10-25T23:38:01.523 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/108/10' -> 'copyofsnap1/test1/108/10' 2023-10-25T23:38:01.523 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/108/11' -> 'copyofsnap1/test1/108/11' 2023-10-25T23:38:01.524 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/108/12' -> 'copyofsnap1/test1/108/12' 2023-10-25T23:38:01.524 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/108/13' -> 'copyofsnap1/test1/108/13' 2023-10-25T23:38:01.524 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/108/14' -> 'copyofsnap1/test1/108/14' 2023-10-25T23:38:01.524 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/108/15' -> 'copyofsnap1/test1/108/15' 2023-10-25T23:38:01.525 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/108/16' -> 'copyofsnap1/test1/108/16' 2023-10-25T23:38:01.525 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/108/17' -> 'copyofsnap1/test1/108/17' 2023-10-25T23:38:01.525 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/108/18' -> 'copyofsnap1/test1/108/18' 2023-10-25T23:38:01.525 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/108/19' -> 'copyofsnap1/test1/108/19' 2023-10-25T23:38:01.526 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/108/20' -> 'copyofsnap1/test1/108/20' 2023-10-25T23:38:01.526 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/109' -> 'copyofsnap1/test1/109' 2023-10-25T23:38:01.526 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/109/10' -> 'copyofsnap1/test1/109/10' 2023-10-25T23:38:01.526 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/109/11' -> 'copyofsnap1/test1/109/11' 2023-10-25T23:38:01.527 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/109/12' -> 'copyofsnap1/test1/109/12' 2023-10-25T23:38:01.527 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/109/13' -> 'copyofsnap1/test1/109/13' 2023-10-25T23:38:01.527 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/109/14' -> 'copyofsnap1/test1/109/14' 2023-10-25T23:38:01.527 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/109/15' -> 'copyofsnap1/test1/109/15' 2023-10-25T23:38:01.527 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/109/16' -> 'copyofsnap1/test1/109/16' 2023-10-25T23:38:01.528 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/109/17' -> 'copyofsnap1/test1/109/17' 2023-10-25T23:38:01.528 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/109/18' -> 'copyofsnap1/test1/109/18' 2023-10-25T23:38:01.528 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/109/19' -> 'copyofsnap1/test1/109/19' 2023-10-25T23:38:01.528 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/109/20' -> 'copyofsnap1/test1/109/20' 2023-10-25T23:38:01.529 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/110' -> 'copyofsnap1/test1/110' 2023-10-25T23:38:01.529 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/110/10' -> 'copyofsnap1/test1/110/10' 2023-10-25T23:38:01.529 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/110/11' -> 'copyofsnap1/test1/110/11' 2023-10-25T23:38:01.529 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/110/12' -> 'copyofsnap1/test1/110/12' 2023-10-25T23:38:01.529 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/110/13' -> 'copyofsnap1/test1/110/13' 2023-10-25T23:38:01.530 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/110/14' -> 'copyofsnap1/test1/110/14' 2023-10-25T23:38:01.530 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/110/15' -> 'copyofsnap1/test1/110/15' 2023-10-25T23:38:01.530 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/110/16' -> 'copyofsnap1/test1/110/16' 2023-10-25T23:38:01.530 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/110/17' -> 'copyofsnap1/test1/110/17' 2023-10-25T23:38:01.530 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/110/18' -> 'copyofsnap1/test1/110/18' 2023-10-25T23:38:01.531 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/110/19' -> 'copyofsnap1/test1/110/19' 2023-10-25T23:38:01.531 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/110/20' -> 'copyofsnap1/test1/110/20' 2023-10-25T23:38:01.531 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/111' -> 'copyofsnap1/test1/111' 2023-10-25T23:38:01.531 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/111/10' -> 'copyofsnap1/test1/111/10' 2023-10-25T23:38:01.532 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/111/11' -> 'copyofsnap1/test1/111/11' 2023-10-25T23:38:01.532 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/111/12' -> 'copyofsnap1/test1/111/12' 2023-10-25T23:38:01.532 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/111/13' -> 'copyofsnap1/test1/111/13' 2023-10-25T23:38:01.532 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/111/14' -> 'copyofsnap1/test1/111/14' 2023-10-25T23:38:01.532 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/111/15' -> 'copyofsnap1/test1/111/15' 2023-10-25T23:38:01.533 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/111/16' -> 'copyofsnap1/test1/111/16' 2023-10-25T23:38:01.533 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/111/17' -> 'copyofsnap1/test1/111/17' 2023-10-25T23:38:01.533 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/111/18' -> 'copyofsnap1/test1/111/18' 2023-10-25T23:38:01.533 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/111/19' -> 'copyofsnap1/test1/111/19' 2023-10-25T23:38:01.533 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/111/20' -> 'copyofsnap1/test1/111/20' 2023-10-25T23:38:01.533 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/112' -> 'copyofsnap1/test1/112' 2023-10-25T23:38:01.534 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/112/10' -> 'copyofsnap1/test1/112/10' 2023-10-25T23:38:01.534 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/112/11' -> 'copyofsnap1/test1/112/11' 2023-10-25T23:38:01.534 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/112/12' -> 'copyofsnap1/test1/112/12' 2023-10-25T23:38:01.534 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/112/13' -> 'copyofsnap1/test1/112/13' 2023-10-25T23:38:01.534 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/112/14' -> 'copyofsnap1/test1/112/14' 2023-10-25T23:38:01.535 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/112/15' -> 'copyofsnap1/test1/112/15' 2023-10-25T23:38:01.535 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/112/16' -> 'copyofsnap1/test1/112/16' 2023-10-25T23:38:01.535 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/112/17' -> 'copyofsnap1/test1/112/17' 2023-10-25T23:38:01.535 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/112/18' -> 'copyofsnap1/test1/112/18' 2023-10-25T23:38:01.536 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/112/19' -> 'copyofsnap1/test1/112/19' 2023-10-25T23:38:01.536 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/112/20' -> 'copyofsnap1/test1/112/20' 2023-10-25T23:38:01.536 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/113' -> 'copyofsnap1/test1/113' 2023-10-25T23:38:01.536 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/113/10' -> 'copyofsnap1/test1/113/10' 2023-10-25T23:38:01.536 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/113/11' -> 'copyofsnap1/test1/113/11' 2023-10-25T23:38:01.537 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/113/12' -> 'copyofsnap1/test1/113/12' 2023-10-25T23:38:01.537 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/113/13' -> 'copyofsnap1/test1/113/13' 2023-10-25T23:38:01.660 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/113/14' -> 'copyofsnap1/test1/113/14' 2023-10-25T23:38:01.661 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/113/15' -> 'copyofsnap1/test1/113/15' 2023-10-25T23:38:01.661 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/113/16' -> 'copyofsnap1/test1/113/16' 2023-10-25T23:38:01.661 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/113/17' -> 'copyofsnap1/test1/113/17' 2023-10-25T23:38:01.661 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/113/18' -> 'copyofsnap1/test1/113/18' 2023-10-25T23:38:01.662 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/113/19' -> 'copyofsnap1/test1/113/19' 2023-10-25T23:38:01.662 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/113/20' -> 'copyofsnap1/test1/113/20' 2023-10-25T23:38:01.662 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/114' -> 'copyofsnap1/test1/114' 2023-10-25T23:38:01.662 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/114/10' -> 'copyofsnap1/test1/114/10' 2023-10-25T23:38:01.662 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/114/11' -> 'copyofsnap1/test1/114/11' 2023-10-25T23:38:01.663 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/114/12' -> 'copyofsnap1/test1/114/12' 2023-10-25T23:38:01.663 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/114/13' -> 'copyofsnap1/test1/114/13' 2023-10-25T23:38:01.663 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/114/14' -> 'copyofsnap1/test1/114/14' 2023-10-25T23:38:01.663 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/114/15' -> 'copyofsnap1/test1/114/15' 2023-10-25T23:38:01.663 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/114/16' -> 'copyofsnap1/test1/114/16' 2023-10-25T23:38:01.664 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/114/17' -> 'copyofsnap1/test1/114/17' 2023-10-25T23:38:01.664 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/114/18' -> 'copyofsnap1/test1/114/18' 2023-10-25T23:38:01.664 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/114/19' -> 'copyofsnap1/test1/114/19' 2023-10-25T23:38:01.664 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/114/20' -> 'copyofsnap1/test1/114/20' 2023-10-25T23:38:01.664 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/115' -> 'copyofsnap1/test1/115' 2023-10-25T23:38:01.665 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/115/10' -> 'copyofsnap1/test1/115/10' 2023-10-25T23:38:01.665 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/115/11' -> 'copyofsnap1/test1/115/11' 2023-10-25T23:38:01.665 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/115/12' -> 'copyofsnap1/test1/115/12' 2023-10-25T23:38:01.665 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/115/13' -> 'copyofsnap1/test1/115/13' 2023-10-25T23:38:01.665 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/115/14' -> 'copyofsnap1/test1/115/14' 2023-10-25T23:38:01.666 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/115/15' -> 'copyofsnap1/test1/115/15' 2023-10-25T23:38:01.666 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/115/16' -> 'copyofsnap1/test1/115/16' 2023-10-25T23:38:01.666 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/115/17' -> 'copyofsnap1/test1/115/17' 2023-10-25T23:38:01.666 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/115/18' -> 'copyofsnap1/test1/115/18' 2023-10-25T23:38:01.666 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/115/19' -> 'copyofsnap1/test1/115/19' 2023-10-25T23:38:01.667 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/115/20' -> 'copyofsnap1/test1/115/20' 2023-10-25T23:38:01.667 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/116' -> 'copyofsnap1/test1/116' 2023-10-25T23:38:01.667 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/116/10' -> 'copyofsnap1/test1/116/10' 2023-10-25T23:38:01.668 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/116/11' -> 'copyofsnap1/test1/116/11' 2023-10-25T23:38:01.668 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/116/12' -> 'copyofsnap1/test1/116/12' 2023-10-25T23:38:01.668 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/116/13' -> 'copyofsnap1/test1/116/13' 2023-10-25T23:38:01.668 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/116/14' -> 'copyofsnap1/test1/116/14' 2023-10-25T23:38:01.668 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/116/15' -> 'copyofsnap1/test1/116/15' 2023-10-25T23:38:01.669 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/116/16' -> 'copyofsnap1/test1/116/16' 2023-10-25T23:38:01.669 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/116/17' -> 'copyofsnap1/test1/116/17' 2023-10-25T23:38:01.669 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/116/18' -> 'copyofsnap1/test1/116/18' 2023-10-25T23:38:01.669 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/116/19' -> 'copyofsnap1/test1/116/19' 2023-10-25T23:38:01.669 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/116/20' -> 'copyofsnap1/test1/116/20' 2023-10-25T23:38:01.670 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/117' -> 'copyofsnap1/test1/117' 2023-10-25T23:38:01.670 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/117/10' -> 'copyofsnap1/test1/117/10' 2023-10-25T23:38:01.670 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/117/11' -> 'copyofsnap1/test1/117/11' 2023-10-25T23:38:01.670 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/117/12' -> 'copyofsnap1/test1/117/12' 2023-10-25T23:38:01.670 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/117/13' -> 'copyofsnap1/test1/117/13' 2023-10-25T23:38:01.671 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/117/14' -> 'copyofsnap1/test1/117/14' 2023-10-25T23:38:01.671 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/117/15' -> 'copyofsnap1/test1/117/15' 2023-10-25T23:38:01.671 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/117/16' -> 'copyofsnap1/test1/117/16' 2023-10-25T23:38:01.671 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/117/17' -> 'copyofsnap1/test1/117/17' 2023-10-25T23:38:01.671 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/117/18' -> 'copyofsnap1/test1/117/18' 2023-10-25T23:38:01.672 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/117/19' -> 'copyofsnap1/test1/117/19' 2023-10-25T23:38:01.672 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/117/20' -> 'copyofsnap1/test1/117/20' 2023-10-25T23:38:01.672 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/118' -> 'copyofsnap1/test1/118' 2023-10-25T23:38:01.672 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/118/10' -> 'copyofsnap1/test1/118/10' 2023-10-25T23:38:01.672 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/118/11' -> 'copyofsnap1/test1/118/11' 2023-10-25T23:38:01.673 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/118/12' -> 'copyofsnap1/test1/118/12' 2023-10-25T23:38:01.673 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/118/13' -> 'copyofsnap1/test1/118/13' 2023-10-25T23:38:01.673 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/118/14' -> 'copyofsnap1/test1/118/14' 2023-10-25T23:38:01.673 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/118/15' -> 'copyofsnap1/test1/118/15' 2023-10-25T23:38:01.673 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/118/16' -> 'copyofsnap1/test1/118/16' 2023-10-25T23:38:01.673 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/118/17' -> 'copyofsnap1/test1/118/17' 2023-10-25T23:38:01.674 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/118/18' -> 'copyofsnap1/test1/118/18' 2023-10-25T23:38:01.674 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/118/19' -> 'copyofsnap1/test1/118/19' 2023-10-25T23:38:01.674 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/118/20' -> 'copyofsnap1/test1/118/20' 2023-10-25T23:38:01.674 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/119' -> 'copyofsnap1/test1/119' 2023-10-25T23:38:01.674 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/119/10' -> 'copyofsnap1/test1/119/10' 2023-10-25T23:38:01.675 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/119/11' -> 'copyofsnap1/test1/119/11' 2023-10-25T23:38:01.675 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/119/12' -> 'copyofsnap1/test1/119/12' 2023-10-25T23:38:01.675 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/119/13' -> 'copyofsnap1/test1/119/13' 2023-10-25T23:38:01.675 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/119/14' -> 'copyofsnap1/test1/119/14' 2023-10-25T23:38:01.675 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/119/15' -> 'copyofsnap1/test1/119/15' 2023-10-25T23:38:01.676 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/119/16' -> 'copyofsnap1/test1/119/16' 2023-10-25T23:38:01.676 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/119/17' -> 'copyofsnap1/test1/119/17' 2023-10-25T23:38:01.676 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/119/18' -> 'copyofsnap1/test1/119/18' 2023-10-25T23:38:01.676 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/119/19' -> 'copyofsnap1/test1/119/19' 2023-10-25T23:38:01.676 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/119/20' -> 'copyofsnap1/test1/119/20' 2023-10-25T23:38:01.676 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/120' -> 'copyofsnap1/test1/120' 2023-10-25T23:38:01.677 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/120/10' -> 'copyofsnap1/test1/120/10' 2023-10-25T23:38:01.791 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/120/11' -> 'copyofsnap1/test1/120/11' 2023-10-25T23:38:01.792 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/120/12' -> 'copyofsnap1/test1/120/12' 2023-10-25T23:38:01.792 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/120/13' -> 'copyofsnap1/test1/120/13' 2023-10-25T23:38:01.792 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/120/14' -> 'copyofsnap1/test1/120/14' 2023-10-25T23:38:01.792 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/120/15' -> 'copyofsnap1/test1/120/15' 2023-10-25T23:38:01.792 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/120/16' -> 'copyofsnap1/test1/120/16' 2023-10-25T23:38:01.793 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/120/17' -> 'copyofsnap1/test1/120/17' 2023-10-25T23:38:01.793 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/120/18' -> 'copyofsnap1/test1/120/18' 2023-10-25T23:38:01.793 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/120/19' -> 'copyofsnap1/test1/120/19' 2023-10-25T23:38:01.793 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/120/20' -> 'copyofsnap1/test1/120/20' 2023-10-25T23:38:01.793 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/121' -> 'copyofsnap1/test1/121' 2023-10-25T23:38:01.794 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/121/10' -> 'copyofsnap1/test1/121/10' 2023-10-25T23:38:01.794 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/121/11' -> 'copyofsnap1/test1/121/11' 2023-10-25T23:38:01.794 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/121/12' -> 'copyofsnap1/test1/121/12' 2023-10-25T23:38:01.794 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/121/13' -> 'copyofsnap1/test1/121/13' 2023-10-25T23:38:01.794 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/121/14' -> 'copyofsnap1/test1/121/14' 2023-10-25T23:38:01.795 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/121/15' -> 'copyofsnap1/test1/121/15' 2023-10-25T23:38:01.795 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/121/16' -> 'copyofsnap1/test1/121/16' 2023-10-25T23:38:01.795 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/121/17' -> 'copyofsnap1/test1/121/17' 2023-10-25T23:38:01.795 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/121/18' -> 'copyofsnap1/test1/121/18' 2023-10-25T23:38:01.795 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/121/19' -> 'copyofsnap1/test1/121/19' 2023-10-25T23:38:01.796 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/121/20' -> 'copyofsnap1/test1/121/20' 2023-10-25T23:38:01.796 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/122' -> 'copyofsnap1/test1/122' 2023-10-25T23:38:01.796 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/122/10' -> 'copyofsnap1/test1/122/10' 2023-10-25T23:38:01.796 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/122/11' -> 'copyofsnap1/test1/122/11' 2023-10-25T23:38:01.796 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/122/12' -> 'copyofsnap1/test1/122/12' 2023-10-25T23:38:01.796 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/122/13' -> 'copyofsnap1/test1/122/13' 2023-10-25T23:38:01.797 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/122/14' -> 'copyofsnap1/test1/122/14' 2023-10-25T23:38:01.797 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/122/15' -> 'copyofsnap1/test1/122/15' 2023-10-25T23:38:01.797 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/122/16' -> 'copyofsnap1/test1/122/16' 2023-10-25T23:38:01.797 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/122/17' -> 'copyofsnap1/test1/122/17' 2023-10-25T23:38:01.797 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/122/18' -> 'copyofsnap1/test1/122/18' 2023-10-25T23:38:01.798 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/122/19' -> 'copyofsnap1/test1/122/19' 2023-10-25T23:38:01.798 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/122/20' -> 'copyofsnap1/test1/122/20' 2023-10-25T23:38:01.798 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/123' -> 'copyofsnap1/test1/123' 2023-10-25T23:38:01.798 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/123/10' -> 'copyofsnap1/test1/123/10' 2023-10-25T23:38:01.798 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/123/11' -> 'copyofsnap1/test1/123/11' 2023-10-25T23:38:01.799 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/123/12' -> 'copyofsnap1/test1/123/12' 2023-10-25T23:38:01.799 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/123/13' -> 'copyofsnap1/test1/123/13' 2023-10-25T23:38:01.799 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/123/14' -> 'copyofsnap1/test1/123/14' 2023-10-25T23:38:01.799 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/123/15' -> 'copyofsnap1/test1/123/15' 2023-10-25T23:38:01.799 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/123/16' -> 'copyofsnap1/test1/123/16' 2023-10-25T23:38:01.800 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/123/17' -> 'copyofsnap1/test1/123/17' 2023-10-25T23:38:01.800 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/123/18' -> 'copyofsnap1/test1/123/18' 2023-10-25T23:38:01.800 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/123/19' -> 'copyofsnap1/test1/123/19' 2023-10-25T23:38:01.800 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/123/20' -> 'copyofsnap1/test1/123/20' 2023-10-25T23:38:01.800 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/124' -> 'copyofsnap1/test1/124' 2023-10-25T23:38:01.801 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/124/10' -> 'copyofsnap1/test1/124/10' 2023-10-25T23:38:01.801 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/124/11' -> 'copyofsnap1/test1/124/11' 2023-10-25T23:38:01.801 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/124/12' -> 'copyofsnap1/test1/124/12' 2023-10-25T23:38:01.801 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/124/13' -> 'copyofsnap1/test1/124/13' 2023-10-25T23:38:01.801 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/124/14' -> 'copyofsnap1/test1/124/14' 2023-10-25T23:38:01.802 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/124/15' -> 'copyofsnap1/test1/124/15' 2023-10-25T23:38:01.802 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/124/16' -> 'copyofsnap1/test1/124/16' 2023-10-25T23:38:01.802 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/124/17' -> 'copyofsnap1/test1/124/17' 2023-10-25T23:38:01.802 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/124/18' -> 'copyofsnap1/test1/124/18' 2023-10-25T23:38:01.802 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/124/19' -> 'copyofsnap1/test1/124/19' 2023-10-25T23:38:01.802 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/124/20' -> 'copyofsnap1/test1/124/20' 2023-10-25T23:38:01.803 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/125' -> 'copyofsnap1/test1/125' 2023-10-25T23:38:01.803 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/125/10' -> 'copyofsnap1/test1/125/10' 2023-10-25T23:38:01.803 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/125/11' -> 'copyofsnap1/test1/125/11' 2023-10-25T23:38:01.803 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/125/12' -> 'copyofsnap1/test1/125/12' 2023-10-25T23:38:01.803 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/125/13' -> 'copyofsnap1/test1/125/13' 2023-10-25T23:38:01.804 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/125/14' -> 'copyofsnap1/test1/125/14' 2023-10-25T23:38:01.804 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/125/15' -> 'copyofsnap1/test1/125/15' 2023-10-25T23:38:01.804 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/125/16' -> 'copyofsnap1/test1/125/16' 2023-10-25T23:38:01.804 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/125/17' -> 'copyofsnap1/test1/125/17' 2023-10-25T23:38:01.804 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/125/18' -> 'copyofsnap1/test1/125/18' 2023-10-25T23:38:01.805 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/125/19' -> 'copyofsnap1/test1/125/19' 2023-10-25T23:38:01.805 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/125/20' -> 'copyofsnap1/test1/125/20' 2023-10-25T23:38:01.805 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/126' -> 'copyofsnap1/test1/126' 2023-10-25T23:38:01.805 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/126/10' -> 'copyofsnap1/test1/126/10' 2023-10-25T23:38:01.805 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/126/11' -> 'copyofsnap1/test1/126/11' 2023-10-25T23:38:01.806 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/126/12' -> 'copyofsnap1/test1/126/12' 2023-10-25T23:38:01.806 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/126/13' -> 'copyofsnap1/test1/126/13' 2023-10-25T23:38:01.806 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/126/14' -> 'copyofsnap1/test1/126/14' 2023-10-25T23:38:01.806 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/126/15' -> 'copyofsnap1/test1/126/15' 2023-10-25T23:38:01.806 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/126/16' -> 'copyofsnap1/test1/126/16' 2023-10-25T23:38:01.807 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/126/17' -> 'copyofsnap1/test1/126/17' 2023-10-25T23:38:01.807 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/126/18' -> 'copyofsnap1/test1/126/18' 2023-10-25T23:38:01.807 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/126/19' -> 'copyofsnap1/test1/126/19' 2023-10-25T23:38:01.944 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/126/20' -> 'copyofsnap1/test1/126/20' 2023-10-25T23:38:01.944 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/127' -> 'copyofsnap1/test1/127' 2023-10-25T23:38:01.944 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/127/10' -> 'copyofsnap1/test1/127/10' 2023-10-25T23:38:01.944 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/127/11' -> 'copyofsnap1/test1/127/11' 2023-10-25T23:38:01.945 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/127/12' -> 'copyofsnap1/test1/127/12' 2023-10-25T23:38:01.945 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/127/13' -> 'copyofsnap1/test1/127/13' 2023-10-25T23:38:01.945 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/127/14' -> 'copyofsnap1/test1/127/14' 2023-10-25T23:38:01.945 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/127/15' -> 'copyofsnap1/test1/127/15' 2023-10-25T23:38:01.945 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/127/16' -> 'copyofsnap1/test1/127/16' 2023-10-25T23:38:01.946 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/127/17' -> 'copyofsnap1/test1/127/17' 2023-10-25T23:38:01.946 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/127/18' -> 'copyofsnap1/test1/127/18' 2023-10-25T23:38:01.946 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/127/19' -> 'copyofsnap1/test1/127/19' 2023-10-25T23:38:01.946 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/127/20' -> 'copyofsnap1/test1/127/20' 2023-10-25T23:38:01.946 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/128' -> 'copyofsnap1/test1/128' 2023-10-25T23:38:01.946 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/128/10' -> 'copyofsnap1/test1/128/10' 2023-10-25T23:38:01.947 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/128/11' -> 'copyofsnap1/test1/128/11' 2023-10-25T23:38:01.947 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/128/12' -> 'copyofsnap1/test1/128/12' 2023-10-25T23:38:01.947 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/128/13' -> 'copyofsnap1/test1/128/13' 2023-10-25T23:38:01.947 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/128/14' -> 'copyofsnap1/test1/128/14' 2023-10-25T23:38:01.947 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/128/15' -> 'copyofsnap1/test1/128/15' 2023-10-25T23:38:01.948 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/128/16' -> 'copyofsnap1/test1/128/16' 2023-10-25T23:38:01.948 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/128/17' -> 'copyofsnap1/test1/128/17' 2023-10-25T23:38:01.948 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/128/18' -> 'copyofsnap1/test1/128/18' 2023-10-25T23:38:01.948 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/128/19' -> 'copyofsnap1/test1/128/19' 2023-10-25T23:38:01.949 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/128/20' -> 'copyofsnap1/test1/128/20' 2023-10-25T23:38:01.950 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/129' -> 'copyofsnap1/test1/129' 2023-10-25T23:38:01.950 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/129/10' -> 'copyofsnap1/test1/129/10' 2023-10-25T23:38:01.950 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/129/11' -> 'copyofsnap1/test1/129/11' 2023-10-25T23:38:01.950 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/129/12' -> 'copyofsnap1/test1/129/12' 2023-10-25T23:38:01.951 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/129/13' -> 'copyofsnap1/test1/129/13' 2023-10-25T23:38:01.953 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/129/14' -> 'copyofsnap1/test1/129/14' 2023-10-25T23:38:01.953 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/129/15' -> 'copyofsnap1/test1/129/15' 2023-10-25T23:38:01.954 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/129/16' -> 'copyofsnap1/test1/129/16' 2023-10-25T23:38:01.954 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/129/17' -> 'copyofsnap1/test1/129/17' 2023-10-25T23:38:01.954 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/129/18' -> 'copyofsnap1/test1/129/18' 2023-10-25T23:38:01.954 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/129/19' -> 'copyofsnap1/test1/129/19' 2023-10-25T23:38:01.954 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/129/20' -> 'copyofsnap1/test1/129/20' 2023-10-25T23:38:01.955 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/130' -> 'copyofsnap1/test1/130' 2023-10-25T23:38:01.955 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/130/10' -> 'copyofsnap1/test1/130/10' 2023-10-25T23:38:01.955 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/130/11' -> 'copyofsnap1/test1/130/11' 2023-10-25T23:38:01.955 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/130/12' -> 'copyofsnap1/test1/130/12' 2023-10-25T23:38:01.955 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/130/13' -> 'copyofsnap1/test1/130/13' 2023-10-25T23:38:01.956 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/130/14' -> 'copyofsnap1/test1/130/14' 2023-10-25T23:38:01.956 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/130/15' -> 'copyofsnap1/test1/130/15' 2023-10-25T23:38:01.956 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/130/16' -> 'copyofsnap1/test1/130/16' 2023-10-25T23:38:01.956 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/130/17' -> 'copyofsnap1/test1/130/17' 2023-10-25T23:38:01.956 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/130/18' -> 'copyofsnap1/test1/130/18' 2023-10-25T23:38:01.957 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/130/19' -> 'copyofsnap1/test1/130/19' 2023-10-25T23:38:01.957 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/130/20' -> 'copyofsnap1/test1/130/20' 2023-10-25T23:38:01.957 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/131' -> 'copyofsnap1/test1/131' 2023-10-25T23:38:01.957 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/131/10' -> 'copyofsnap1/test1/131/10' 2023-10-25T23:38:01.957 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/131/11' -> 'copyofsnap1/test1/131/11' 2023-10-25T23:38:01.958 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/131/12' -> 'copyofsnap1/test1/131/12' 2023-10-25T23:38:01.958 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/131/13' -> 'copyofsnap1/test1/131/13' 2023-10-25T23:38:01.958 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/131/14' -> 'copyofsnap1/test1/131/14' 2023-10-25T23:38:01.958 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/131/15' -> 'copyofsnap1/test1/131/15' 2023-10-25T23:38:01.959 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/131/16' -> 'copyofsnap1/test1/131/16' 2023-10-25T23:38:01.959 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/131/17' -> 'copyofsnap1/test1/131/17' 2023-10-25T23:38:01.959 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/131/18' -> 'copyofsnap1/test1/131/18' 2023-10-25T23:38:01.959 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/131/19' -> 'copyofsnap1/test1/131/19' 2023-10-25T23:38:01.959 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/131/20' -> 'copyofsnap1/test1/131/20' 2023-10-25T23:38:01.960 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/132' -> 'copyofsnap1/test1/132' 2023-10-25T23:38:01.960 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/132/10' -> 'copyofsnap1/test1/132/10' 2023-10-25T23:38:01.961 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/132/11' -> 'copyofsnap1/test1/132/11' 2023-10-25T23:38:01.961 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/132/12' -> 'copyofsnap1/test1/132/12' 2023-10-25T23:38:01.962 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/132/13' -> 'copyofsnap1/test1/132/13' 2023-10-25T23:38:01.962 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/132/14' -> 'copyofsnap1/test1/132/14' 2023-10-25T23:38:01.962 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/132/15' -> 'copyofsnap1/test1/132/15' 2023-10-25T23:38:01.962 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/132/16' -> 'copyofsnap1/test1/132/16' 2023-10-25T23:38:01.962 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/132/17' -> 'copyofsnap1/test1/132/17' 2023-10-25T23:38:01.963 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/132/18' -> 'copyofsnap1/test1/132/18' 2023-10-25T23:38:01.963 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/132/19' -> 'copyofsnap1/test1/132/19' 2023-10-25T23:38:01.963 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/132/20' -> 'copyofsnap1/test1/132/20' 2023-10-25T23:38:01.963 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/133' -> 'copyofsnap1/test1/133' 2023-10-25T23:38:01.963 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/133/10' -> 'copyofsnap1/test1/133/10' 2023-10-25T23:38:01.964 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/133/11' -> 'copyofsnap1/test1/133/11' 2023-10-25T23:38:01.964 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/133/12' -> 'copyofsnap1/test1/133/12' 2023-10-25T23:38:01.964 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/133/13' -> 'copyofsnap1/test1/133/13' 2023-10-25T23:38:01.964 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/133/14' -> 'copyofsnap1/test1/133/14' 2023-10-25T23:38:01.964 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/133/15' -> 'copyofsnap1/test1/133/15' 2023-10-25T23:38:01.965 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/133/16' -> 'copyofsnap1/test1/133/16' 2023-10-25T23:38:02.107 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/133/17' -> 'copyofsnap1/test1/133/17' 2023-10-25T23:38:02.107 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/133/18' -> 'copyofsnap1/test1/133/18' 2023-10-25T23:38:02.107 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/133/19' -> 'copyofsnap1/test1/133/19' 2023-10-25T23:38:02.107 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/133/20' -> 'copyofsnap1/test1/133/20' 2023-10-25T23:38:02.108 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/134' -> 'copyofsnap1/test1/134' 2023-10-25T23:38:02.108 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/134/10' -> 'copyofsnap1/test1/134/10' 2023-10-25T23:38:02.108 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/134/11' -> 'copyofsnap1/test1/134/11' 2023-10-25T23:38:02.108 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/134/12' -> 'copyofsnap1/test1/134/12' 2023-10-25T23:38:02.108 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/134/13' -> 'copyofsnap1/test1/134/13' 2023-10-25T23:38:02.109 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/134/14' -> 'copyofsnap1/test1/134/14' 2023-10-25T23:38:02.109 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/134/15' -> 'copyofsnap1/test1/134/15' 2023-10-25T23:38:02.109 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/134/16' -> 'copyofsnap1/test1/134/16' 2023-10-25T23:38:02.109 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/134/17' -> 'copyofsnap1/test1/134/17' 2023-10-25T23:38:02.109 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/134/18' -> 'copyofsnap1/test1/134/18' 2023-10-25T23:38:02.110 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/134/19' -> 'copyofsnap1/test1/134/19' 2023-10-25T23:38:02.110 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/134/20' -> 'copyofsnap1/test1/134/20' 2023-10-25T23:38:02.111 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/135' -> 'copyofsnap1/test1/135' 2023-10-25T23:38:02.112 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/135/10' -> 'copyofsnap1/test1/135/10' 2023-10-25T23:38:02.112 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/135/11' -> 'copyofsnap1/test1/135/11' 2023-10-25T23:38:02.112 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/135/12' -> 'copyofsnap1/test1/135/12' 2023-10-25T23:38:02.113 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/135/13' -> 'copyofsnap1/test1/135/13' 2023-10-25T23:38:02.113 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/135/14' -> 'copyofsnap1/test1/135/14' 2023-10-25T23:38:02.113 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/135/15' -> 'copyofsnap1/test1/135/15' 2023-10-25T23:38:02.114 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/135/16' -> 'copyofsnap1/test1/135/16' 2023-10-25T23:38:02.114 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/135/17' -> 'copyofsnap1/test1/135/17' 2023-10-25T23:38:02.114 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/135/18' -> 'copyofsnap1/test1/135/18' 2023-10-25T23:38:02.115 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/135/19' -> 'copyofsnap1/test1/135/19' 2023-10-25T23:38:02.115 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/135/20' -> 'copyofsnap1/test1/135/20' 2023-10-25T23:38:02.115 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/136' -> 'copyofsnap1/test1/136' 2023-10-25T23:38:02.116 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/136/10' -> 'copyofsnap1/test1/136/10' 2023-10-25T23:38:02.116 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/136/11' -> 'copyofsnap1/test1/136/11' 2023-10-25T23:38:02.116 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/136/12' -> 'copyofsnap1/test1/136/12' 2023-10-25T23:38:02.117 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/136/13' -> 'copyofsnap1/test1/136/13' 2023-10-25T23:38:02.117 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/136/14' -> 'copyofsnap1/test1/136/14' 2023-10-25T23:38:02.118 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/136/15' -> 'copyofsnap1/test1/136/15' 2023-10-25T23:38:02.118 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/136/16' -> 'copyofsnap1/test1/136/16' 2023-10-25T23:38:02.118 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/136/17' -> 'copyofsnap1/test1/136/17' 2023-10-25T23:38:02.118 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/136/18' -> 'copyofsnap1/test1/136/18' 2023-10-25T23:38:02.118 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/136/19' -> 'copyofsnap1/test1/136/19' 2023-10-25T23:38:02.119 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/136/20' -> 'copyofsnap1/test1/136/20' 2023-10-25T23:38:02.119 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/137' -> 'copyofsnap1/test1/137' 2023-10-25T23:38:02.119 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/137/10' -> 'copyofsnap1/test1/137/10' 2023-10-25T23:38:02.119 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/137/11' -> 'copyofsnap1/test1/137/11' 2023-10-25T23:38:02.120 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/137/12' -> 'copyofsnap1/test1/137/12' 2023-10-25T23:38:02.120 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/137/13' -> 'copyofsnap1/test1/137/13' 2023-10-25T23:38:02.120 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/137/14' -> 'copyofsnap1/test1/137/14' 2023-10-25T23:38:02.121 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/137/15' -> 'copyofsnap1/test1/137/15' 2023-10-25T23:38:02.121 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/137/16' -> 'copyofsnap1/test1/137/16' 2023-10-25T23:38:02.121 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/137/17' -> 'copyofsnap1/test1/137/17' 2023-10-25T23:38:02.121 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/137/18' -> 'copyofsnap1/test1/137/18' 2023-10-25T23:38:02.122 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/137/19' -> 'copyofsnap1/test1/137/19' 2023-10-25T23:38:02.122 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/137/20' -> 'copyofsnap1/test1/137/20' 2023-10-25T23:38:02.122 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/138' -> 'copyofsnap1/test1/138' 2023-10-25T23:38:02.123 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/138/10' -> 'copyofsnap1/test1/138/10' 2023-10-25T23:38:02.123 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/138/11' -> 'copyofsnap1/test1/138/11' 2023-10-25T23:38:02.123 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/138/12' -> 'copyofsnap1/test1/138/12' 2023-10-25T23:38:02.124 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/138/13' -> 'copyofsnap1/test1/138/13' 2023-10-25T23:38:02.124 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/138/14' -> 'copyofsnap1/test1/138/14' 2023-10-25T23:38:02.124 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/138/15' -> 'copyofsnap1/test1/138/15' 2023-10-25T23:38:02.125 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/138/16' -> 'copyofsnap1/test1/138/16' 2023-10-25T23:38:02.125 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/138/17' -> 'copyofsnap1/test1/138/17' 2023-10-25T23:38:02.125 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/138/18' -> 'copyofsnap1/test1/138/18' 2023-10-25T23:38:02.126 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/138/19' -> 'copyofsnap1/test1/138/19' 2023-10-25T23:38:02.126 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/138/20' -> 'copyofsnap1/test1/138/20' 2023-10-25T23:38:02.127 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/139' -> 'copyofsnap1/test1/139' 2023-10-25T23:38:02.127 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/139/10' -> 'copyofsnap1/test1/139/10' 2023-10-25T23:38:02.127 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/139/11' -> 'copyofsnap1/test1/139/11' 2023-10-25T23:38:02.127 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/139/12' -> 'copyofsnap1/test1/139/12' 2023-10-25T23:38:02.128 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/139/13' -> 'copyofsnap1/test1/139/13' 2023-10-25T23:38:02.128 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/139/14' -> 'copyofsnap1/test1/139/14' 2023-10-25T23:38:02.129 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/139/15' -> 'copyofsnap1/test1/139/15' 2023-10-25T23:38:02.129 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/139/16' -> 'copyofsnap1/test1/139/16' 2023-10-25T23:38:02.129 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/139/17' -> 'copyofsnap1/test1/139/17' 2023-10-25T23:38:02.130 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/139/18' -> 'copyofsnap1/test1/139/18' 2023-10-25T23:38:02.130 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/139/19' -> 'copyofsnap1/test1/139/19' 2023-10-25T23:38:02.130 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/139/20' -> 'copyofsnap1/test1/139/20' 2023-10-25T23:38:02.131 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/140' -> 'copyofsnap1/test1/140' 2023-10-25T23:38:02.131 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/140/10' -> 'copyofsnap1/test1/140/10' 2023-10-25T23:38:02.131 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/140/11' -> 'copyofsnap1/test1/140/11' 2023-10-25T23:38:02.131 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/140/12' -> 'copyofsnap1/test1/140/12' 2023-10-25T23:38:02.132 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/140/13' -> 'copyofsnap1/test1/140/13' 2023-10-25T23:38:02.279 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/140/14' -> 'copyofsnap1/test1/140/14' 2023-10-25T23:38:02.280 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/140/15' -> 'copyofsnap1/test1/140/15' 2023-10-25T23:38:02.280 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/140/16' -> 'copyofsnap1/test1/140/16' 2023-10-25T23:38:02.280 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/140/17' -> 'copyofsnap1/test1/140/17' 2023-10-25T23:38:02.280 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/140/18' -> 'copyofsnap1/test1/140/18' 2023-10-25T23:38:02.281 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/140/19' -> 'copyofsnap1/test1/140/19' 2023-10-25T23:38:02.281 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/140/20' -> 'copyofsnap1/test1/140/20' 2023-10-25T23:38:02.281 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/141' -> 'copyofsnap1/test1/141' 2023-10-25T23:38:02.281 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/141/10' -> 'copyofsnap1/test1/141/10' 2023-10-25T23:38:02.281 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/141/11' -> 'copyofsnap1/test1/141/11' 2023-10-25T23:38:02.281 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/141/12' -> 'copyofsnap1/test1/141/12' 2023-10-25T23:38:02.282 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/141/13' -> 'copyofsnap1/test1/141/13' 2023-10-25T23:38:02.282 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/141/14' -> 'copyofsnap1/test1/141/14' 2023-10-25T23:38:02.282 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/141/15' -> 'copyofsnap1/test1/141/15' 2023-10-25T23:38:02.282 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/141/16' -> 'copyofsnap1/test1/141/16' 2023-10-25T23:38:02.282 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/141/17' -> 'copyofsnap1/test1/141/17' 2023-10-25T23:38:02.283 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/141/18' -> 'copyofsnap1/test1/141/18' 2023-10-25T23:38:02.283 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/141/19' -> 'copyofsnap1/test1/141/19' 2023-10-25T23:38:02.283 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/141/20' -> 'copyofsnap1/test1/141/20' 2023-10-25T23:38:02.283 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/142' -> 'copyofsnap1/test1/142' 2023-10-25T23:38:02.283 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/142/10' -> 'copyofsnap1/test1/142/10' 2023-10-25T23:38:02.284 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/142/11' -> 'copyofsnap1/test1/142/11' 2023-10-25T23:38:02.284 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/142/12' -> 'copyofsnap1/test1/142/12' 2023-10-25T23:38:02.284 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/142/13' -> 'copyofsnap1/test1/142/13' 2023-10-25T23:38:02.285 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/142/14' -> 'copyofsnap1/test1/142/14' 2023-10-25T23:38:02.285 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/142/15' -> 'copyofsnap1/test1/142/15' 2023-10-25T23:38:02.285 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/142/16' -> 'copyofsnap1/test1/142/16' 2023-10-25T23:38:02.285 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/142/17' -> 'copyofsnap1/test1/142/17' 2023-10-25T23:38:02.285 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/142/18' -> 'copyofsnap1/test1/142/18' 2023-10-25T23:38:02.286 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/142/19' -> 'copyofsnap1/test1/142/19' 2023-10-25T23:38:02.286 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/142/20' -> 'copyofsnap1/test1/142/20' 2023-10-25T23:38:02.286 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/143' -> 'copyofsnap1/test1/143' 2023-10-25T23:38:02.286 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/143/10' -> 'copyofsnap1/test1/143/10' 2023-10-25T23:38:02.286 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/143/11' -> 'copyofsnap1/test1/143/11' 2023-10-25T23:38:02.287 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/143/12' -> 'copyofsnap1/test1/143/12' 2023-10-25T23:38:02.287 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/143/13' -> 'copyofsnap1/test1/143/13' 2023-10-25T23:38:02.287 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/143/14' -> 'copyofsnap1/test1/143/14' 2023-10-25T23:38:02.287 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/143/15' -> 'copyofsnap1/test1/143/15' 2023-10-25T23:38:02.287 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/143/16' -> 'copyofsnap1/test1/143/16' 2023-10-25T23:38:02.287 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/143/17' -> 'copyofsnap1/test1/143/17' 2023-10-25T23:38:02.288 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/143/18' -> 'copyofsnap1/test1/143/18' 2023-10-25T23:38:02.288 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/143/19' -> 'copyofsnap1/test1/143/19' 2023-10-25T23:38:02.288 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/143/20' -> 'copyofsnap1/test1/143/20' 2023-10-25T23:38:02.288 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/144' -> 'copyofsnap1/test1/144' 2023-10-25T23:38:02.288 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/144/10' -> 'copyofsnap1/test1/144/10' 2023-10-25T23:38:02.289 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/144/11' -> 'copyofsnap1/test1/144/11' 2023-10-25T23:38:02.289 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/144/12' -> 'copyofsnap1/test1/144/12' 2023-10-25T23:38:02.289 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/144/13' -> 'copyofsnap1/test1/144/13' 2023-10-25T23:38:02.289 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/144/14' -> 'copyofsnap1/test1/144/14' 2023-10-25T23:38:02.289 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/144/15' -> 'copyofsnap1/test1/144/15' 2023-10-25T23:38:02.290 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/144/16' -> 'copyofsnap1/test1/144/16' 2023-10-25T23:38:02.290 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/144/17' -> 'copyofsnap1/test1/144/17' 2023-10-25T23:38:02.290 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/144/18' -> 'copyofsnap1/test1/144/18' 2023-10-25T23:38:02.290 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/144/19' -> 'copyofsnap1/test1/144/19' 2023-10-25T23:38:02.290 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/144/20' -> 'copyofsnap1/test1/144/20' 2023-10-25T23:38:02.290 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/145' -> 'copyofsnap1/test1/145' 2023-10-25T23:38:02.291 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/145/10' -> 'copyofsnap1/test1/145/10' 2023-10-25T23:38:02.291 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/145/11' -> 'copyofsnap1/test1/145/11' 2023-10-25T23:38:02.291 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/145/12' -> 'copyofsnap1/test1/145/12' 2023-10-25T23:38:02.291 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/145/13' -> 'copyofsnap1/test1/145/13' 2023-10-25T23:38:02.291 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/145/14' -> 'copyofsnap1/test1/145/14' 2023-10-25T23:38:02.292 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/145/15' -> 'copyofsnap1/test1/145/15' 2023-10-25T23:38:02.292 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/145/16' -> 'copyofsnap1/test1/145/16' 2023-10-25T23:38:02.292 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/145/17' -> 'copyofsnap1/test1/145/17' 2023-10-25T23:38:02.292 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/145/18' -> 'copyofsnap1/test1/145/18' 2023-10-25T23:38:02.292 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/145/19' -> 'copyofsnap1/test1/145/19' 2023-10-25T23:38:02.292 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/145/20' -> 'copyofsnap1/test1/145/20' 2023-10-25T23:38:02.293 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/146' -> 'copyofsnap1/test1/146' 2023-10-25T23:38:02.293 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/146/10' -> 'copyofsnap1/test1/146/10' 2023-10-25T23:38:02.293 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/146/11' -> 'copyofsnap1/test1/146/11' 2023-10-25T23:38:02.293 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/146/12' -> 'copyofsnap1/test1/146/12' 2023-10-25T23:38:02.293 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/146/13' -> 'copyofsnap1/test1/146/13' 2023-10-25T23:38:02.294 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/146/14' -> 'copyofsnap1/test1/146/14' 2023-10-25T23:38:02.294 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/146/15' -> 'copyofsnap1/test1/146/15' 2023-10-25T23:38:02.294 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/146/16' -> 'copyofsnap1/test1/146/16' 2023-10-25T23:38:02.295 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/146/17' -> 'copyofsnap1/test1/146/17' 2023-10-25T23:38:02.295 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/146/18' -> 'copyofsnap1/test1/146/18' 2023-10-25T23:38:02.295 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/146/19' -> 'copyofsnap1/test1/146/19' 2023-10-25T23:38:02.296 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/146/20' -> 'copyofsnap1/test1/146/20' 2023-10-25T23:38:02.296 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/147' -> 'copyofsnap1/test1/147' 2023-10-25T23:38:02.296 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/147/10' -> 'copyofsnap1/test1/147/10' 2023-10-25T23:38:02.296 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/147/11' -> 'copyofsnap1/test1/147/11' 2023-10-25T23:38:02.430 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/147/12' -> 'copyofsnap1/test1/147/12' 2023-10-25T23:38:02.430 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/147/13' -> 'copyofsnap1/test1/147/13' 2023-10-25T23:38:02.431 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/147/14' -> 'copyofsnap1/test1/147/14' 2023-10-25T23:38:02.431 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/147/15' -> 'copyofsnap1/test1/147/15' 2023-10-25T23:38:02.431 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/147/16' -> 'copyofsnap1/test1/147/16' 2023-10-25T23:38:02.431 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/147/17' -> 'copyofsnap1/test1/147/17' 2023-10-25T23:38:02.432 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/147/18' -> 'copyofsnap1/test1/147/18' 2023-10-25T23:38:02.432 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/147/19' -> 'copyofsnap1/test1/147/19' 2023-10-25T23:38:02.432 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/147/20' -> 'copyofsnap1/test1/147/20' 2023-10-25T23:38:02.432 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/148' -> 'copyofsnap1/test1/148' 2023-10-25T23:38:02.432 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/148/10' -> 'copyofsnap1/test1/148/10' 2023-10-25T23:38:02.433 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/148/11' -> 'copyofsnap1/test1/148/11' 2023-10-25T23:38:02.433 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/148/12' -> 'copyofsnap1/test1/148/12' 2023-10-25T23:38:02.433 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/148/13' -> 'copyofsnap1/test1/148/13' 2023-10-25T23:38:02.433 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/148/14' -> 'copyofsnap1/test1/148/14' 2023-10-25T23:38:02.433 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/148/15' -> 'copyofsnap1/test1/148/15' 2023-10-25T23:38:02.434 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/148/16' -> 'copyofsnap1/test1/148/16' 2023-10-25T23:38:02.434 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/148/17' -> 'copyofsnap1/test1/148/17' 2023-10-25T23:38:02.434 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/148/18' -> 'copyofsnap1/test1/148/18' 2023-10-25T23:38:02.434 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/148/19' -> 'copyofsnap1/test1/148/19' 2023-10-25T23:38:02.434 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/148/20' -> 'copyofsnap1/test1/148/20' 2023-10-25T23:38:02.435 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/149' -> 'copyofsnap1/test1/149' 2023-10-25T23:38:02.435 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/149/10' -> 'copyofsnap1/test1/149/10' 2023-10-25T23:38:02.435 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/149/11' -> 'copyofsnap1/test1/149/11' 2023-10-25T23:38:02.435 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/149/12' -> 'copyofsnap1/test1/149/12' 2023-10-25T23:38:02.435 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/149/13' -> 'copyofsnap1/test1/149/13' 2023-10-25T23:38:02.436 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/149/14' -> 'copyofsnap1/test1/149/14' 2023-10-25T23:38:02.436 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/149/15' -> 'copyofsnap1/test1/149/15' 2023-10-25T23:38:02.436 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/149/16' -> 'copyofsnap1/test1/149/16' 2023-10-25T23:38:02.436 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/149/17' -> 'copyofsnap1/test1/149/17' 2023-10-25T23:38:02.436 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/149/18' -> 'copyofsnap1/test1/149/18' 2023-10-25T23:38:02.437 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/149/19' -> 'copyofsnap1/test1/149/19' 2023-10-25T23:38:02.437 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/149/20' -> 'copyofsnap1/test1/149/20' 2023-10-25T23:38:02.437 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/150' -> 'copyofsnap1/test1/150' 2023-10-25T23:38:02.437 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/150/10' -> 'copyofsnap1/test1/150/10' 2023-10-25T23:38:02.437 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/150/11' -> 'copyofsnap1/test1/150/11' 2023-10-25T23:38:02.438 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/150/12' -> 'copyofsnap1/test1/150/12' 2023-10-25T23:38:02.438 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/150/13' -> 'copyofsnap1/test1/150/13' 2023-10-25T23:38:02.438 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/150/14' -> 'copyofsnap1/test1/150/14' 2023-10-25T23:38:02.438 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/150/15' -> 'copyofsnap1/test1/150/15' 2023-10-25T23:38:02.438 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/150/16' -> 'copyofsnap1/test1/150/16' 2023-10-25T23:38:02.439 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/150/17' -> 'copyofsnap1/test1/150/17' 2023-10-25T23:38:02.439 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/150/18' -> 'copyofsnap1/test1/150/18' 2023-10-25T23:38:02.439 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/150/19' -> 'copyofsnap1/test1/150/19' 2023-10-25T23:38:02.439 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/150/20' -> 'copyofsnap1/test1/150/20' 2023-10-25T23:38:02.439 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/151' -> 'copyofsnap1/test1/151' 2023-10-25T23:38:02.440 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/151/10' -> 'copyofsnap1/test1/151/10' 2023-10-25T23:38:02.440 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/151/11' -> 'copyofsnap1/test1/151/11' 2023-10-25T23:38:02.441 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/151/12' -> 'copyofsnap1/test1/151/12' 2023-10-25T23:38:02.441 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/151/13' -> 'copyofsnap1/test1/151/13' 2023-10-25T23:38:02.441 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/151/14' -> 'copyofsnap1/test1/151/14' 2023-10-25T23:38:02.441 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/151/15' -> 'copyofsnap1/test1/151/15' 2023-10-25T23:38:02.441 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/151/16' -> 'copyofsnap1/test1/151/16' 2023-10-25T23:38:02.442 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/151/17' -> 'copyofsnap1/test1/151/17' 2023-10-25T23:38:02.442 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/151/18' -> 'copyofsnap1/test1/151/18' 2023-10-25T23:38:02.442 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/151/19' -> 'copyofsnap1/test1/151/19' 2023-10-25T23:38:02.442 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/151/20' -> 'copyofsnap1/test1/151/20' 2023-10-25T23:38:02.443 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/152' -> 'copyofsnap1/test1/152' 2023-10-25T23:38:02.443 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/152/10' -> 'copyofsnap1/test1/152/10' 2023-10-25T23:38:02.443 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/152/11' -> 'copyofsnap1/test1/152/11' 2023-10-25T23:38:02.443 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/152/12' -> 'copyofsnap1/test1/152/12' 2023-10-25T23:38:02.443 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/152/13' -> 'copyofsnap1/test1/152/13' 2023-10-25T23:38:02.443 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/152/14' -> 'copyofsnap1/test1/152/14' 2023-10-25T23:38:02.444 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/152/15' -> 'copyofsnap1/test1/152/15' 2023-10-25T23:38:02.444 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/152/16' -> 'copyofsnap1/test1/152/16' 2023-10-25T23:38:02.444 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/152/17' -> 'copyofsnap1/test1/152/17' 2023-10-25T23:38:02.444 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/152/18' -> 'copyofsnap1/test1/152/18' 2023-10-25T23:38:02.444 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/152/19' -> 'copyofsnap1/test1/152/19' 2023-10-25T23:38:02.445 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/152/20' -> 'copyofsnap1/test1/152/20' 2023-10-25T23:38:02.445 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/153' -> 'copyofsnap1/test1/153' 2023-10-25T23:38:02.445 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/153/10' -> 'copyofsnap1/test1/153/10' 2023-10-25T23:38:02.445 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/153/11' -> 'copyofsnap1/test1/153/11' 2023-10-25T23:38:02.445 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/153/12' -> 'copyofsnap1/test1/153/12' 2023-10-25T23:38:02.445 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/153/13' -> 'copyofsnap1/test1/153/13' 2023-10-25T23:38:02.446 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/153/14' -> 'copyofsnap1/test1/153/14' 2023-10-25T23:38:02.446 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/153/15' -> 'copyofsnap1/test1/153/15' 2023-10-25T23:38:02.446 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/153/16' -> 'copyofsnap1/test1/153/16' 2023-10-25T23:38:02.446 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/153/17' -> 'copyofsnap1/test1/153/17' 2023-10-25T23:38:02.446 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/153/18' -> 'copyofsnap1/test1/153/18' 2023-10-25T23:38:02.447 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/153/19' -> 'copyofsnap1/test1/153/19' 2023-10-25T23:38:02.450 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/153/20' -> 'copyofsnap1/test1/153/20' 2023-10-25T23:38:02.591 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/154' -> 'copyofsnap1/test1/154' 2023-10-25T23:38:02.592 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/154/10' -> 'copyofsnap1/test1/154/10' 2023-10-25T23:38:02.592 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/154/11' -> 'copyofsnap1/test1/154/11' 2023-10-25T23:38:02.592 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/154/12' -> 'copyofsnap1/test1/154/12' 2023-10-25T23:38:02.592 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/154/13' -> 'copyofsnap1/test1/154/13' 2023-10-25T23:38:02.593 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/154/14' -> 'copyofsnap1/test1/154/14' 2023-10-25T23:38:02.593 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/154/15' -> 'copyofsnap1/test1/154/15' 2023-10-25T23:38:02.593 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/154/16' -> 'copyofsnap1/test1/154/16' 2023-10-25T23:38:02.593 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/154/17' -> 'copyofsnap1/test1/154/17' 2023-10-25T23:38:02.593 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/154/18' -> 'copyofsnap1/test1/154/18' 2023-10-25T23:38:02.593 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/154/19' -> 'copyofsnap1/test1/154/19' 2023-10-25T23:38:02.594 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/154/20' -> 'copyofsnap1/test1/154/20' 2023-10-25T23:38:02.594 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/155' -> 'copyofsnap1/test1/155' 2023-10-25T23:38:02.594 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/155/10' -> 'copyofsnap1/test1/155/10' 2023-10-25T23:38:02.594 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/155/11' -> 'copyofsnap1/test1/155/11' 2023-10-25T23:38:02.595 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/155/12' -> 'copyofsnap1/test1/155/12' 2023-10-25T23:38:02.595 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/155/13' -> 'copyofsnap1/test1/155/13' 2023-10-25T23:38:02.595 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/155/14' -> 'copyofsnap1/test1/155/14' 2023-10-25T23:38:02.595 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/155/15' -> 'copyofsnap1/test1/155/15' 2023-10-25T23:38:02.596 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/155/16' -> 'copyofsnap1/test1/155/16' 2023-10-25T23:38:02.596 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/155/17' -> 'copyofsnap1/test1/155/17' 2023-10-25T23:38:02.596 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/155/18' -> 'copyofsnap1/test1/155/18' 2023-10-25T23:38:02.596 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/155/19' -> 'copyofsnap1/test1/155/19' 2023-10-25T23:38:02.596 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/155/20' -> 'copyofsnap1/test1/155/20' 2023-10-25T23:38:02.597 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/156' -> 'copyofsnap1/test1/156' 2023-10-25T23:38:02.597 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/156/10' -> 'copyofsnap1/test1/156/10' 2023-10-25T23:38:02.597 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/156/11' -> 'copyofsnap1/test1/156/11' 2023-10-25T23:38:02.597 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/156/12' -> 'copyofsnap1/test1/156/12' 2023-10-25T23:38:02.597 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/156/13' -> 'copyofsnap1/test1/156/13' 2023-10-25T23:38:02.598 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/156/14' -> 'copyofsnap1/test1/156/14' 2023-10-25T23:38:02.598 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/156/15' -> 'copyofsnap1/test1/156/15' 2023-10-25T23:38:02.598 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/156/16' -> 'copyofsnap1/test1/156/16' 2023-10-25T23:38:02.598 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/156/17' -> 'copyofsnap1/test1/156/17' 2023-10-25T23:38:02.598 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/156/18' -> 'copyofsnap1/test1/156/18' 2023-10-25T23:38:02.599 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/156/19' -> 'copyofsnap1/test1/156/19' 2023-10-25T23:38:02.599 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/156/20' -> 'copyofsnap1/test1/156/20' 2023-10-25T23:38:02.599 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/157' -> 'copyofsnap1/test1/157' 2023-10-25T23:38:02.599 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/157/10' -> 'copyofsnap1/test1/157/10' 2023-10-25T23:38:02.599 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/157/11' -> 'copyofsnap1/test1/157/11' 2023-10-25T23:38:02.600 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/157/12' -> 'copyofsnap1/test1/157/12' 2023-10-25T23:38:02.600 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/157/13' -> 'copyofsnap1/test1/157/13' 2023-10-25T23:38:02.600 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/157/14' -> 'copyofsnap1/test1/157/14' 2023-10-25T23:38:02.600 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/157/15' -> 'copyofsnap1/test1/157/15' 2023-10-25T23:38:02.600 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/157/16' -> 'copyofsnap1/test1/157/16' 2023-10-25T23:38:02.601 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/157/17' -> 'copyofsnap1/test1/157/17' 2023-10-25T23:38:02.601 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/157/18' -> 'copyofsnap1/test1/157/18' 2023-10-25T23:38:02.601 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/157/19' -> 'copyofsnap1/test1/157/19' 2023-10-25T23:38:02.601 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/157/20' -> 'copyofsnap1/test1/157/20' 2023-10-25T23:38:02.601 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/158' -> 'copyofsnap1/test1/158' 2023-10-25T23:38:02.602 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/158/10' -> 'copyofsnap1/test1/158/10' 2023-10-25T23:38:02.602 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/158/11' -> 'copyofsnap1/test1/158/11' 2023-10-25T23:38:02.602 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/158/12' -> 'copyofsnap1/test1/158/12' 2023-10-25T23:38:02.602 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/158/13' -> 'copyofsnap1/test1/158/13' 2023-10-25T23:38:02.603 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/158/14' -> 'copyofsnap1/test1/158/14' 2023-10-25T23:38:02.603 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/158/15' -> 'copyofsnap1/test1/158/15' 2023-10-25T23:38:02.603 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/158/16' -> 'copyofsnap1/test1/158/16' 2023-10-25T23:38:02.603 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/158/17' -> 'copyofsnap1/test1/158/17' 2023-10-25T23:38:02.603 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/158/18' -> 'copyofsnap1/test1/158/18' 2023-10-25T23:38:02.603 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/158/19' -> 'copyofsnap1/test1/158/19' 2023-10-25T23:38:02.604 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/158/20' -> 'copyofsnap1/test1/158/20' 2023-10-25T23:38:02.604 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/159' -> 'copyofsnap1/test1/159' 2023-10-25T23:38:02.604 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/159/10' -> 'copyofsnap1/test1/159/10' 2023-10-25T23:38:02.604 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/159/11' -> 'copyofsnap1/test1/159/11' 2023-10-25T23:38:02.604 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/159/12' -> 'copyofsnap1/test1/159/12' 2023-10-25T23:38:02.605 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/159/13' -> 'copyofsnap1/test1/159/13' 2023-10-25T23:38:02.605 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/159/14' -> 'copyofsnap1/test1/159/14' 2023-10-25T23:38:02.605 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/159/15' -> 'copyofsnap1/test1/159/15' 2023-10-25T23:38:02.605 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/159/16' -> 'copyofsnap1/test1/159/16' 2023-10-25T23:38:02.605 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/159/17' -> 'copyofsnap1/test1/159/17' 2023-10-25T23:38:02.606 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/159/18' -> 'copyofsnap1/test1/159/18' 2023-10-25T23:38:02.606 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/159/19' -> 'copyofsnap1/test1/159/19' 2023-10-25T23:38:02.606 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/159/20' -> 'copyofsnap1/test1/159/20' 2023-10-25T23:38:02.606 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/160' -> 'copyofsnap1/test1/160' 2023-10-25T23:38:02.606 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/160/10' -> 'copyofsnap1/test1/160/10' 2023-10-25T23:38:02.606 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/160/11' -> 'copyofsnap1/test1/160/11' 2023-10-25T23:38:02.607 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/160/12' -> 'copyofsnap1/test1/160/12' 2023-10-25T23:38:02.607 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/160/13' -> 'copyofsnap1/test1/160/13' 2023-10-25T23:38:02.607 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/160/14' -> 'copyofsnap1/test1/160/14' 2023-10-25T23:38:02.607 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/160/15' -> 'copyofsnap1/test1/160/15' 2023-10-25T23:38:02.608 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/160/16' -> 'copyofsnap1/test1/160/16' 2023-10-25T23:38:02.608 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/160/17' -> 'copyofsnap1/test1/160/17' 2023-10-25T23:38:02.753 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/160/18' -> 'copyofsnap1/test1/160/18' 2023-10-25T23:38:02.753 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/160/19' -> 'copyofsnap1/test1/160/19' 2023-10-25T23:38:02.753 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/160/20' -> 'copyofsnap1/test1/160/20' 2023-10-25T23:38:02.754 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/161' -> 'copyofsnap1/test1/161' 2023-10-25T23:38:02.754 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/161/10' -> 'copyofsnap1/test1/161/10' 2023-10-25T23:38:02.754 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/161/11' -> 'copyofsnap1/test1/161/11' 2023-10-25T23:38:02.754 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/161/12' -> 'copyofsnap1/test1/161/12' 2023-10-25T23:38:02.754 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/161/13' -> 'copyofsnap1/test1/161/13' 2023-10-25T23:38:02.755 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/161/14' -> 'copyofsnap1/test1/161/14' 2023-10-25T23:38:02.755 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/161/15' -> 'copyofsnap1/test1/161/15' 2023-10-25T23:38:02.755 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/161/16' -> 'copyofsnap1/test1/161/16' 2023-10-25T23:38:02.755 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/161/17' -> 'copyofsnap1/test1/161/17' 2023-10-25T23:38:02.755 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/161/18' -> 'copyofsnap1/test1/161/18' 2023-10-25T23:38:02.756 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/161/19' -> 'copyofsnap1/test1/161/19' 2023-10-25T23:38:02.756 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/161/20' -> 'copyofsnap1/test1/161/20' 2023-10-25T23:38:02.756 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/162' -> 'copyofsnap1/test1/162' 2023-10-25T23:38:02.756 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/162/10' -> 'copyofsnap1/test1/162/10' 2023-10-25T23:38:02.756 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/162/11' -> 'copyofsnap1/test1/162/11' 2023-10-25T23:38:02.757 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/162/12' -> 'copyofsnap1/test1/162/12' 2023-10-25T23:38:02.757 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/162/13' -> 'copyofsnap1/test1/162/13' 2023-10-25T23:38:02.757 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/162/14' -> 'copyofsnap1/test1/162/14' 2023-10-25T23:38:02.757 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/162/15' -> 'copyofsnap1/test1/162/15' 2023-10-25T23:38:02.757 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/162/16' -> 'copyofsnap1/test1/162/16' 2023-10-25T23:38:02.758 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/162/17' -> 'copyofsnap1/test1/162/17' 2023-10-25T23:38:02.758 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/162/18' -> 'copyofsnap1/test1/162/18' 2023-10-25T23:38:02.758 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/162/19' -> 'copyofsnap1/test1/162/19' 2023-10-25T23:38:02.758 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/162/20' -> 'copyofsnap1/test1/162/20' 2023-10-25T23:38:02.758 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/163' -> 'copyofsnap1/test1/163' 2023-10-25T23:38:02.759 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/163/10' -> 'copyofsnap1/test1/163/10' 2023-10-25T23:38:02.759 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/163/11' -> 'copyofsnap1/test1/163/11' 2023-10-25T23:38:02.759 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/163/12' -> 'copyofsnap1/test1/163/12' 2023-10-25T23:38:02.759 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/163/13' -> 'copyofsnap1/test1/163/13' 2023-10-25T23:38:02.759 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/163/14' -> 'copyofsnap1/test1/163/14' 2023-10-25T23:38:02.760 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/163/15' -> 'copyofsnap1/test1/163/15' 2023-10-25T23:38:02.760 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/163/16' -> 'copyofsnap1/test1/163/16' 2023-10-25T23:38:02.760 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/163/17' -> 'copyofsnap1/test1/163/17' 2023-10-25T23:38:02.760 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/163/18' -> 'copyofsnap1/test1/163/18' 2023-10-25T23:38:02.760 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/163/19' -> 'copyofsnap1/test1/163/19' 2023-10-25T23:38:02.760 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/163/20' -> 'copyofsnap1/test1/163/20' 2023-10-25T23:38:02.761 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/164' -> 'copyofsnap1/test1/164' 2023-10-25T23:38:02.761 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/164/10' -> 'copyofsnap1/test1/164/10' 2023-10-25T23:38:02.761 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/164/11' -> 'copyofsnap1/test1/164/11' 2023-10-25T23:38:02.761 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/164/12' -> 'copyofsnap1/test1/164/12' 2023-10-25T23:38:02.761 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/164/13' -> 'copyofsnap1/test1/164/13' 2023-10-25T23:38:02.762 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/164/14' -> 'copyofsnap1/test1/164/14' 2023-10-25T23:38:02.762 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/164/15' -> 'copyofsnap1/test1/164/15' 2023-10-25T23:38:02.763 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/164/16' -> 'copyofsnap1/test1/164/16' 2023-10-25T23:38:02.763 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/164/17' -> 'copyofsnap1/test1/164/17' 2023-10-25T23:38:02.763 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/164/18' -> 'copyofsnap1/test1/164/18' 2023-10-25T23:38:02.763 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/164/19' -> 'copyofsnap1/test1/164/19' 2023-10-25T23:38:02.763 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/164/20' -> 'copyofsnap1/test1/164/20' 2023-10-25T23:38:02.764 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/165' -> 'copyofsnap1/test1/165' 2023-10-25T23:38:02.764 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/165/10' -> 'copyofsnap1/test1/165/10' 2023-10-25T23:38:02.764 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/165/11' -> 'copyofsnap1/test1/165/11' 2023-10-25T23:38:02.764 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/165/12' -> 'copyofsnap1/test1/165/12' 2023-10-25T23:38:02.764 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/165/13' -> 'copyofsnap1/test1/165/13' 2023-10-25T23:38:02.764 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/165/14' -> 'copyofsnap1/test1/165/14' 2023-10-25T23:38:02.765 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/165/15' -> 'copyofsnap1/test1/165/15' 2023-10-25T23:38:02.765 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/165/16' -> 'copyofsnap1/test1/165/16' 2023-10-25T23:38:02.765 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/165/17' -> 'copyofsnap1/test1/165/17' 2023-10-25T23:38:02.766 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/165/18' -> 'copyofsnap1/test1/165/18' 2023-10-25T23:38:02.766 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/165/19' -> 'copyofsnap1/test1/165/19' 2023-10-25T23:38:02.766 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/165/20' -> 'copyofsnap1/test1/165/20' 2023-10-25T23:38:02.766 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/166' -> 'copyofsnap1/test1/166' 2023-10-25T23:38:02.767 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/166/10' -> 'copyofsnap1/test1/166/10' 2023-10-25T23:38:02.767 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/166/11' -> 'copyofsnap1/test1/166/11' 2023-10-25T23:38:02.767 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/166/12' -> 'copyofsnap1/test1/166/12' 2023-10-25T23:38:02.767 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/166/13' -> 'copyofsnap1/test1/166/13' 2023-10-25T23:38:02.767 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/166/14' -> 'copyofsnap1/test1/166/14' 2023-10-25T23:38:02.768 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/166/15' -> 'copyofsnap1/test1/166/15' 2023-10-25T23:38:02.768 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/166/16' -> 'copyofsnap1/test1/166/16' 2023-10-25T23:38:02.768 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/166/17' -> 'copyofsnap1/test1/166/17' 2023-10-25T23:38:02.768 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/166/18' -> 'copyofsnap1/test1/166/18' 2023-10-25T23:38:02.768 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/166/19' -> 'copyofsnap1/test1/166/19' 2023-10-25T23:38:02.769 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/166/20' -> 'copyofsnap1/test1/166/20' 2023-10-25T23:38:02.769 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/167' -> 'copyofsnap1/test1/167' 2023-10-25T23:38:02.769 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/167/10' -> 'copyofsnap1/test1/167/10' 2023-10-25T23:38:02.769 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/167/11' -> 'copyofsnap1/test1/167/11' 2023-10-25T23:38:02.769 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/167/12' -> 'copyofsnap1/test1/167/12' 2023-10-25T23:38:02.770 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/167/13' -> 'copyofsnap1/test1/167/13' 2023-10-25T23:38:02.770 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/167/14' -> 'copyofsnap1/test1/167/14' 2023-10-25T23:38:02.905 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/167/15' -> 'copyofsnap1/test1/167/15' 2023-10-25T23:38:02.905 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/167/16' -> 'copyofsnap1/test1/167/16' 2023-10-25T23:38:02.905 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/167/17' -> 'copyofsnap1/test1/167/17' 2023-10-25T23:38:02.905 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/167/18' -> 'copyofsnap1/test1/167/18' 2023-10-25T23:38:02.906 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/167/19' -> 'copyofsnap1/test1/167/19' 2023-10-25T23:38:02.906 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/167/20' -> 'copyofsnap1/test1/167/20' 2023-10-25T23:38:02.906 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/168' -> 'copyofsnap1/test1/168' 2023-10-25T23:38:02.906 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/168/10' -> 'copyofsnap1/test1/168/10' 2023-10-25T23:38:02.907 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/168/11' -> 'copyofsnap1/test1/168/11' 2023-10-25T23:38:02.907 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/168/12' -> 'copyofsnap1/test1/168/12' 2023-10-25T23:38:02.907 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/168/13' -> 'copyofsnap1/test1/168/13' 2023-10-25T23:38:02.907 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/168/14' -> 'copyofsnap1/test1/168/14' 2023-10-25T23:38:02.907 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/168/15' -> 'copyofsnap1/test1/168/15' 2023-10-25T23:38:02.908 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/168/16' -> 'copyofsnap1/test1/168/16' 2023-10-25T23:38:02.908 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/168/17' -> 'copyofsnap1/test1/168/17' 2023-10-25T23:38:02.908 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/168/18' -> 'copyofsnap1/test1/168/18' 2023-10-25T23:38:02.908 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/168/19' -> 'copyofsnap1/test1/168/19' 2023-10-25T23:38:02.908 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/168/20' -> 'copyofsnap1/test1/168/20' 2023-10-25T23:38:02.908 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/169' -> 'copyofsnap1/test1/169' 2023-10-25T23:38:02.909 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/169/10' -> 'copyofsnap1/test1/169/10' 2023-10-25T23:38:02.909 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/169/11' -> 'copyofsnap1/test1/169/11' 2023-10-25T23:38:02.909 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/169/12' -> 'copyofsnap1/test1/169/12' 2023-10-25T23:38:02.909 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/169/13' -> 'copyofsnap1/test1/169/13' 2023-10-25T23:38:02.909 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/169/14' -> 'copyofsnap1/test1/169/14' 2023-10-25T23:38:02.909 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/169/15' -> 'copyofsnap1/test1/169/15' 2023-10-25T23:38:02.910 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/169/16' -> 'copyofsnap1/test1/169/16' 2023-10-25T23:38:02.910 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/169/17' -> 'copyofsnap1/test1/169/17' 2023-10-25T23:38:02.910 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/169/18' -> 'copyofsnap1/test1/169/18' 2023-10-25T23:38:02.910 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/169/19' -> 'copyofsnap1/test1/169/19' 2023-10-25T23:38:02.910 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/169/20' -> 'copyofsnap1/test1/169/20' 2023-10-25T23:38:02.911 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/170' -> 'copyofsnap1/test1/170' 2023-10-25T23:38:02.911 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/170/10' -> 'copyofsnap1/test1/170/10' 2023-10-25T23:38:02.911 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/170/11' -> 'copyofsnap1/test1/170/11' 2023-10-25T23:38:02.911 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/170/12' -> 'copyofsnap1/test1/170/12' 2023-10-25T23:38:02.911 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/170/13' -> 'copyofsnap1/test1/170/13' 2023-10-25T23:38:02.912 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/170/14' -> 'copyofsnap1/test1/170/14' 2023-10-25T23:38:02.912 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/170/15' -> 'copyofsnap1/test1/170/15' 2023-10-25T23:38:02.912 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/170/16' -> 'copyofsnap1/test1/170/16' 2023-10-25T23:38:02.912 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/170/17' -> 'copyofsnap1/test1/170/17' 2023-10-25T23:38:02.912 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/170/18' -> 'copyofsnap1/test1/170/18' 2023-10-25T23:38:02.913 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/170/19' -> 'copyofsnap1/test1/170/19' 2023-10-25T23:38:02.913 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/170/20' -> 'copyofsnap1/test1/170/20' 2023-10-25T23:38:02.913 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/171' -> 'copyofsnap1/test1/171' 2023-10-25T23:38:02.913 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/171/10' -> 'copyofsnap1/test1/171/10' 2023-10-25T23:38:02.914 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/171/11' -> 'copyofsnap1/test1/171/11' 2023-10-25T23:38:02.914 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/171/12' -> 'copyofsnap1/test1/171/12' 2023-10-25T23:38:02.914 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/171/13' -> 'copyofsnap1/test1/171/13' 2023-10-25T23:38:02.914 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/171/14' -> 'copyofsnap1/test1/171/14' 2023-10-25T23:38:02.914 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/171/15' -> 'copyofsnap1/test1/171/15' 2023-10-25T23:38:02.915 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/171/16' -> 'copyofsnap1/test1/171/16' 2023-10-25T23:38:02.915 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/171/17' -> 'copyofsnap1/test1/171/17' 2023-10-25T23:38:02.915 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/171/18' -> 'copyofsnap1/test1/171/18' 2023-10-25T23:38:02.915 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/171/19' -> 'copyofsnap1/test1/171/19' 2023-10-25T23:38:02.915 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/171/20' -> 'copyofsnap1/test1/171/20' 2023-10-25T23:38:02.916 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/172' -> 'copyofsnap1/test1/172' 2023-10-25T23:38:02.916 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/172/10' -> 'copyofsnap1/test1/172/10' 2023-10-25T23:38:02.916 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/172/11' -> 'copyofsnap1/test1/172/11' 2023-10-25T23:38:02.916 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/172/12' -> 'copyofsnap1/test1/172/12' 2023-10-25T23:38:02.917 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/172/13' -> 'copyofsnap1/test1/172/13' 2023-10-25T23:38:02.917 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/172/14' -> 'copyofsnap1/test1/172/14' 2023-10-25T23:38:02.917 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/172/15' -> 'copyofsnap1/test1/172/15' 2023-10-25T23:38:02.917 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/172/16' -> 'copyofsnap1/test1/172/16' 2023-10-25T23:38:02.917 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/172/17' -> 'copyofsnap1/test1/172/17' 2023-10-25T23:38:02.918 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/172/18' -> 'copyofsnap1/test1/172/18' 2023-10-25T23:38:02.918 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/172/19' -> 'copyofsnap1/test1/172/19' 2023-10-25T23:38:02.918 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/172/20' -> 'copyofsnap1/test1/172/20' 2023-10-25T23:38:02.918 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/173' -> 'copyofsnap1/test1/173' 2023-10-25T23:38:02.918 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/173/10' -> 'copyofsnap1/test1/173/10' 2023-10-25T23:38:02.919 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/173/11' -> 'copyofsnap1/test1/173/11' 2023-10-25T23:38:02.919 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/173/12' -> 'copyofsnap1/test1/173/12' 2023-10-25T23:38:02.919 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/173/13' -> 'copyofsnap1/test1/173/13' 2023-10-25T23:38:02.919 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/173/14' -> 'copyofsnap1/test1/173/14' 2023-10-25T23:38:02.919 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/173/15' -> 'copyofsnap1/test1/173/15' 2023-10-25T23:38:02.920 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/173/16' -> 'copyofsnap1/test1/173/16' 2023-10-25T23:38:02.920 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/173/17' -> 'copyofsnap1/test1/173/17' 2023-10-25T23:38:02.920 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/173/18' -> 'copyofsnap1/test1/173/18' 2023-10-25T23:38:02.920 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/173/19' -> 'copyofsnap1/test1/173/19' 2023-10-25T23:38:02.920 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/173/20' -> 'copyofsnap1/test1/173/20' 2023-10-25T23:38:02.921 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/174' -> 'copyofsnap1/test1/174' 2023-10-25T23:38:02.921 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/174/10' -> 'copyofsnap1/test1/174/10' 2023-10-25T23:38:02.921 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/174/11' -> 'copyofsnap1/test1/174/11' 2023-10-25T23:38:03.068 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/174/12' -> 'copyofsnap1/test1/174/12' 2023-10-25T23:38:03.068 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/174/13' -> 'copyofsnap1/test1/174/13' 2023-10-25T23:38:03.069 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/174/14' -> 'copyofsnap1/test1/174/14' 2023-10-25T23:38:03.069 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/174/15' -> 'copyofsnap1/test1/174/15' 2023-10-25T23:38:03.069 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/174/16' -> 'copyofsnap1/test1/174/16' 2023-10-25T23:38:03.069 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/174/17' -> 'copyofsnap1/test1/174/17' 2023-10-25T23:38:03.069 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/174/18' -> 'copyofsnap1/test1/174/18' 2023-10-25T23:38:03.070 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/174/19' -> 'copyofsnap1/test1/174/19' 2023-10-25T23:38:03.070 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/174/20' -> 'copyofsnap1/test1/174/20' 2023-10-25T23:38:03.070 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/175' -> 'copyofsnap1/test1/175' 2023-10-25T23:38:03.070 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/175/10' -> 'copyofsnap1/test1/175/10' 2023-10-25T23:38:03.070 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/175/11' -> 'copyofsnap1/test1/175/11' 2023-10-25T23:38:03.071 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/175/12' -> 'copyofsnap1/test1/175/12' 2023-10-25T23:38:03.071 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/175/13' -> 'copyofsnap1/test1/175/13' 2023-10-25T23:38:03.071 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/175/14' -> 'copyofsnap1/test1/175/14' 2023-10-25T23:38:03.071 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/175/15' -> 'copyofsnap1/test1/175/15' 2023-10-25T23:38:03.071 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/175/16' -> 'copyofsnap1/test1/175/16' 2023-10-25T23:38:03.072 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/175/17' -> 'copyofsnap1/test1/175/17' 2023-10-25T23:38:03.072 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/175/18' -> 'copyofsnap1/test1/175/18' 2023-10-25T23:38:03.072 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/175/19' -> 'copyofsnap1/test1/175/19' 2023-10-25T23:38:03.072 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/175/20' -> 'copyofsnap1/test1/175/20' 2023-10-25T23:38:03.072 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/176' -> 'copyofsnap1/test1/176' 2023-10-25T23:38:03.072 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/176/10' -> 'copyofsnap1/test1/176/10' 2023-10-25T23:38:03.073 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/176/11' -> 'copyofsnap1/test1/176/11' 2023-10-25T23:38:03.074 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/176/12' -> 'copyofsnap1/test1/176/12' 2023-10-25T23:38:03.074 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/176/13' -> 'copyofsnap1/test1/176/13' 2023-10-25T23:38:03.074 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/176/14' -> 'copyofsnap1/test1/176/14' 2023-10-25T23:38:03.074 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/176/15' -> 'copyofsnap1/test1/176/15' 2023-10-25T23:38:03.074 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/176/16' -> 'copyofsnap1/test1/176/16' 2023-10-25T23:38:03.075 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/176/17' -> 'copyofsnap1/test1/176/17' 2023-10-25T23:38:03.075 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/176/18' -> 'copyofsnap1/test1/176/18' 2023-10-25T23:38:03.075 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/176/19' -> 'copyofsnap1/test1/176/19' 2023-10-25T23:38:03.075 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/176/20' -> 'copyofsnap1/test1/176/20' 2023-10-25T23:38:03.075 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/177' -> 'copyofsnap1/test1/177' 2023-10-25T23:38:03.076 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/177/10' -> 'copyofsnap1/test1/177/10' 2023-10-25T23:38:03.076 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/177/11' -> 'copyofsnap1/test1/177/11' 2023-10-25T23:38:03.076 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/177/12' -> 'copyofsnap1/test1/177/12' 2023-10-25T23:38:03.076 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/177/13' -> 'copyofsnap1/test1/177/13' 2023-10-25T23:38:03.076 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/177/14' -> 'copyofsnap1/test1/177/14' 2023-10-25T23:38:03.077 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/177/15' -> 'copyofsnap1/test1/177/15' 2023-10-25T23:38:03.077 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/177/16' -> 'copyofsnap1/test1/177/16' 2023-10-25T23:38:03.077 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/177/17' -> 'copyofsnap1/test1/177/17' 2023-10-25T23:38:03.077 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/177/18' -> 'copyofsnap1/test1/177/18' 2023-10-25T23:38:03.077 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/177/19' -> 'copyofsnap1/test1/177/19' 2023-10-25T23:38:03.078 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/177/20' -> 'copyofsnap1/test1/177/20' 2023-10-25T23:38:03.078 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/178' -> 'copyofsnap1/test1/178' 2023-10-25T23:38:03.078 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/178/10' -> 'copyofsnap1/test1/178/10' 2023-10-25T23:38:03.078 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/178/11' -> 'copyofsnap1/test1/178/11' 2023-10-25T23:38:03.078 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/178/12' -> 'copyofsnap1/test1/178/12' 2023-10-25T23:38:03.079 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/178/13' -> 'copyofsnap1/test1/178/13' 2023-10-25T23:38:03.079 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/178/14' -> 'copyofsnap1/test1/178/14' 2023-10-25T23:38:03.079 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/178/15' -> 'copyofsnap1/test1/178/15' 2023-10-25T23:38:03.079 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/178/16' -> 'copyofsnap1/test1/178/16' 2023-10-25T23:38:03.079 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/178/17' -> 'copyofsnap1/test1/178/17' 2023-10-25T23:38:03.080 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/178/18' -> 'copyofsnap1/test1/178/18' 2023-10-25T23:38:03.080 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/178/19' -> 'copyofsnap1/test1/178/19' 2023-10-25T23:38:03.080 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/178/20' -> 'copyofsnap1/test1/178/20' 2023-10-25T23:38:03.080 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/179' -> 'copyofsnap1/test1/179' 2023-10-25T23:38:03.080 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/179/10' -> 'copyofsnap1/test1/179/10' 2023-10-25T23:38:03.080 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/179/11' -> 'copyofsnap1/test1/179/11' 2023-10-25T23:38:03.081 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/179/12' -> 'copyofsnap1/test1/179/12' 2023-10-25T23:38:03.081 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/179/13' -> 'copyofsnap1/test1/179/13' 2023-10-25T23:38:03.081 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/179/14' -> 'copyofsnap1/test1/179/14' 2023-10-25T23:38:03.081 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/179/15' -> 'copyofsnap1/test1/179/15' 2023-10-25T23:38:03.081 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/179/16' -> 'copyofsnap1/test1/179/16' 2023-10-25T23:38:03.082 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/179/17' -> 'copyofsnap1/test1/179/17' 2023-10-25T23:38:03.082 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/179/18' -> 'copyofsnap1/test1/179/18' 2023-10-25T23:38:03.082 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/179/19' -> 'copyofsnap1/test1/179/19' 2023-10-25T23:38:03.082 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/179/20' -> 'copyofsnap1/test1/179/20' 2023-10-25T23:38:03.082 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/180' -> 'copyofsnap1/test1/180' 2023-10-25T23:38:03.083 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/180/10' -> 'copyofsnap1/test1/180/10' 2023-10-25T23:38:03.083 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/180/11' -> 'copyofsnap1/test1/180/11' 2023-10-25T23:38:03.083 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/180/12' -> 'copyofsnap1/test1/180/12' 2023-10-25T23:38:03.083 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/180/13' -> 'copyofsnap1/test1/180/13' 2023-10-25T23:38:03.083 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/180/14' -> 'copyofsnap1/test1/180/14' 2023-10-25T23:38:03.084 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/180/15' -> 'copyofsnap1/test1/180/15' 2023-10-25T23:38:03.084 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/180/16' -> 'copyofsnap1/test1/180/16' 2023-10-25T23:38:03.084 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/180/17' -> 'copyofsnap1/test1/180/17' 2023-10-25T23:38:03.084 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/180/18' -> 'copyofsnap1/test1/180/18' 2023-10-25T23:38:03.084 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/180/19' -> 'copyofsnap1/test1/180/19' 2023-10-25T23:38:03.084 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/180/20' -> 'copyofsnap1/test1/180/20' 2023-10-25T23:38:03.225 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/181' -> 'copyofsnap1/test1/181' 2023-10-25T23:38:03.225 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/181/10' -> 'copyofsnap1/test1/181/10' 2023-10-25T23:38:03.226 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/181/11' -> 'copyofsnap1/test1/181/11' 2023-10-25T23:38:03.226 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/181/12' -> 'copyofsnap1/test1/181/12' 2023-10-25T23:38:03.226 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/181/13' -> 'copyofsnap1/test1/181/13' 2023-10-25T23:38:03.226 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/181/14' -> 'copyofsnap1/test1/181/14' 2023-10-25T23:38:03.227 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/181/15' -> 'copyofsnap1/test1/181/15' 2023-10-25T23:38:03.227 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/181/16' -> 'copyofsnap1/test1/181/16' 2023-10-25T23:38:03.227 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/181/17' -> 'copyofsnap1/test1/181/17' 2023-10-25T23:38:03.227 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/181/18' -> 'copyofsnap1/test1/181/18' 2023-10-25T23:38:03.227 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/181/19' -> 'copyofsnap1/test1/181/19' 2023-10-25T23:38:03.227 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/181/20' -> 'copyofsnap1/test1/181/20' 2023-10-25T23:38:03.228 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/182' -> 'copyofsnap1/test1/182' 2023-10-25T23:38:03.228 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/182/10' -> 'copyofsnap1/test1/182/10' 2023-10-25T23:38:03.228 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/182/11' -> 'copyofsnap1/test1/182/11' 2023-10-25T23:38:03.228 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/182/12' -> 'copyofsnap1/test1/182/12' 2023-10-25T23:38:03.228 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/182/13' -> 'copyofsnap1/test1/182/13' 2023-10-25T23:38:03.229 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/182/14' -> 'copyofsnap1/test1/182/14' 2023-10-25T23:38:03.229 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/182/15' -> 'copyofsnap1/test1/182/15' 2023-10-25T23:38:03.229 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/182/16' -> 'copyofsnap1/test1/182/16' 2023-10-25T23:38:03.229 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/182/17' -> 'copyofsnap1/test1/182/17' 2023-10-25T23:38:03.229 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/182/18' -> 'copyofsnap1/test1/182/18' 2023-10-25T23:38:03.230 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/182/19' -> 'copyofsnap1/test1/182/19' 2023-10-25T23:38:03.230 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/182/20' -> 'copyofsnap1/test1/182/20' 2023-10-25T23:38:03.230 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/183' -> 'copyofsnap1/test1/183' 2023-10-25T23:38:03.230 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/183/10' -> 'copyofsnap1/test1/183/10' 2023-10-25T23:38:03.230 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/183/11' -> 'copyofsnap1/test1/183/11' 2023-10-25T23:38:03.231 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/183/12' -> 'copyofsnap1/test1/183/12' 2023-10-25T23:38:03.231 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/183/13' -> 'copyofsnap1/test1/183/13' 2023-10-25T23:38:03.231 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/183/14' -> 'copyofsnap1/test1/183/14' 2023-10-25T23:38:03.231 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/183/15' -> 'copyofsnap1/test1/183/15' 2023-10-25T23:38:03.231 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/183/16' -> 'copyofsnap1/test1/183/16' 2023-10-25T23:38:03.232 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/183/17' -> 'copyofsnap1/test1/183/17' 2023-10-25T23:38:03.232 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/183/18' -> 'copyofsnap1/test1/183/18' 2023-10-25T23:38:03.232 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/183/19' -> 'copyofsnap1/test1/183/19' 2023-10-25T23:38:03.232 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/183/20' -> 'copyofsnap1/test1/183/20' 2023-10-25T23:38:03.232 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/184' -> 'copyofsnap1/test1/184' 2023-10-25T23:38:03.233 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/184/10' -> 'copyofsnap1/test1/184/10' 2023-10-25T23:38:03.233 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/184/11' -> 'copyofsnap1/test1/184/11' 2023-10-25T23:38:03.233 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/184/12' -> 'copyofsnap1/test1/184/12' 2023-10-25T23:38:03.233 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/184/13' -> 'copyofsnap1/test1/184/13' 2023-10-25T23:38:03.233 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/184/14' -> 'copyofsnap1/test1/184/14' 2023-10-25T23:38:03.234 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/184/15' -> 'copyofsnap1/test1/184/15' 2023-10-25T23:38:03.234 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/184/16' -> 'copyofsnap1/test1/184/16' 2023-10-25T23:38:03.234 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/184/17' -> 'copyofsnap1/test1/184/17' 2023-10-25T23:38:03.234 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/184/18' -> 'copyofsnap1/test1/184/18' 2023-10-25T23:38:03.234 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/184/19' -> 'copyofsnap1/test1/184/19' 2023-10-25T23:38:03.235 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/184/20' -> 'copyofsnap1/test1/184/20' 2023-10-25T23:38:03.235 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/185' -> 'copyofsnap1/test1/185' 2023-10-25T23:38:03.235 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/185/10' -> 'copyofsnap1/test1/185/10' 2023-10-25T23:38:03.235 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/185/11' -> 'copyofsnap1/test1/185/11' 2023-10-25T23:38:03.235 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/185/12' -> 'copyofsnap1/test1/185/12' 2023-10-25T23:38:03.236 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/185/13' -> 'copyofsnap1/test1/185/13' 2023-10-25T23:38:03.236 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/185/14' -> 'copyofsnap1/test1/185/14' 2023-10-25T23:38:03.236 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/185/15' -> 'copyofsnap1/test1/185/15' 2023-10-25T23:38:03.236 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/185/16' -> 'copyofsnap1/test1/185/16' 2023-10-25T23:38:03.236 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/185/17' -> 'copyofsnap1/test1/185/17' 2023-10-25T23:38:03.236 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/185/18' -> 'copyofsnap1/test1/185/18' 2023-10-25T23:38:03.237 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/185/19' -> 'copyofsnap1/test1/185/19' 2023-10-25T23:38:03.237 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/185/20' -> 'copyofsnap1/test1/185/20' 2023-10-25T23:38:03.237 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/186' -> 'copyofsnap1/test1/186' 2023-10-25T23:38:03.237 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/186/10' -> 'copyofsnap1/test1/186/10' 2023-10-25T23:38:03.238 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/186/11' -> 'copyofsnap1/test1/186/11' 2023-10-25T23:38:03.238 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/186/12' -> 'copyofsnap1/test1/186/12' 2023-10-25T23:38:03.238 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/186/13' -> 'copyofsnap1/test1/186/13' 2023-10-25T23:38:03.238 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/186/14' -> 'copyofsnap1/test1/186/14' 2023-10-25T23:38:03.238 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/186/15' -> 'copyofsnap1/test1/186/15' 2023-10-25T23:38:03.238 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/186/16' -> 'copyofsnap1/test1/186/16' 2023-10-25T23:38:03.239 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/186/17' -> 'copyofsnap1/test1/186/17' 2023-10-25T23:38:03.239 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/186/18' -> 'copyofsnap1/test1/186/18' 2023-10-25T23:38:03.239 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/186/19' -> 'copyofsnap1/test1/186/19' 2023-10-25T23:38:03.239 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/186/20' -> 'copyofsnap1/test1/186/20' 2023-10-25T23:38:03.239 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/187' -> 'copyofsnap1/test1/187' 2023-10-25T23:38:03.240 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/187/10' -> 'copyofsnap1/test1/187/10' 2023-10-25T23:38:03.240 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/187/11' -> 'copyofsnap1/test1/187/11' 2023-10-25T23:38:03.240 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/187/12' -> 'copyofsnap1/test1/187/12' 2023-10-25T23:38:03.240 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/187/13' -> 'copyofsnap1/test1/187/13' 2023-10-25T23:38:03.240 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/187/14' -> 'copyofsnap1/test1/187/14' 2023-10-25T23:38:03.241 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/187/15' -> 'copyofsnap1/test1/187/15' 2023-10-25T23:38:03.241 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/187/16' -> 'copyofsnap1/test1/187/16' 2023-10-25T23:38:03.241 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/187/17' -> 'copyofsnap1/test1/187/17' 2023-10-25T23:38:03.379 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/187/18' -> 'copyofsnap1/test1/187/18' 2023-10-25T23:38:03.379 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/187/19' -> 'copyofsnap1/test1/187/19' 2023-10-25T23:38:03.381 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/187/20' -> 'copyofsnap1/test1/187/20' 2023-10-25T23:38:03.381 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/188' -> 'copyofsnap1/test1/188' 2023-10-25T23:38:03.381 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/188/10' -> 'copyofsnap1/test1/188/10' 2023-10-25T23:38:03.382 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/188/11' -> 'copyofsnap1/test1/188/11' 2023-10-25T23:38:03.382 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/188/12' -> 'copyofsnap1/test1/188/12' 2023-10-25T23:38:03.382 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/188/13' -> 'copyofsnap1/test1/188/13' 2023-10-25T23:38:03.382 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/188/14' -> 'copyofsnap1/test1/188/14' 2023-10-25T23:38:03.382 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/188/15' -> 'copyofsnap1/test1/188/15' 2023-10-25T23:38:03.383 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/188/16' -> 'copyofsnap1/test1/188/16' 2023-10-25T23:38:03.383 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/188/17' -> 'copyofsnap1/test1/188/17' 2023-10-25T23:38:03.383 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/188/18' -> 'copyofsnap1/test1/188/18' 2023-10-25T23:38:03.383 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/188/19' -> 'copyofsnap1/test1/188/19' 2023-10-25T23:38:03.384 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/188/20' -> 'copyofsnap1/test1/188/20' 2023-10-25T23:38:03.384 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/189' -> 'copyofsnap1/test1/189' 2023-10-25T23:38:03.384 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/189/10' -> 'copyofsnap1/test1/189/10' 2023-10-25T23:38:03.385 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/189/11' -> 'copyofsnap1/test1/189/11' 2023-10-25T23:38:03.385 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/189/12' -> 'copyofsnap1/test1/189/12' 2023-10-25T23:38:03.385 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/189/13' -> 'copyofsnap1/test1/189/13' 2023-10-25T23:38:03.385 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/189/14' -> 'copyofsnap1/test1/189/14' 2023-10-25T23:38:03.386 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/189/15' -> 'copyofsnap1/test1/189/15' 2023-10-25T23:38:03.386 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/189/16' -> 'copyofsnap1/test1/189/16' 2023-10-25T23:38:03.386 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/189/17' -> 'copyofsnap1/test1/189/17' 2023-10-25T23:38:03.386 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/189/18' -> 'copyofsnap1/test1/189/18' 2023-10-25T23:38:03.387 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/189/19' -> 'copyofsnap1/test1/189/19' 2023-10-25T23:38:03.387 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/189/20' -> 'copyofsnap1/test1/189/20' 2023-10-25T23:38:03.387 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/190' -> 'copyofsnap1/test1/190' 2023-10-25T23:38:03.387 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/190/10' -> 'copyofsnap1/test1/190/10' 2023-10-25T23:38:03.387 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/190/11' -> 'copyofsnap1/test1/190/11' 2023-10-25T23:38:03.387 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/190/12' -> 'copyofsnap1/test1/190/12' 2023-10-25T23:38:03.388 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/190/13' -> 'copyofsnap1/test1/190/13' 2023-10-25T23:38:03.388 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/190/14' -> 'copyofsnap1/test1/190/14' 2023-10-25T23:38:03.388 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/190/15' -> 'copyofsnap1/test1/190/15' 2023-10-25T23:38:03.388 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/190/16' -> 'copyofsnap1/test1/190/16' 2023-10-25T23:38:03.388 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/190/17' -> 'copyofsnap1/test1/190/17' 2023-10-25T23:38:03.389 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/190/18' -> 'copyofsnap1/test1/190/18' 2023-10-25T23:38:03.389 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/190/19' -> 'copyofsnap1/test1/190/19' 2023-10-25T23:38:03.389 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/190/20' -> 'copyofsnap1/test1/190/20' 2023-10-25T23:38:03.389 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/191' -> 'copyofsnap1/test1/191' 2023-10-25T23:38:03.389 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/191/10' -> 'copyofsnap1/test1/191/10' 2023-10-25T23:38:03.390 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/191/11' -> 'copyofsnap1/test1/191/11' 2023-10-25T23:38:03.390 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/191/12' -> 'copyofsnap1/test1/191/12' 2023-10-25T23:38:03.390 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/191/13' -> 'copyofsnap1/test1/191/13' 2023-10-25T23:38:03.390 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/191/14' -> 'copyofsnap1/test1/191/14' 2023-10-25T23:38:03.390 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/191/15' -> 'copyofsnap1/test1/191/15' 2023-10-25T23:38:03.391 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/191/16' -> 'copyofsnap1/test1/191/16' 2023-10-25T23:38:03.391 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/191/17' -> 'copyofsnap1/test1/191/17' 2023-10-25T23:38:03.391 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/191/18' -> 'copyofsnap1/test1/191/18' 2023-10-25T23:38:03.391 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/191/19' -> 'copyofsnap1/test1/191/19' 2023-10-25T23:38:03.391 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/191/20' -> 'copyofsnap1/test1/191/20' 2023-10-25T23:38:03.392 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/192' -> 'copyofsnap1/test1/192' 2023-10-25T23:38:03.392 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/192/10' -> 'copyofsnap1/test1/192/10' 2023-10-25T23:38:03.392 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/192/11' -> 'copyofsnap1/test1/192/11' 2023-10-25T23:38:03.392 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/192/12' -> 'copyofsnap1/test1/192/12' 2023-10-25T23:38:03.392 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/192/13' -> 'copyofsnap1/test1/192/13' 2023-10-25T23:38:03.393 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/192/14' -> 'copyofsnap1/test1/192/14' 2023-10-25T23:38:03.393 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/192/15' -> 'copyofsnap1/test1/192/15' 2023-10-25T23:38:03.393 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/192/16' -> 'copyofsnap1/test1/192/16' 2023-10-25T23:38:03.393 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/192/17' -> 'copyofsnap1/test1/192/17' 2023-10-25T23:38:03.393 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/192/18' -> 'copyofsnap1/test1/192/18' 2023-10-25T23:38:03.394 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/192/19' -> 'copyofsnap1/test1/192/19' 2023-10-25T23:38:03.394 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/192/20' -> 'copyofsnap1/test1/192/20' 2023-10-25T23:38:03.394 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/193' -> 'copyofsnap1/test1/193' 2023-10-25T23:38:03.394 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/193/10' -> 'copyofsnap1/test1/193/10' 2023-10-25T23:38:03.395 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/193/11' -> 'copyofsnap1/test1/193/11' 2023-10-25T23:38:03.395 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/193/12' -> 'copyofsnap1/test1/193/12' 2023-10-25T23:38:03.395 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/193/13' -> 'copyofsnap1/test1/193/13' 2023-10-25T23:38:03.395 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/193/14' -> 'copyofsnap1/test1/193/14' 2023-10-25T23:38:03.395 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/193/15' -> 'copyofsnap1/test1/193/15' 2023-10-25T23:38:03.396 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/193/16' -> 'copyofsnap1/test1/193/16' 2023-10-25T23:38:03.396 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/193/17' -> 'copyofsnap1/test1/193/17' 2023-10-25T23:38:03.396 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/193/18' -> 'copyofsnap1/test1/193/18' 2023-10-25T23:38:03.396 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/193/19' -> 'copyofsnap1/test1/193/19' 2023-10-25T23:38:03.396 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/193/20' -> 'copyofsnap1/test1/193/20' 2023-10-25T23:38:03.396 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/194' -> 'copyofsnap1/test1/194' 2023-10-25T23:38:03.397 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/194/10' -> 'copyofsnap1/test1/194/10' 2023-10-25T23:38:03.397 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/194/11' -> 'copyofsnap1/test1/194/11' 2023-10-25T23:38:03.397 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/194/12' -> 'copyofsnap1/test1/194/12' 2023-10-25T23:38:03.397 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/194/13' -> 'copyofsnap1/test1/194/13' 2023-10-25T23:38:03.397 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/194/14' -> 'copyofsnap1/test1/194/14' 2023-10-25T23:38:03.496 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/194/15' -> 'copyofsnap1/test1/194/15' 2023-10-25T23:38:03.496 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/194/16' -> 'copyofsnap1/test1/194/16' 2023-10-25T23:38:03.496 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/194/17' -> 'copyofsnap1/test1/194/17' 2023-10-25T23:38:03.497 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/194/18' -> 'copyofsnap1/test1/194/18' 2023-10-25T23:38:03.497 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/194/19' -> 'copyofsnap1/test1/194/19' 2023-10-25T23:38:03.497 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/194/20' -> 'copyofsnap1/test1/194/20' 2023-10-25T23:38:03.497 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/195' -> 'copyofsnap1/test1/195' 2023-10-25T23:38:03.497 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/195/10' -> 'copyofsnap1/test1/195/10' 2023-10-25T23:38:03.498 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/195/11' -> 'copyofsnap1/test1/195/11' 2023-10-25T23:38:03.498 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/195/12' -> 'copyofsnap1/test1/195/12' 2023-10-25T23:38:03.498 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/195/13' -> 'copyofsnap1/test1/195/13' 2023-10-25T23:38:03.498 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/195/14' -> 'copyofsnap1/test1/195/14' 2023-10-25T23:38:03.498 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/195/15' -> 'copyofsnap1/test1/195/15' 2023-10-25T23:38:03.499 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/195/16' -> 'copyofsnap1/test1/195/16' 2023-10-25T23:38:03.499 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/195/17' -> 'copyofsnap1/test1/195/17' 2023-10-25T23:38:03.499 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/195/18' -> 'copyofsnap1/test1/195/18' 2023-10-25T23:38:03.499 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/195/19' -> 'copyofsnap1/test1/195/19' 2023-10-25T23:38:03.499 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/195/20' -> 'copyofsnap1/test1/195/20' 2023-10-25T23:38:03.500 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/196' -> 'copyofsnap1/test1/196' 2023-10-25T23:38:03.500 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/196/10' -> 'copyofsnap1/test1/196/10' 2023-10-25T23:38:03.500 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/196/11' -> 'copyofsnap1/test1/196/11' 2023-10-25T23:38:03.501 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/196/12' -> 'copyofsnap1/test1/196/12' 2023-10-25T23:38:03.501 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/196/13' -> 'copyofsnap1/test1/196/13' 2023-10-25T23:38:03.502 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/196/14' -> 'copyofsnap1/test1/196/14' 2023-10-25T23:38:03.502 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/196/15' -> 'copyofsnap1/test1/196/15' 2023-10-25T23:38:03.502 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/196/16' -> 'copyofsnap1/test1/196/16' 2023-10-25T23:38:03.503 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/196/17' -> 'copyofsnap1/test1/196/17' 2023-10-25T23:38:03.503 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/196/18' -> 'copyofsnap1/test1/196/18' 2023-10-25T23:38:03.503 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/196/19' -> 'copyofsnap1/test1/196/19' 2023-10-25T23:38:03.504 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/196/20' -> 'copyofsnap1/test1/196/20' 2023-10-25T23:38:03.504 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/197' -> 'copyofsnap1/test1/197' 2023-10-25T23:38:03.505 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/197/10' -> 'copyofsnap1/test1/197/10' 2023-10-25T23:38:03.505 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/197/11' -> 'copyofsnap1/test1/197/11' 2023-10-25T23:38:03.505 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/197/12' -> 'copyofsnap1/test1/197/12' 2023-10-25T23:38:03.506 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/197/13' -> 'copyofsnap1/test1/197/13' 2023-10-25T23:38:03.506 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/197/14' -> 'copyofsnap1/test1/197/14' 2023-10-25T23:38:03.506 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/197/15' -> 'copyofsnap1/test1/197/15' 2023-10-25T23:38:03.507 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/197/16' -> 'copyofsnap1/test1/197/16' 2023-10-25T23:38:03.507 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/197/17' -> 'copyofsnap1/test1/197/17' 2023-10-25T23:38:03.507 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/197/18' -> 'copyofsnap1/test1/197/18' 2023-10-25T23:38:03.508 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/197/19' -> 'copyofsnap1/test1/197/19' 2023-10-25T23:38:03.508 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/197/20' -> 'copyofsnap1/test1/197/20' 2023-10-25T23:38:03.508 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/198' -> 'copyofsnap1/test1/198' 2023-10-25T23:38:03.509 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/198/10' -> 'copyofsnap1/test1/198/10' 2023-10-25T23:38:03.509 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/198/11' -> 'copyofsnap1/test1/198/11' 2023-10-25T23:38:03.509 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/198/12' -> 'copyofsnap1/test1/198/12' 2023-10-25T23:38:03.509 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/198/13' -> 'copyofsnap1/test1/198/13' 2023-10-25T23:38:03.509 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/198/14' -> 'copyofsnap1/test1/198/14' 2023-10-25T23:38:03.510 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/198/15' -> 'copyofsnap1/test1/198/15' 2023-10-25T23:38:03.510 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/198/16' -> 'copyofsnap1/test1/198/16' 2023-10-25T23:38:03.510 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/198/17' -> 'copyofsnap1/test1/198/17' 2023-10-25T23:38:03.511 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/198/18' -> 'copyofsnap1/test1/198/18' 2023-10-25T23:38:03.511 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/198/19' -> 'copyofsnap1/test1/198/19' 2023-10-25T23:38:03.511 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/198/20' -> 'copyofsnap1/test1/198/20' 2023-10-25T23:38:03.511 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/199' -> 'copyofsnap1/test1/199' 2023-10-25T23:38:03.511 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/199/10' -> 'copyofsnap1/test1/199/10' 2023-10-25T23:38:03.511 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/199/11' -> 'copyofsnap1/test1/199/11' 2023-10-25T23:38:03.512 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/199/12' -> 'copyofsnap1/test1/199/12' 2023-10-25T23:38:03.512 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/199/13' -> 'copyofsnap1/test1/199/13' 2023-10-25T23:38:03.512 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/199/14' -> 'copyofsnap1/test1/199/14' 2023-10-25T23:38:03.512 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/199/15' -> 'copyofsnap1/test1/199/15' 2023-10-25T23:38:03.512 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/199/16' -> 'copyofsnap1/test1/199/16' 2023-10-25T23:38:03.513 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/199/17' -> 'copyofsnap1/test1/199/17' 2023-10-25T23:38:03.513 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/199/18' -> 'copyofsnap1/test1/199/18' 2023-10-25T23:38:03.513 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/199/19' -> 'copyofsnap1/test1/199/19' 2023-10-25T23:38:03.513 INFO:tasks.workunit.client.0.smithi081.stdout:'.snap/test1/199/20' -> 'copyofsnap1/test1/199/20' 2023-10-25T23:38:03.513 INFO:tasks.workunit.client.0.smithi081.stdout:Take third snapshot .snap/test3 2023-10-25T23:38:03.530 INFO:tasks.workunit.client.0.smithi081.stdout:Delete the snapshots... 2023-10-25T23:38:03.772 INFO:tasks.workunit.client.0.smithi081.stdout:.//.snap/test1 2023-10-25T23:38:03.773 INFO:tasks.workunit.client.0.smithi081.stdout:.//.snap/test2 2023-10-25T23:38:03.773 INFO:tasks.workunit.client.0.smithi081.stdout:.//.snap/test3 2023-10-25T23:38:03.776 INFO:tasks.workunit.client.0.smithi081.stdout:./274/.snap/snap-subdir-test 2023-10-25T23:38:03.779 INFO:tasks.workunit.client.0.smithi081.stdout:./166/.snap/snap-subdir-test 2023-10-25T23:38:03.783 INFO:tasks.workunit.client.0.smithi081.stdout:./256/.snap/snap-subdir-test 2023-10-25T23:38:03.789 INFO:tasks.workunit.client.0.smithi081.stdout:./247/.snap/snap-subdir-test 2023-10-25T23:38:03.791 INFO:tasks.workunit.client.0.smithi081.stdout:./248/.snap/snap-subdir-test 2023-10-25T23:38:03.795 INFO:tasks.workunit.client.0.smithi081.stdout:./147/.snap/snap-subdir-test 2023-10-25T23:38:03.800 INFO:tasks.workunit.client.0.smithi081.stdout:./151/.snap/snap-subdir-test 2023-10-25T23:38:03.804 INFO:tasks.workunit.client.0.smithi081.stdout:./170/.snap/snap-subdir-test 2023-10-25T23:38:03.808 INFO:tasks.workunit.client.0.smithi081.stdout:./167/.snap/snap-subdir-test 2023-10-25T23:38:03.812 INFO:tasks.workunit.client.0.smithi081.stdout:./140/.snap/snap-subdir-test 2023-10-25T23:38:03.816 INFO:tasks.workunit.client.0.smithi081.stdout:./142/.snap/snap-subdir-test 2023-10-25T23:38:03.820 INFO:tasks.workunit.client.0.smithi081.stdout:./150/.snap/snap-subdir-test 2023-10-25T23:38:03.824 INFO:tasks.workunit.client.0.smithi081.stdout:./273/.snap/snap-subdir-test 2023-10-25T23:38:03.828 INFO:tasks.workunit.client.0.smithi081.stdout:./269/.snap/snap-subdir-test 2023-10-25T23:38:03.832 INFO:tasks.workunit.client.0.smithi081.stdout:./105/.snap/snap-subdir-test 2023-10-25T23:38:03.836 INFO:tasks.workunit.client.0.smithi081.stdout:./210/.snap/snap-subdir-test 2023-10-25T23:38:03.840 INFO:tasks.workunit.client.0.smithi081.stdout:./265/.snap/snap-subdir-test 2023-10-25T23:38:03.844 INFO:tasks.workunit.client.0.smithi081.stdout:./218/.snap/snap-subdir-test 2023-10-25T23:38:03.848 INFO:tasks.workunit.client.0.smithi081.stdout:./290/.snap/snap-subdir-test 2023-10-25T23:38:03.852 INFO:tasks.workunit.client.0.smithi081.stdout:./149/.snap/snap-subdir-test 2023-10-25T23:38:03.856 INFO:tasks.workunit.client.0.smithi081.stdout:./109/.snap/snap-subdir-test 2023-10-25T23:38:03.860 INFO:tasks.workunit.client.0.smithi081.stdout:./292/.snap/snap-subdir-test 2023-10-25T23:38:03.864 INFO:tasks.workunit.client.0.smithi081.stdout:./242/.snap/snap-subdir-test 2023-10-25T23:38:03.869 INFO:tasks.workunit.client.0.smithi081.stdout:./158/.snap/snap-subdir-test 2023-10-25T23:38:03.873 INFO:tasks.workunit.client.0.smithi081.stdout:./243/.snap/snap-subdir-test 2023-10-25T23:38:03.877 INFO:tasks.workunit.client.0.smithi081.stdout:./106/.snap/snap-subdir-test 2023-10-25T23:38:03.881 INFO:tasks.workunit.client.0.smithi081.stdout:./250/.snap/snap-subdir-test 2023-10-25T23:38:03.885 INFO:tasks.workunit.client.0.smithi081.stdout:./221/.snap/snap-subdir-test 2023-10-25T23:38:03.888 INFO:tasks.workunit.client.0.smithi081.stdout:./244/.snap/snap-subdir-test 2023-10-25T23:38:03.892 INFO:tasks.workunit.client.0.smithi081.stdout:./258/.snap/snap-subdir-test 2023-10-25T23:38:03.896 INFO:tasks.workunit.client.0.smithi081.stdout:./268/.snap/snap-subdir-test 2023-10-25T23:38:03.900 INFO:tasks.workunit.client.0.smithi081.stdout:./189/.snap/snap-subdir-test 2023-10-25T23:38:03.904 INFO:tasks.workunit.client.0.smithi081.stdout:./285/.snap/snap-subdir-test 2023-10-25T23:38:03.908 INFO:tasks.workunit.client.0.smithi081.stdout:./208/.snap/snap-subdir-test 2023-10-25T23:38:03.912 INFO:tasks.workunit.client.0.smithi081.stdout:./288/.snap/snap-subdir-test 2023-10-25T23:38:03.916 INFO:tasks.workunit.client.0.smithi081.stdout:./209/.snap/snap-subdir-test 2023-10-25T23:38:03.920 INFO:tasks.workunit.client.0.smithi081.stdout:./253/.snap/snap-subdir-test 2023-10-25T23:38:03.924 INFO:tasks.workunit.client.0.smithi081.stdout:./249/.snap/snap-subdir-test 2023-10-25T23:38:03.928 INFO:tasks.workunit.client.0.smithi081.stdout:./133/.snap/snap-subdir-test 2023-10-25T23:38:03.933 INFO:tasks.workunit.client.0.smithi081.stdout:./291/.snap/snap-subdir-test 2023-10-25T23:38:03.936 INFO:tasks.workunit.client.0.smithi081.stdout:./226/.snap/snap-subdir-test 2023-10-25T23:38:03.940 INFO:tasks.workunit.client.0.smithi081.stdout:./173/.snap/snap-subdir-test 2023-10-25T23:38:03.944 INFO:tasks.workunit.client.0.smithi081.stdout:./174/.snap/snap-subdir-test 2023-10-25T23:38:03.948 INFO:tasks.workunit.client.0.smithi081.stdout:./299/.snap/snap-subdir-test 2023-10-25T23:38:03.952 INFO:tasks.workunit.client.0.smithi081.stdout:./262/.snap/snap-subdir-test 2023-10-25T23:38:03.955 INFO:tasks.workunit.client.0.smithi081.stdout:./231/.snap/snap-subdir-test 2023-10-25T23:38:03.959 INFO:tasks.workunit.client.0.smithi081.stdout:./214/.snap/snap-subdir-test 2023-10-25T23:38:03.963 INFO:tasks.workunit.client.0.smithi081.stdout:./281/.snap/snap-subdir-test 2023-10-25T23:38:03.967 INFO:tasks.workunit.client.0.smithi081.stdout:./289/.snap/snap-subdir-test 2023-10-25T23:38:03.970 INFO:tasks.workunit.client.0.smithi081.stdout:./283/.snap/snap-subdir-test 2023-10-25T23:38:03.974 INFO:tasks.workunit.client.0.smithi081.stdout:./232/.snap/snap-subdir-test 2023-10-25T23:38:03.978 INFO:tasks.workunit.client.0.smithi081.stdout:./298/.snap/snap-subdir-test 2023-10-25T23:38:03.982 INFO:tasks.workunit.client.0.smithi081.stdout:./233/.snap/snap-subdir-test 2023-10-25T23:38:03.986 INFO:tasks.workunit.client.0.smithi081.stdout:./155/.snap/snap-subdir-test 2023-10-25T23:38:03.989 INFO:tasks.workunit.client.0.smithi081.stdout:./114/.snap/snap-subdir-test 2023-10-25T23:38:03.994 INFO:tasks.workunit.client.0.smithi081.stdout:./159/.snap/snap-subdir-test 2023-10-25T23:38:03.998 INFO:tasks.workunit.client.0.smithi081.stdout:./187/.snap/snap-subdir-test 2023-10-25T23:38:04.002 INFO:tasks.workunit.client.0.smithi081.stdout:./185/.snap/snap-subdir-test 2023-10-25T23:38:04.006 INFO:tasks.workunit.client.0.smithi081.stdout:./293/.snap/snap-subdir-test 2023-10-25T23:38:04.010 INFO:tasks.workunit.client.0.smithi081.stdout:./228/.snap/snap-subdir-test 2023-10-25T23:38:04.014 INFO:tasks.workunit.client.0.smithi081.stdout:./120/.snap/snap-subdir-test 2023-10-25T23:38:04.018 INFO:tasks.workunit.client.0.smithi081.stdout:./110/.snap/snap-subdir-test 2023-10-25T23:38:04.022 INFO:tasks.workunit.client.0.smithi081.stdout:./267/.snap/snap-subdir-test 2023-10-25T23:38:04.026 INFO:tasks.workunit.client.0.smithi081.stdout:./202/.snap/snap-subdir-test 2023-10-25T23:38:04.030 INFO:tasks.workunit.client.0.smithi081.stdout:./137/.snap/snap-subdir-test 2023-10-25T23:38:04.034 INFO:tasks.workunit.client.0.smithi081.stdout:./246/.snap/snap-subdir-test 2023-10-25T23:38:04.038 INFO:tasks.workunit.client.0.smithi081.stdout:./219/.snap/snap-subdir-test 2023-10-25T23:38:04.042 INFO:tasks.workunit.client.0.smithi081.stdout:./198/.snap/snap-subdir-test 2023-10-25T23:38:04.045 INFO:tasks.workunit.client.0.smithi081.stdout:./136/.snap/snap-subdir-test 2023-10-25T23:38:04.049 INFO:tasks.workunit.client.0.smithi081.stdout:./270/.snap/snap-subdir-test 2023-10-25T23:38:04.053 INFO:tasks.workunit.client.0.smithi081.stdout:./125/.snap/snap-subdir-test 2023-10-25T23:38:04.057 INFO:tasks.workunit.client.0.smithi081.stdout:./194/.snap/snap-subdir-test 2023-10-25T23:38:04.061 INFO:tasks.workunit.client.0.smithi081.stdout:./119/.snap/snap-subdir-test 2023-10-25T23:38:04.064 INFO:tasks.workunit.client.0.smithi081.stdout:./297/.snap/snap-subdir-test 2023-10-25T23:38:04.068 INFO:tasks.workunit.client.0.smithi081.stdout:./230/.snap/snap-subdir-test 2023-10-25T23:38:04.072 INFO:tasks.workunit.client.0.smithi081.stdout:./260/.snap/snap-subdir-test 2023-10-25T23:38:04.075 INFO:tasks.workunit.client.0.smithi081.stdout:./157/.snap/snap-subdir-test 2023-10-25T23:38:04.079 INFO:tasks.workunit.client.0.smithi081.stdout:./172/.snap/snap-subdir-test 2023-10-25T23:38:04.083 INFO:tasks.workunit.client.0.smithi081.stdout:./277/.snap/snap-subdir-test 2023-10-25T23:38:04.087 INFO:tasks.workunit.client.0.smithi081.stdout:./186/.snap/snap-subdir-test 2023-10-25T23:38:04.090 INFO:tasks.workunit.client.0.smithi081.stdout:./237/.snap/snap-subdir-test 2023-10-25T23:38:04.094 INFO:tasks.workunit.client.0.smithi081.stdout:./190/.snap/snap-subdir-test 2023-10-25T23:38:04.098 INFO:tasks.workunit.client.0.smithi081.stdout:./213/.snap/snap-subdir-test 2023-10-25T23:38:04.101 INFO:tasks.workunit.client.0.smithi081.stdout:./104/.snap/snap-subdir-test 2023-10-25T23:38:04.105 INFO:tasks.workunit.client.0.smithi081.stdout:./164/.snap/snap-subdir-test 2023-10-25T23:38:04.109 INFO:tasks.workunit.client.0.smithi081.stdout:./112/.snap/snap-subdir-test 2023-10-25T23:38:04.113 INFO:tasks.workunit.client.0.smithi081.stdout:./295/.snap/snap-subdir-test 2023-10-25T23:38:04.116 INFO:tasks.workunit.client.0.smithi081.stdout:./272/.snap/snap-subdir-test 2023-10-25T23:38:04.120 INFO:tasks.workunit.client.0.smithi081.stdout:./100/.snap/snap-subdir-test 2023-10-25T23:38:04.124 INFO:tasks.workunit.client.0.smithi081.stdout:./134/.snap/snap-subdir-test 2023-10-25T23:38:04.127 INFO:tasks.workunit.client.0.smithi081.stdout:./200/.snap/snap-subdir-test 2023-10-25T23:38:04.131 INFO:tasks.workunit.client.0.smithi081.stdout:./115/.snap/snap-subdir-test 2023-10-25T23:38:04.135 INFO:tasks.workunit.client.0.smithi081.stdout:./284/.snap/snap-subdir-test 2023-10-25T23:38:04.138 INFO:tasks.workunit.client.0.smithi081.stdout:./280/.snap/snap-subdir-test 2023-10-25T23:38:04.142 INFO:tasks.workunit.client.0.smithi081.stdout:./116/.snap/snap-subdir-test 2023-10-25T23:38:04.146 INFO:tasks.workunit.client.0.smithi081.stdout:./245/.snap/snap-subdir-test 2023-10-25T23:38:04.149 INFO:tasks.workunit.client.0.smithi081.stdout:./195/.snap/snap-subdir-test 2023-10-25T23:38:04.153 INFO:tasks.workunit.client.0.smithi081.stdout:./138/.snap/snap-subdir-test 2023-10-25T23:38:04.157 INFO:tasks.workunit.client.0.smithi081.stdout:./135/.snap/snap-subdir-test 2023-10-25T23:38:04.161 INFO:tasks.workunit.client.0.smithi081.stdout:./117/.snap/snap-subdir-test 2023-10-25T23:38:04.164 INFO:tasks.workunit.client.0.smithi081.stdout:./241/.snap/snap-subdir-test 2023-10-25T23:38:04.168 INFO:tasks.workunit.client.0.smithi081.stdout:./143/.snap/snap-subdir-test 2023-10-25T23:38:04.172 INFO:tasks.workunit.client.0.smithi081.stdout:./180/.snap/snap-subdir-test 2023-10-25T23:38:04.175 INFO:tasks.workunit.client.0.smithi081.stdout:./126/.snap/snap-subdir-test 2023-10-25T23:38:04.179 INFO:tasks.workunit.client.0.smithi081.stdout:./161/.snap/snap-subdir-test 2023-10-25T23:38:04.183 INFO:tasks.workunit.client.0.smithi081.stdout:./204/.snap/snap-subdir-test 2023-10-25T23:38:04.187 INFO:tasks.workunit.client.0.smithi081.stdout:./176/.snap/snap-subdir-test 2023-10-25T23:38:04.191 INFO:tasks.workunit.client.0.smithi081.stdout:./255/.snap/snap-subdir-test 2023-10-25T23:38:04.197 INFO:tasks.workunit.client.0.smithi081.stdout:./215/.snap/snap-subdir-test 2023-10-25T23:38:04.199 INFO:tasks.workunit.client.0.smithi081.stdout:./111/.snap/snap-subdir-test 2023-10-25T23:38:04.203 INFO:tasks.workunit.client.0.smithi081.stdout:./238/.snap/snap-subdir-test 2023-10-25T23:38:04.207 INFO:tasks.workunit.client.0.smithi081.stdout:./191/.snap/snap-subdir-test 2023-10-25T23:38:04.211 INFO:tasks.workunit.client.0.smithi081.stdout:./184/.snap/snap-subdir-test 2023-10-25T23:38:04.215 INFO:tasks.workunit.client.0.smithi081.stdout:./192/.snap/snap-subdir-test 2023-10-25T23:38:04.219 INFO:tasks.workunit.client.0.smithi081.stdout:./103/.snap/snap-subdir-test 2023-10-25T23:38:04.223 INFO:tasks.workunit.client.0.smithi081.stdout:./128/.snap/snap-subdir-test 2023-10-25T23:38:04.227 INFO:tasks.workunit.client.0.smithi081.stdout:./229/.snap/snap-subdir-test 2023-10-25T23:38:04.231 INFO:tasks.workunit.client.0.smithi081.stdout:./144/.snap/snap-subdir-test 2023-10-25T23:38:04.235 INFO:tasks.workunit.client.0.smithi081.stdout:./146/.snap/snap-subdir-test 2023-10-25T23:38:04.239 INFO:tasks.workunit.client.0.smithi081.stdout:./227/.snap/snap-subdir-test 2023-10-25T23:38:04.244 INFO:tasks.workunit.client.0.smithi081.stdout:./278/.snap/snap-subdir-test 2023-10-25T23:38:04.248 INFO:tasks.workunit.client.0.smithi081.stdout:./141/.snap/snap-subdir-test 2023-10-25T23:38:04.252 INFO:tasks.workunit.client.0.smithi081.stdout:./234/.snap/snap-subdir-test 2023-10-25T23:38:04.255 INFO:tasks.workunit.client.0.smithi081.stdout:./225/.snap/snap-subdir-test 2023-10-25T23:38:04.259 INFO:tasks.workunit.client.0.smithi081.stdout:./182/.snap/snap-subdir-test 2023-10-25T23:38:04.263 INFO:tasks.workunit.client.0.smithi081.stdout:./107/.snap/snap-subdir-test 2023-10-25T23:38:04.266 INFO:tasks.workunit.client.0.smithi081.stdout:./178/.snap/snap-subdir-test 2023-10-25T23:38:04.270 INFO:tasks.workunit.client.0.smithi081.stdout:./266/.snap/snap-subdir-test 2023-10-25T23:38:04.275 INFO:tasks.workunit.client.0.smithi081.stdout:./240/.snap/snap-subdir-test 2023-10-25T23:38:04.279 INFO:tasks.workunit.client.0.smithi081.stdout:./156/.snap/snap-subdir-test 2023-10-25T23:38:04.283 INFO:tasks.workunit.client.0.smithi081.stdout:./131/.snap/snap-subdir-test 2023-10-25T23:38:04.287 INFO:tasks.workunit.client.0.smithi081.stdout:./123/.snap/snap-subdir-test 2023-10-25T23:38:04.291 INFO:tasks.workunit.client.0.smithi081.stdout:./160/.snap/snap-subdir-test 2023-10-25T23:38:04.294 INFO:tasks.workunit.client.0.smithi081.stdout:./165/.snap/snap-subdir-test 2023-10-25T23:38:04.298 INFO:tasks.workunit.client.0.smithi081.stdout:./101/.snap/snap-subdir-test 2023-10-25T23:38:04.301 INFO:tasks.workunit.client.0.smithi081.stdout:./148/.snap/snap-subdir-test 2023-10-25T23:38:04.305 INFO:tasks.workunit.client.0.smithi081.stdout:./168/.snap/snap-subdir-test 2023-10-25T23:38:04.310 INFO:tasks.workunit.client.0.smithi081.stdout:./179/.snap/snap-subdir-test 2023-10-25T23:38:04.314 INFO:tasks.workunit.client.0.smithi081.stdout:./257/.snap/snap-subdir-test 2023-10-25T23:38:04.318 INFO:tasks.workunit.client.0.smithi081.stdout:./252/.snap/snap-subdir-test 2023-10-25T23:38:04.321 INFO:tasks.workunit.client.0.smithi081.stdout:./132/.snap/snap-subdir-test 2023-10-25T23:38:04.326 INFO:tasks.workunit.client.0.smithi081.stdout:./236/.snap/snap-subdir-test 2023-10-25T23:38:04.330 INFO:tasks.workunit.client.0.smithi081.stdout:./211/.snap/snap-subdir-test 2023-10-25T23:38:04.334 INFO:tasks.workunit.client.0.smithi081.stdout:./199/.snap/snap-subdir-test 2023-10-25T23:38:04.338 INFO:tasks.workunit.client.0.smithi081.stdout:./205/.snap/snap-subdir-test 2023-10-25T23:38:04.343 INFO:tasks.workunit.client.0.smithi081.stdout:./163/.snap/snap-subdir-test 2023-10-25T23:38:04.347 INFO:tasks.workunit.client.0.smithi081.stdout:./261/.snap/snap-subdir-test 2023-10-25T23:38:04.350 INFO:tasks.workunit.client.0.smithi081.stdout:./201/.snap/snap-subdir-test 2023-10-25T23:38:04.355 INFO:tasks.workunit.client.0.smithi081.stdout:./282/.snap/snap-subdir-test 2023-10-25T23:38:04.358 INFO:tasks.workunit.client.0.smithi081.stdout:./296/.snap/snap-subdir-test 2023-10-25T23:38:04.362 INFO:tasks.workunit.client.0.smithi081.stdout:./217/.snap/snap-subdir-test 2023-10-25T23:38:04.365 INFO:tasks.workunit.client.0.smithi081.stdout:./153/.snap/snap-subdir-test 2023-10-25T23:38:04.369 INFO:tasks.workunit.client.0.smithi081.stdout:./206/.snap/snap-subdir-test 2023-10-25T23:38:04.372 INFO:tasks.workunit.client.0.smithi081.stdout:./122/.snap/snap-subdir-test 2023-10-25T23:38:04.376 INFO:tasks.workunit.client.0.smithi081.stdout:./162/.snap/snap-subdir-test 2023-10-25T23:38:04.380 INFO:tasks.workunit.client.0.smithi081.stdout:./197/.snap/snap-subdir-test 2023-10-25T23:38:04.383 INFO:tasks.workunit.client.0.smithi081.stdout:./216/.snap/snap-subdir-test 2023-10-25T23:38:04.643 INFO:tasks.workunit.client.0.smithi081.stdout:./254/.snap/snap-subdir-test 2023-10-25T23:38:04.646 INFO:tasks.workunit.client.0.smithi081.stdout:./113/.snap/snap-subdir-test 2023-10-25T23:38:04.650 INFO:tasks.workunit.client.0.smithi081.stdout:./152/.snap/snap-subdir-test 2023-10-25T23:38:04.654 INFO:tasks.workunit.client.0.smithi081.stdout:./121/.snap/snap-subdir-test 2023-10-25T23:38:04.658 INFO:tasks.workunit.client.0.smithi081.stdout:./118/.snap/snap-subdir-test 2023-10-25T23:38:04.661 INFO:tasks.workunit.client.0.smithi081.stdout:./196/.snap/snap-subdir-test 2023-10-25T23:38:04.665 INFO:tasks.workunit.client.0.smithi081.stdout:./124/.snap/snap-subdir-test 2023-10-25T23:38:04.669 INFO:tasks.workunit.client.0.smithi081.stdout:./239/.snap/snap-subdir-test 2023-10-25T23:38:04.672 INFO:tasks.workunit.client.0.smithi081.stdout:./188/.snap/snap-subdir-test 2023-10-25T23:38:04.676 INFO:tasks.workunit.client.0.smithi081.stdout:./287/.snap/snap-subdir-test 2023-10-25T23:38:04.680 INFO:tasks.workunit.client.0.smithi081.stdout:./275/.snap/snap-subdir-test 2023-10-25T23:38:04.684 INFO:tasks.workunit.client.0.smithi081.stdout:./259/.snap/snap-subdir-test 2023-10-25T23:38:04.687 INFO:tasks.workunit.client.0.smithi081.stdout:./224/.snap/snap-subdir-test 2023-10-25T23:38:04.691 INFO:tasks.workunit.client.0.smithi081.stdout:./264/.snap/snap-subdir-test 2023-10-25T23:38:04.695 INFO:tasks.workunit.client.0.smithi081.stdout:./145/.snap/snap-subdir-test 2023-10-25T23:38:04.699 INFO:tasks.workunit.client.0.smithi081.stdout:./279/.snap/snap-subdir-test 2023-10-25T23:38:04.702 INFO:tasks.workunit.client.0.smithi081.stdout:./263/.snap/snap-subdir-test 2023-10-25T23:38:04.706 INFO:tasks.workunit.client.0.smithi081.stdout:./130/.snap/snap-subdir-test 2023-10-25T23:38:04.709 INFO:tasks.workunit.client.0.smithi081.stdout:./193/.snap/snap-subdir-test 2023-10-25T23:38:04.713 INFO:tasks.workunit.client.0.smithi081.stdout:./223/.snap/snap-subdir-test 2023-10-25T23:38:04.717 INFO:tasks.workunit.client.0.smithi081.stdout:./207/.snap/snap-subdir-test 2023-10-25T23:38:04.721 INFO:tasks.workunit.client.0.smithi081.stdout:./276/.snap/snap-subdir-test 2023-10-25T23:38:04.725 INFO:tasks.workunit.client.0.smithi081.stdout:./271/.snap/snap-subdir-test 2023-10-25T23:38:04.729 INFO:tasks.workunit.client.0.smithi081.stdout:./251/.snap/snap-subdir-test 2023-10-25T23:38:04.732 INFO:tasks.workunit.client.0.smithi081.stdout:./175/.snap/snap-subdir-test 2023-10-25T23:38:04.736 INFO:tasks.workunit.client.0.smithi081.stdout:./222/.snap/snap-subdir-test 2023-10-25T23:38:04.740 INFO:tasks.workunit.client.0.smithi081.stdout:./220/.snap/snap-subdir-test 2023-10-25T23:38:04.744 INFO:tasks.workunit.client.0.smithi081.stdout:./203/.snap/snap-subdir-test 2023-10-25T23:38:04.748 INFO:tasks.workunit.client.0.smithi081.stdout:./181/.snap/snap-subdir-test 2023-10-25T23:38:04.751 INFO:tasks.workunit.client.0.smithi081.stdout:./286/.snap/snap-subdir-test 2023-10-25T23:38:04.755 INFO:tasks.workunit.client.0.smithi081.stdout:./127/.snap/snap-subdir-test 2023-10-25T23:38:04.759 INFO:tasks.workunit.client.0.smithi081.stdout:./108/.snap/snap-subdir-test 2023-10-25T23:38:04.763 INFO:tasks.workunit.client.0.smithi081.stdout:./183/.snap/snap-subdir-test 2023-10-25T23:38:04.767 INFO:tasks.workunit.client.0.smithi081.stdout:./294/.snap/snap-subdir-test 2023-10-25T23:38:04.771 INFO:tasks.workunit.client.0.smithi081.stdout:./235/.snap/snap-subdir-test 2023-10-25T23:38:04.775 INFO:tasks.workunit.client.0.smithi081.stdout:./177/.snap/snap-subdir-test 2023-10-25T23:38:04.778 INFO:tasks.workunit.client.0.smithi081.stdout:./169/.snap/snap-subdir-test 2023-10-25T23:38:04.782 INFO:tasks.workunit.client.0.smithi081.stdout:./212/.snap/snap-subdir-test 2023-10-25T23:38:04.786 INFO:tasks.workunit.client.0.smithi081.stdout:./154/.snap/snap-subdir-test 2023-10-25T23:38:04.790 INFO:tasks.workunit.client.0.smithi081.stdout:./171/.snap/snap-subdir-test 2023-10-25T23:38:04.794 INFO:tasks.workunit.client.0.smithi081.stdout:./139/.snap/snap-subdir-test 2023-10-25T23:38:04.797 INFO:tasks.workunit.client.0.smithi081.stdout:./102/.snap/snap-subdir-test 2023-10-25T23:38:04.802 INFO:tasks.workunit.client.0.smithi081.stdout:./129/.snap/snap-subdir-test 2023-10-25T23:38:06.135 INFO:tasks.workunit.client.0.smithi081.stdout:Delete all the files and directories ... 2023-10-25T23:38:06.520 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/19' 2023-10-25T23:38:06.520 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/15' 2023-10-25T23:38:06.520 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/31' 2023-10-25T23:38:06.520 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/36' 2023-10-25T23:38:06.521 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/20' 2023-10-25T23:38:06.521 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/12' 2023-10-25T23:38:06.521 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/39' 2023-10-25T23:38:06.521 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/10' 2023-10-25T23:38:06.521 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/34' 2023-10-25T23:38:06.522 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/38' 2023-10-25T23:38:06.522 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/11' 2023-10-25T23:38:06.522 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/16' 2023-10-25T23:38:06.522 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/32' 2023-10-25T23:38:06.522 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/30' 2023-10-25T23:38:06.523 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/14' 2023-10-25T23:38:06.523 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/18' 2023-10-25T23:38:06.523 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/13' 2023-10-25T23:38:06.523 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/33' 2023-10-25T23:38:06.523 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/17' 2023-10-25T23:38:06.523 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/35' 2023-10-25T23:38:06.524 INFO:tasks.workunit.client.0.smithi081.stdout:removed './100/37' 2023-10-25T23:38:06.524 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './100' 2023-10-25T23:38:06.524 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/19' 2023-10-25T23:38:06.524 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/15' 2023-10-25T23:38:06.524 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/31' 2023-10-25T23:38:06.525 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/36' 2023-10-25T23:38:06.525 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/20' 2023-10-25T23:38:06.525 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/12' 2023-10-25T23:38:06.525 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/39' 2023-10-25T23:38:06.525 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/10' 2023-10-25T23:38:06.525 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/34' 2023-10-25T23:38:06.526 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/38' 2023-10-25T23:38:06.526 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/11' 2023-10-25T23:38:06.526 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/16' 2023-10-25T23:38:06.526 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/32' 2023-10-25T23:38:06.526 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/30' 2023-10-25T23:38:06.527 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/14' 2023-10-25T23:38:06.527 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/18' 2023-10-25T23:38:06.527 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/13' 2023-10-25T23:38:06.527 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/33' 2023-10-25T23:38:06.527 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/17' 2023-10-25T23:38:06.528 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/35' 2023-10-25T23:38:06.528 INFO:tasks.workunit.client.0.smithi081.stdout:removed './101/37' 2023-10-25T23:38:06.528 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './101' 2023-10-25T23:38:06.528 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/19' 2023-10-25T23:38:06.528 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/15' 2023-10-25T23:38:06.528 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/31' 2023-10-25T23:38:06.529 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/36' 2023-10-25T23:38:06.529 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/20' 2023-10-25T23:38:06.529 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/12' 2023-10-25T23:38:06.529 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/39' 2023-10-25T23:38:06.529 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/10' 2023-10-25T23:38:06.530 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/34' 2023-10-25T23:38:06.530 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/38' 2023-10-25T23:38:06.530 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/11' 2023-10-25T23:38:06.530 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/16' 2023-10-25T23:38:06.530 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/32' 2023-10-25T23:38:06.531 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/30' 2023-10-25T23:38:06.531 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/14' 2023-10-25T23:38:06.531 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/18' 2023-10-25T23:38:06.531 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/13' 2023-10-25T23:38:06.531 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/33' 2023-10-25T23:38:06.532 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/17' 2023-10-25T23:38:06.532 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/35' 2023-10-25T23:38:06.532 INFO:tasks.workunit.client.0.smithi081.stdout:removed './102/37' 2023-10-25T23:38:06.532 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './102' 2023-10-25T23:38:06.532 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/19' 2023-10-25T23:38:06.532 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/15' 2023-10-25T23:38:06.533 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/31' 2023-10-25T23:38:06.533 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/36' 2023-10-25T23:38:06.533 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/20' 2023-10-25T23:38:06.533 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/12' 2023-10-25T23:38:06.533 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/39' 2023-10-25T23:38:06.534 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/10' 2023-10-25T23:38:06.534 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/34' 2023-10-25T23:38:06.534 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/38' 2023-10-25T23:38:06.534 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/11' 2023-10-25T23:38:06.534 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/16' 2023-10-25T23:38:06.535 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/32' 2023-10-25T23:38:06.535 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/30' 2023-10-25T23:38:06.535 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/14' 2023-10-25T23:38:06.535 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/18' 2023-10-25T23:38:06.535 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/13' 2023-10-25T23:38:06.535 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/33' 2023-10-25T23:38:06.536 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/17' 2023-10-25T23:38:06.536 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/35' 2023-10-25T23:38:06.536 INFO:tasks.workunit.client.0.smithi081.stdout:removed './103/37' 2023-10-25T23:38:06.536 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './103' 2023-10-25T23:38:06.536 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/19' 2023-10-25T23:38:06.536 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/15' 2023-10-25T23:38:06.537 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/31' 2023-10-25T23:38:06.537 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/36' 2023-10-25T23:38:06.537 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/20' 2023-10-25T23:38:06.537 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/12' 2023-10-25T23:38:06.537 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/39' 2023-10-25T23:38:06.538 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/10' 2023-10-25T23:38:06.538 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/34' 2023-10-25T23:38:06.538 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/38' 2023-10-25T23:38:06.538 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/11' 2023-10-25T23:38:06.538 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/16' 2023-10-25T23:38:06.538 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/32' 2023-10-25T23:38:06.539 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/30' 2023-10-25T23:38:06.539 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/14' 2023-10-25T23:38:06.539 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/18' 2023-10-25T23:38:06.539 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/13' 2023-10-25T23:38:06.539 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/33' 2023-10-25T23:38:06.540 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/17' 2023-10-25T23:38:06.540 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/35' 2023-10-25T23:38:06.540 INFO:tasks.workunit.client.0.smithi081.stdout:removed './104/37' 2023-10-25T23:38:06.540 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './104' 2023-10-25T23:38:06.540 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/19' 2023-10-25T23:38:06.540 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/15' 2023-10-25T23:38:06.541 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/31' 2023-10-25T23:38:06.541 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/36' 2023-10-25T23:38:06.541 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/20' 2023-10-25T23:38:06.541 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/12' 2023-10-25T23:38:06.541 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/39' 2023-10-25T23:38:06.542 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/10' 2023-10-25T23:38:06.542 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/34' 2023-10-25T23:38:06.542 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/38' 2023-10-25T23:38:06.542 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/11' 2023-10-25T23:38:06.542 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/16' 2023-10-25T23:38:06.542 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/32' 2023-10-25T23:38:06.543 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/30' 2023-10-25T23:38:06.543 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/14' 2023-10-25T23:38:06.543 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/18' 2023-10-25T23:38:06.543 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/13' 2023-10-25T23:38:06.543 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/33' 2023-10-25T23:38:06.544 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/17' 2023-10-25T23:38:06.544 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/35' 2023-10-25T23:38:06.544 INFO:tasks.workunit.client.0.smithi081.stdout:removed './105/37' 2023-10-25T23:38:06.544 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './105' 2023-10-25T23:38:06.544 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/19' 2023-10-25T23:38:06.544 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/15' 2023-10-25T23:38:06.545 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/31' 2023-10-25T23:38:06.545 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/36' 2023-10-25T23:38:06.545 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/20' 2023-10-25T23:38:06.545 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/12' 2023-10-25T23:38:06.545 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/39' 2023-10-25T23:38:06.545 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/10' 2023-10-25T23:38:06.546 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/34' 2023-10-25T23:38:06.546 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/38' 2023-10-25T23:38:06.546 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/11' 2023-10-25T23:38:06.546 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/16' 2023-10-25T23:38:06.546 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/32' 2023-10-25T23:38:06.547 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/30' 2023-10-25T23:38:06.547 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/14' 2023-10-25T23:38:06.547 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/18' 2023-10-25T23:38:06.547 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/13' 2023-10-25T23:38:06.547 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/33' 2023-10-25T23:38:06.547 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/17' 2023-10-25T23:38:06.548 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/35' 2023-10-25T23:38:06.548 INFO:tasks.workunit.client.0.smithi081.stdout:removed './106/37' 2023-10-25T23:38:06.548 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './106' 2023-10-25T23:38:06.548 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/19' 2023-10-25T23:38:06.548 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/15' 2023-10-25T23:38:06.549 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/31' 2023-10-25T23:38:06.549 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/36' 2023-10-25T23:38:06.549 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/20' 2023-10-25T23:38:06.549 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/12' 2023-10-25T23:38:06.549 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/39' 2023-10-25T23:38:06.549 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/10' 2023-10-25T23:38:06.550 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/34' 2023-10-25T23:38:06.550 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/38' 2023-10-25T23:38:06.550 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/11' 2023-10-25T23:38:06.550 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/16' 2023-10-25T23:38:06.550 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/32' 2023-10-25T23:38:06.551 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/30' 2023-10-25T23:38:06.551 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/14' 2023-10-25T23:38:06.551 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/18' 2023-10-25T23:38:06.551 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/13' 2023-10-25T23:38:06.551 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/33' 2023-10-25T23:38:06.551 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/17' 2023-10-25T23:38:06.552 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/35' 2023-10-25T23:38:06.552 INFO:tasks.workunit.client.0.smithi081.stdout:removed './107/37' 2023-10-25T23:38:06.552 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './107' 2023-10-25T23:38:06.552 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/19' 2023-10-25T23:38:06.552 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/15' 2023-10-25T23:38:06.553 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/31' 2023-10-25T23:38:06.553 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/36' 2023-10-25T23:38:06.553 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/20' 2023-10-25T23:38:06.553 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/12' 2023-10-25T23:38:06.553 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/39' 2023-10-25T23:38:06.553 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/10' 2023-10-25T23:38:06.554 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/34' 2023-10-25T23:38:06.554 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/38' 2023-10-25T23:38:06.554 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/11' 2023-10-25T23:38:06.554 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/16' 2023-10-25T23:38:06.554 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/32' 2023-10-25T23:38:06.555 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/30' 2023-10-25T23:38:06.555 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/14' 2023-10-25T23:38:06.555 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/18' 2023-10-25T23:38:06.555 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/13' 2023-10-25T23:38:06.555 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/33' 2023-10-25T23:38:06.556 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/17' 2023-10-25T23:38:06.556 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/35' 2023-10-25T23:38:06.556 INFO:tasks.workunit.client.0.smithi081.stdout:removed './108/37' 2023-10-25T23:38:06.556 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './108' 2023-10-25T23:38:06.556 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/19' 2023-10-25T23:38:06.556 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/15' 2023-10-25T23:38:06.557 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/31' 2023-10-25T23:38:06.557 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/36' 2023-10-25T23:38:06.557 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/20' 2023-10-25T23:38:06.557 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/12' 2023-10-25T23:38:06.557 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/39' 2023-10-25T23:38:06.558 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/10' 2023-10-25T23:38:06.558 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/34' 2023-10-25T23:38:06.558 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/38' 2023-10-25T23:38:06.558 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/11' 2023-10-25T23:38:06.558 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/16' 2023-10-25T23:38:06.558 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/32' 2023-10-25T23:38:06.559 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/30' 2023-10-25T23:38:06.907 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/14' 2023-10-25T23:38:06.908 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/18' 2023-10-25T23:38:06.908 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/13' 2023-10-25T23:38:06.909 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/33' 2023-10-25T23:38:06.909 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/17' 2023-10-25T23:38:06.910 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/35' 2023-10-25T23:38:06.910 INFO:tasks.workunit.client.0.smithi081.stdout:removed './109/37' 2023-10-25T23:38:06.910 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './109' 2023-10-25T23:38:06.911 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/19' 2023-10-25T23:38:06.911 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/15' 2023-10-25T23:38:06.911 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/31' 2023-10-25T23:38:06.912 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/36' 2023-10-25T23:38:06.912 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/20' 2023-10-25T23:38:06.912 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/12' 2023-10-25T23:38:06.913 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/39' 2023-10-25T23:38:06.913 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/10' 2023-10-25T23:38:06.913 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/34' 2023-10-25T23:38:06.914 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/38' 2023-10-25T23:38:06.914 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/11' 2023-10-25T23:38:06.915 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/16' 2023-10-25T23:38:06.915 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/32' 2023-10-25T23:38:06.915 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/30' 2023-10-25T23:38:06.916 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/14' 2023-10-25T23:38:06.916 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/18' 2023-10-25T23:38:06.916 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/13' 2023-10-25T23:38:06.917 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/33' 2023-10-25T23:38:06.917 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/17' 2023-10-25T23:38:06.918 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/35' 2023-10-25T23:38:06.918 INFO:tasks.workunit.client.0.smithi081.stdout:removed './110/37' 2023-10-25T23:38:06.918 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './110' 2023-10-25T23:38:06.919 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/19' 2023-10-25T23:38:06.919 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/15' 2023-10-25T23:38:06.919 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/31' 2023-10-25T23:38:06.920 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/36' 2023-10-25T23:38:06.920 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/20' 2023-10-25T23:38:06.920 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/12' 2023-10-25T23:38:06.921 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/39' 2023-10-25T23:38:06.921 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/10' 2023-10-25T23:38:06.922 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/34' 2023-10-25T23:38:06.922 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/38' 2023-10-25T23:38:06.922 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/11' 2023-10-25T23:38:06.923 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/16' 2023-10-25T23:38:06.923 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/32' 2023-10-25T23:38:06.924 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/30' 2023-10-25T23:38:06.924 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/14' 2023-10-25T23:38:06.924 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/18' 2023-10-25T23:38:06.925 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/13' 2023-10-25T23:38:06.925 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/33' 2023-10-25T23:38:06.925 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/17' 2023-10-25T23:38:06.926 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/35' 2023-10-25T23:38:06.926 INFO:tasks.workunit.client.0.smithi081.stdout:removed './111/37' 2023-10-25T23:38:06.927 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './111' 2023-10-25T23:38:06.927 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/19' 2023-10-25T23:38:06.927 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/15' 2023-10-25T23:38:06.928 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/31' 2023-10-25T23:38:06.928 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/36' 2023-10-25T23:38:06.929 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/20' 2023-10-25T23:38:06.929 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/12' 2023-10-25T23:38:06.929 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/39' 2023-10-25T23:38:06.930 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/10' 2023-10-25T23:38:06.930 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/34' 2023-10-25T23:38:06.930 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/38' 2023-10-25T23:38:06.931 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/11' 2023-10-25T23:38:06.931 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/16' 2023-10-25T23:38:06.931 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/32' 2023-10-25T23:38:06.932 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/30' 2023-10-25T23:38:06.932 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/14' 2023-10-25T23:38:06.932 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/18' 2023-10-25T23:38:06.933 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/13' 2023-10-25T23:38:06.933 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/33' 2023-10-25T23:38:06.933 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/17' 2023-10-25T23:38:06.933 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/35' 2023-10-25T23:38:06.934 INFO:tasks.workunit.client.0.smithi081.stdout:removed './112/37' 2023-10-25T23:38:06.934 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './112' 2023-10-25T23:38:06.934 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/19' 2023-10-25T23:38:06.935 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/15' 2023-10-25T23:38:06.935 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/31' 2023-10-25T23:38:06.935 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/36' 2023-10-25T23:38:06.936 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/20' 2023-10-25T23:38:06.936 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/12' 2023-10-25T23:38:06.936 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/39' 2023-10-25T23:38:06.936 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/10' 2023-10-25T23:38:06.937 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/34' 2023-10-25T23:38:06.937 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/38' 2023-10-25T23:38:06.937 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/11' 2023-10-25T23:38:06.937 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/16' 2023-10-25T23:38:06.937 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/32' 2023-10-25T23:38:06.937 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/30' 2023-10-25T23:38:06.938 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/14' 2023-10-25T23:38:06.938 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/18' 2023-10-25T23:38:06.938 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/13' 2023-10-25T23:38:06.938 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/33' 2023-10-25T23:38:06.939 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/17' 2023-10-25T23:38:06.939 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/35' 2023-10-25T23:38:06.939 INFO:tasks.workunit.client.0.smithi081.stdout:removed './113/37' 2023-10-25T23:38:06.940 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './113' 2023-10-25T23:38:06.940 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/19' 2023-10-25T23:38:06.940 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/15' 2023-10-25T23:38:06.941 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/31' 2023-10-25T23:38:06.941 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/36' 2023-10-25T23:38:06.941 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/20' 2023-10-25T23:38:06.942 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/12' 2023-10-25T23:38:06.942 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/39' 2023-10-25T23:38:06.942 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/10' 2023-10-25T23:38:06.943 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/34' 2023-10-25T23:38:06.943 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/38' 2023-10-25T23:38:06.943 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/11' 2023-10-25T23:38:06.944 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/16' 2023-10-25T23:38:06.944 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/32' 2023-10-25T23:38:06.944 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/30' 2023-10-25T23:38:06.945 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/14' 2023-10-25T23:38:06.945 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/18' 2023-10-25T23:38:06.945 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/13' 2023-10-25T23:38:06.946 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/33' 2023-10-25T23:38:06.946 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/17' 2023-10-25T23:38:06.946 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/35' 2023-10-25T23:38:06.947 INFO:tasks.workunit.client.0.smithi081.stdout:removed './114/37' 2023-10-25T23:38:06.947 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './114' 2023-10-25T23:38:06.948 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/19' 2023-10-25T23:38:06.948 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/15' 2023-10-25T23:38:06.948 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/31' 2023-10-25T23:38:06.948 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/36' 2023-10-25T23:38:06.949 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/20' 2023-10-25T23:38:06.949 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/12' 2023-10-25T23:38:06.949 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/39' 2023-10-25T23:38:06.949 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/10' 2023-10-25T23:38:06.950 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/34' 2023-10-25T23:38:06.950 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/38' 2023-10-25T23:38:06.950 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/11' 2023-10-25T23:38:06.950 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/16' 2023-10-25T23:38:06.950 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/32' 2023-10-25T23:38:06.951 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/30' 2023-10-25T23:38:06.951 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/14' 2023-10-25T23:38:06.951 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/18' 2023-10-25T23:38:06.951 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/13' 2023-10-25T23:38:06.951 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/33' 2023-10-25T23:38:06.952 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/17' 2023-10-25T23:38:06.952 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/35' 2023-10-25T23:38:06.952 INFO:tasks.workunit.client.0.smithi081.stdout:removed './115/37' 2023-10-25T23:38:06.952 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './115' 2023-10-25T23:38:06.952 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/19' 2023-10-25T23:38:06.953 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/15' 2023-10-25T23:38:06.953 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/31' 2023-10-25T23:38:06.953 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/36' 2023-10-25T23:38:06.953 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/20' 2023-10-25T23:38:06.953 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/12' 2023-10-25T23:38:06.954 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/39' 2023-10-25T23:38:06.954 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/10' 2023-10-25T23:38:06.954 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/34' 2023-10-25T23:38:06.954 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/38' 2023-10-25T23:38:06.955 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/11' 2023-10-25T23:38:06.955 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/16' 2023-10-25T23:38:06.955 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/32' 2023-10-25T23:38:06.955 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/30' 2023-10-25T23:38:06.955 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/14' 2023-10-25T23:38:06.956 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/18' 2023-10-25T23:38:06.956 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/13' 2023-10-25T23:38:06.956 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/33' 2023-10-25T23:38:06.956 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/17' 2023-10-25T23:38:06.956 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/35' 2023-10-25T23:38:06.956 INFO:tasks.workunit.client.0.smithi081.stdout:removed './116/37' 2023-10-25T23:38:06.957 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './116' 2023-10-25T23:38:06.957 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/19' 2023-10-25T23:38:06.957 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/15' 2023-10-25T23:38:06.957 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/31' 2023-10-25T23:38:06.957 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/36' 2023-10-25T23:38:06.958 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/20' 2023-10-25T23:38:06.958 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/12' 2023-10-25T23:38:06.958 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/39' 2023-10-25T23:38:06.958 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/10' 2023-10-25T23:38:06.959 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/34' 2023-10-25T23:38:06.959 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/38' 2023-10-25T23:38:06.959 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/11' 2023-10-25T23:38:06.959 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/16' 2023-10-25T23:38:06.959 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/32' 2023-10-25T23:38:06.960 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/30' 2023-10-25T23:38:06.960 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/14' 2023-10-25T23:38:06.960 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/18' 2023-10-25T23:38:06.960 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/13' 2023-10-25T23:38:06.960 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/33' 2023-10-25T23:38:06.961 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/17' 2023-10-25T23:38:06.961 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/35' 2023-10-25T23:38:06.961 INFO:tasks.workunit.client.0.smithi081.stdout:removed './117/37' 2023-10-25T23:38:06.961 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './117' 2023-10-25T23:38:06.961 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/19' 2023-10-25T23:38:06.961 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/15' 2023-10-25T23:38:06.962 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/31' 2023-10-25T23:38:06.962 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/36' 2023-10-25T23:38:06.962 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/20' 2023-10-25T23:38:06.962 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/12' 2023-10-25T23:38:06.962 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/39' 2023-10-25T23:38:06.963 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/10' 2023-10-25T23:38:06.963 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/34' 2023-10-25T23:38:06.963 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/38' 2023-10-25T23:38:06.963 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/11' 2023-10-25T23:38:06.963 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/16' 2023-10-25T23:38:06.964 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/32' 2023-10-25T23:38:06.964 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/30' 2023-10-25T23:38:06.964 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/14' 2023-10-25T23:38:06.964 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/18' 2023-10-25T23:38:06.964 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/13' 2023-10-25T23:38:06.965 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/33' 2023-10-25T23:38:06.965 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/17' 2023-10-25T23:38:06.965 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/35' 2023-10-25T23:38:06.965 INFO:tasks.workunit.client.0.smithi081.stdout:removed './118/37' 2023-10-25T23:38:06.965 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './118' 2023-10-25T23:38:06.966 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/19' 2023-10-25T23:38:06.966 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/15' 2023-10-25T23:38:06.966 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/31' 2023-10-25T23:38:06.966 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/36' 2023-10-25T23:38:06.966 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/20' 2023-10-25T23:38:06.967 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/12' 2023-10-25T23:38:07.294 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/39' 2023-10-25T23:38:07.295 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/10' 2023-10-25T23:38:07.295 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/34' 2023-10-25T23:38:07.295 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/38' 2023-10-25T23:38:07.296 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/11' 2023-10-25T23:38:07.296 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/16' 2023-10-25T23:38:07.296 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/32' 2023-10-25T23:38:07.296 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/30' 2023-10-25T23:38:07.296 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/14' 2023-10-25T23:38:07.297 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/18' 2023-10-25T23:38:07.297 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/13' 2023-10-25T23:38:07.297 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/33' 2023-10-25T23:38:07.297 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/17' 2023-10-25T23:38:07.297 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/35' 2023-10-25T23:38:07.298 INFO:tasks.workunit.client.0.smithi081.stdout:removed './119/37' 2023-10-25T23:38:07.298 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './119' 2023-10-25T23:38:07.298 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/19' 2023-10-25T23:38:07.298 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/15' 2023-10-25T23:38:07.299 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/31' 2023-10-25T23:38:07.299 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/36' 2023-10-25T23:38:07.299 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/20' 2023-10-25T23:38:07.299 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/12' 2023-10-25T23:38:07.299 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/39' 2023-10-25T23:38:07.300 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/10' 2023-10-25T23:38:07.300 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/34' 2023-10-25T23:38:07.300 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/38' 2023-10-25T23:38:07.300 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/11' 2023-10-25T23:38:07.300 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/16' 2023-10-25T23:38:07.301 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/32' 2023-10-25T23:38:07.301 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/30' 2023-10-25T23:38:07.301 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/14' 2023-10-25T23:38:07.301 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/18' 2023-10-25T23:38:07.301 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/13' 2023-10-25T23:38:07.301 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/33' 2023-10-25T23:38:07.302 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/17' 2023-10-25T23:38:07.302 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/35' 2023-10-25T23:38:07.302 INFO:tasks.workunit.client.0.smithi081.stdout:removed './120/37' 2023-10-25T23:38:07.302 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './120' 2023-10-25T23:38:07.302 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/19' 2023-10-25T23:38:07.303 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/15' 2023-10-25T23:38:07.303 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/31' 2023-10-25T23:38:07.303 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/36' 2023-10-25T23:38:07.303 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/20' 2023-10-25T23:38:07.303 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/12' 2023-10-25T23:38:07.304 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/39' 2023-10-25T23:38:07.304 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/10' 2023-10-25T23:38:07.304 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/34' 2023-10-25T23:38:07.304 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/38' 2023-10-25T23:38:07.304 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/11' 2023-10-25T23:38:07.304 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/16' 2023-10-25T23:38:07.305 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/32' 2023-10-25T23:38:07.305 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/30' 2023-10-25T23:38:07.305 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/14' 2023-10-25T23:38:07.305 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/18' 2023-10-25T23:38:07.305 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/13' 2023-10-25T23:38:07.306 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/33' 2023-10-25T23:38:07.306 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/17' 2023-10-25T23:38:07.306 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/35' 2023-10-25T23:38:07.306 INFO:tasks.workunit.client.0.smithi081.stdout:removed './121/37' 2023-10-25T23:38:07.306 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './121' 2023-10-25T23:38:07.307 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/19' 2023-10-25T23:38:07.307 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/15' 2023-10-25T23:38:07.307 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/31' 2023-10-25T23:38:07.307 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/36' 2023-10-25T23:38:07.307 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/20' 2023-10-25T23:38:07.308 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/12' 2023-10-25T23:38:07.308 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/39' 2023-10-25T23:38:07.308 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/10' 2023-10-25T23:38:07.308 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/34' 2023-10-25T23:38:07.308 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/38' 2023-10-25T23:38:07.308 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/11' 2023-10-25T23:38:07.309 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/16' 2023-10-25T23:38:07.309 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/32' 2023-10-25T23:38:07.309 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/30' 2023-10-25T23:38:07.309 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/14' 2023-10-25T23:38:07.309 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/18' 2023-10-25T23:38:07.310 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/13' 2023-10-25T23:38:07.310 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/33' 2023-10-25T23:38:07.310 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/17' 2023-10-25T23:38:07.310 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/35' 2023-10-25T23:38:07.310 INFO:tasks.workunit.client.0.smithi081.stdout:removed './122/37' 2023-10-25T23:38:07.311 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './122' 2023-10-25T23:38:07.311 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/19' 2023-10-25T23:38:07.311 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/15' 2023-10-25T23:38:07.311 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/31' 2023-10-25T23:38:07.311 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/36' 2023-10-25T23:38:07.312 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/20' 2023-10-25T23:38:07.312 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/12' 2023-10-25T23:38:07.312 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/39' 2023-10-25T23:38:07.312 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/10' 2023-10-25T23:38:07.312 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/34' 2023-10-25T23:38:07.313 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/38' 2023-10-25T23:38:07.313 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/11' 2023-10-25T23:38:07.313 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/16' 2023-10-25T23:38:07.314 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/32' 2023-10-25T23:38:07.314 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/30' 2023-10-25T23:38:07.314 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/14' 2023-10-25T23:38:07.315 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/18' 2023-10-25T23:38:07.315 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/13' 2023-10-25T23:38:07.316 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/33' 2023-10-25T23:38:07.316 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/17' 2023-10-25T23:38:07.316 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/35' 2023-10-25T23:38:07.317 INFO:tasks.workunit.client.0.smithi081.stdout:removed './123/37' 2023-10-25T23:38:07.317 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './123' 2023-10-25T23:38:07.317 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/19' 2023-10-25T23:38:07.318 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/15' 2023-10-25T23:38:07.318 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/31' 2023-10-25T23:38:07.319 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/36' 2023-10-25T23:38:07.319 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/20' 2023-10-25T23:38:07.319 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/12' 2023-10-25T23:38:07.320 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/39' 2023-10-25T23:38:07.320 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/10' 2023-10-25T23:38:07.320 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/34' 2023-10-25T23:38:07.321 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/38' 2023-10-25T23:38:07.321 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/11' 2023-10-25T23:38:07.321 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/16' 2023-10-25T23:38:07.322 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/32' 2023-10-25T23:38:07.322 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/30' 2023-10-25T23:38:07.323 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/14' 2023-10-25T23:38:07.323 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/18' 2023-10-25T23:38:07.323 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/13' 2023-10-25T23:38:07.324 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/33' 2023-10-25T23:38:07.324 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/17' 2023-10-25T23:38:07.324 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/35' 2023-10-25T23:38:07.325 INFO:tasks.workunit.client.0.smithi081.stdout:removed './124/37' 2023-10-25T23:38:07.325 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './124' 2023-10-25T23:38:07.325 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/19' 2023-10-25T23:38:07.326 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/15' 2023-10-25T23:38:07.326 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/31' 2023-10-25T23:38:07.326 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/36' 2023-10-25T23:38:07.327 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/20' 2023-10-25T23:38:07.327 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/12' 2023-10-25T23:38:07.328 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/39' 2023-10-25T23:38:07.328 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/10' 2023-10-25T23:38:07.328 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/34' 2023-10-25T23:38:07.329 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/38' 2023-10-25T23:38:07.329 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/11' 2023-10-25T23:38:07.329 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/16' 2023-10-25T23:38:07.330 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/32' 2023-10-25T23:38:07.330 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/30' 2023-10-25T23:38:07.331 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/14' 2023-10-25T23:38:07.331 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/18' 2023-10-25T23:38:07.331 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/13' 2023-10-25T23:38:07.332 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/33' 2023-10-25T23:38:07.332 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/17' 2023-10-25T23:38:07.332 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/35' 2023-10-25T23:38:07.333 INFO:tasks.workunit.client.0.smithi081.stdout:removed './125/37' 2023-10-25T23:38:07.333 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './125' 2023-10-25T23:38:07.333 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/19' 2023-10-25T23:38:07.334 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/15' 2023-10-25T23:38:07.334 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/31' 2023-10-25T23:38:07.334 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/36' 2023-10-25T23:38:07.335 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/20' 2023-10-25T23:38:07.335 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/12' 2023-10-25T23:38:07.335 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/39' 2023-10-25T23:38:07.336 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/10' 2023-10-25T23:38:07.336 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/34' 2023-10-25T23:38:07.336 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/38' 2023-10-25T23:38:07.337 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/11' 2023-10-25T23:38:07.337 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/16' 2023-10-25T23:38:07.337 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/32' 2023-10-25T23:38:07.338 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/30' 2023-10-25T23:38:07.338 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/14' 2023-10-25T23:38:07.339 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/18' 2023-10-25T23:38:07.339 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/13' 2023-10-25T23:38:07.339 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/33' 2023-10-25T23:38:07.340 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/17' 2023-10-25T23:38:07.340 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/35' 2023-10-25T23:38:07.340 INFO:tasks.workunit.client.0.smithi081.stdout:removed './126/37' 2023-10-25T23:38:07.341 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './126' 2023-10-25T23:38:07.341 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/19' 2023-10-25T23:38:07.342 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/15' 2023-10-25T23:38:07.342 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/31' 2023-10-25T23:38:07.342 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/36' 2023-10-25T23:38:07.343 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/20' 2023-10-25T23:38:07.343 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/12' 2023-10-25T23:38:07.343 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/39' 2023-10-25T23:38:07.344 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/10' 2023-10-25T23:38:07.344 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/34' 2023-10-25T23:38:07.344 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/38' 2023-10-25T23:38:07.345 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/11' 2023-10-25T23:38:07.345 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/16' 2023-10-25T23:38:07.345 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/32' 2023-10-25T23:38:07.345 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/30' 2023-10-25T23:38:07.346 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/14' 2023-10-25T23:38:07.346 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/18' 2023-10-25T23:38:07.346 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/13' 2023-10-25T23:38:07.347 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/33' 2023-10-25T23:38:07.347 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/17' 2023-10-25T23:38:07.347 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/35' 2023-10-25T23:38:07.347 INFO:tasks.workunit.client.0.smithi081.stdout:removed './127/37' 2023-10-25T23:38:07.348 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './127' 2023-10-25T23:38:07.348 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/19' 2023-10-25T23:38:07.348 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/15' 2023-10-25T23:38:07.349 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/31' 2023-10-25T23:38:07.349 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/36' 2023-10-25T23:38:07.349 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/20' 2023-10-25T23:38:07.349 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/12' 2023-10-25T23:38:07.349 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/39' 2023-10-25T23:38:07.350 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/10' 2023-10-25T23:38:07.350 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/34' 2023-10-25T23:38:07.350 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/38' 2023-10-25T23:38:07.350 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/11' 2023-10-25T23:38:07.350 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/16' 2023-10-25T23:38:07.351 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/32' 2023-10-25T23:38:07.351 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/30' 2023-10-25T23:38:07.351 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/14' 2023-10-25T23:38:07.351 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/18' 2023-10-25T23:38:07.351 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/13' 2023-10-25T23:38:07.352 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/33' 2023-10-25T23:38:07.352 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/17' 2023-10-25T23:38:07.352 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/35' 2023-10-25T23:38:07.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:38:07.596 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:38:07.816 INFO:tasks.workunit.client.0.smithi081.stdout:removed './128/37' 2023-10-25T23:38:07.817 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './128' 2023-10-25T23:38:07.817 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/19' 2023-10-25T23:38:07.817 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/15' 2023-10-25T23:38:07.817 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/31' 2023-10-25T23:38:07.817 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/36' 2023-10-25T23:38:07.818 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/20' 2023-10-25T23:38:07.818 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/12' 2023-10-25T23:38:07.818 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/39' 2023-10-25T23:38:07.818 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/10' 2023-10-25T23:38:07.818 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/34' 2023-10-25T23:38:07.819 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/38' 2023-10-25T23:38:07.819 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/11' 2023-10-25T23:38:07.819 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/16' 2023-10-25T23:38:07.819 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/32' 2023-10-25T23:38:07.819 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/30' 2023-10-25T23:38:07.819 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/14' 2023-10-25T23:38:07.820 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/18' 2023-10-25T23:38:07.820 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/13' 2023-10-25T23:38:07.820 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/33' 2023-10-25T23:38:07.820 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/17' 2023-10-25T23:38:07.820 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/35' 2023-10-25T23:38:07.821 INFO:tasks.workunit.client.0.smithi081.stdout:removed './129/37' 2023-10-25T23:38:07.821 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './129' 2023-10-25T23:38:07.821 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/19' 2023-10-25T23:38:07.821 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/15' 2023-10-25T23:38:07.821 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/31' 2023-10-25T23:38:07.821 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/36' 2023-10-25T23:38:07.822 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/20' 2023-10-25T23:38:07.822 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/12' 2023-10-25T23:38:07.822 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/39' 2023-10-25T23:38:07.822 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/10' 2023-10-25T23:38:07.822 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/34' 2023-10-25T23:38:07.823 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/38' 2023-10-25T23:38:07.823 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/11' 2023-10-25T23:38:07.823 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/16' 2023-10-25T23:38:07.823 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/32' 2023-10-25T23:38:07.823 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/30' 2023-10-25T23:38:07.823 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/14' 2023-10-25T23:38:07.824 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/18' 2023-10-25T23:38:07.824 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/13' 2023-10-25T23:38:07.824 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/33' 2023-10-25T23:38:07.824 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/17' 2023-10-25T23:38:07.824 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/35' 2023-10-25T23:38:07.825 INFO:tasks.workunit.client.0.smithi081.stdout:removed './130/37' 2023-10-25T23:38:07.825 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './130' 2023-10-25T23:38:07.825 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/19' 2023-10-25T23:38:07.825 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/15' 2023-10-25T23:38:07.825 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/31' 2023-10-25T23:38:07.825 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/36' 2023-10-25T23:38:07.826 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/20' 2023-10-25T23:38:07.826 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/12' 2023-10-25T23:38:07.826 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/39' 2023-10-25T23:38:07.826 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/10' 2023-10-25T23:38:07.826 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/34' 2023-10-25T23:38:07.827 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/38' 2023-10-25T23:38:07.827 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/11' 2023-10-25T23:38:07.827 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/16' 2023-10-25T23:38:07.827 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/32' 2023-10-25T23:38:07.827 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/30' 2023-10-25T23:38:07.828 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/14' 2023-10-25T23:38:07.828 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/18' 2023-10-25T23:38:07.828 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/13' 2023-10-25T23:38:07.828 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/33' 2023-10-25T23:38:07.828 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/17' 2023-10-25T23:38:07.828 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/35' 2023-10-25T23:38:07.829 INFO:tasks.workunit.client.0.smithi081.stdout:removed './131/37' 2023-10-25T23:38:07.829 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './131' 2023-10-25T23:38:07.829 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/19' 2023-10-25T23:38:07.829 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/15' 2023-10-25T23:38:07.829 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/31' 2023-10-25T23:38:07.829 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/36' 2023-10-25T23:38:07.830 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/20' 2023-10-25T23:38:07.830 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/12' 2023-10-25T23:38:07.830 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/39' 2023-10-25T23:38:07.830 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/10' 2023-10-25T23:38:07.830 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/34' 2023-10-25T23:38:07.831 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/38' 2023-10-25T23:38:07.831 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/11' 2023-10-25T23:38:07.831 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/16' 2023-10-25T23:38:07.831 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/32' 2023-10-25T23:38:07.831 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/30' 2023-10-25T23:38:07.832 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/14' 2023-10-25T23:38:07.832 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/18' 2023-10-25T23:38:07.832 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/13' 2023-10-25T23:38:07.832 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/33' 2023-10-25T23:38:07.832 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/17' 2023-10-25T23:38:07.832 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/35' 2023-10-25T23:38:07.833 INFO:tasks.workunit.client.0.smithi081.stdout:removed './132/37' 2023-10-25T23:38:07.833 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './132' 2023-10-25T23:38:07.833 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/19' 2023-10-25T23:38:07.833 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/15' 2023-10-25T23:38:07.833 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/31' 2023-10-25T23:38:07.834 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/36' 2023-10-25T23:38:07.834 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/20' 2023-10-25T23:38:07.834 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/12' 2023-10-25T23:38:07.834 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/39' 2023-10-25T23:38:07.834 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/10' 2023-10-25T23:38:07.834 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/34' 2023-10-25T23:38:07.835 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/38' 2023-10-25T23:38:07.835 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/11' 2023-10-25T23:38:07.835 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/16' 2023-10-25T23:38:07.835 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/32' 2023-10-25T23:38:07.835 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/30' 2023-10-25T23:38:07.836 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/14' 2023-10-25T23:38:07.836 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/18' 2023-10-25T23:38:07.836 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/13' 2023-10-25T23:38:07.836 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/33' 2023-10-25T23:38:07.836 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/17' 2023-10-25T23:38:07.836 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/35' 2023-10-25T23:38:07.837 INFO:tasks.workunit.client.0.smithi081.stdout:removed './133/37' 2023-10-25T23:38:07.837 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './133' 2023-10-25T23:38:07.837 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/19' 2023-10-25T23:38:07.837 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/15' 2023-10-25T23:38:07.837 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/31' 2023-10-25T23:38:07.838 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/36' 2023-10-25T23:38:07.838 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/20' 2023-10-25T23:38:07.838 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/12' 2023-10-25T23:38:07.838 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/39' 2023-10-25T23:38:07.838 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/10' 2023-10-25T23:38:07.838 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/34' 2023-10-25T23:38:07.839 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/38' 2023-10-25T23:38:07.839 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/11' 2023-10-25T23:38:07.839 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/16' 2023-10-25T23:38:07.839 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/32' 2023-10-25T23:38:07.839 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/30' 2023-10-25T23:38:07.840 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/14' 2023-10-25T23:38:07.840 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/18' 2023-10-25T23:38:07.840 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/13' 2023-10-25T23:38:07.840 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/33' 2023-10-25T23:38:07.840 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/17' 2023-10-25T23:38:07.840 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/35' 2023-10-25T23:38:07.841 INFO:tasks.workunit.client.0.smithi081.stdout:removed './134/37' 2023-10-25T23:38:07.841 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './134' 2023-10-25T23:38:07.841 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/19' 2023-10-25T23:38:07.841 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/15' 2023-10-25T23:38:07.841 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/31' 2023-10-25T23:38:07.841 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/36' 2023-10-25T23:38:07.842 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/20' 2023-10-25T23:38:07.842 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/12' 2023-10-25T23:38:07.842 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/39' 2023-10-25T23:38:07.842 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/10' 2023-10-25T23:38:07.842 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/34' 2023-10-25T23:38:07.843 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/38' 2023-10-25T23:38:07.843 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/11' 2023-10-25T23:38:07.843 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/16' 2023-10-25T23:38:07.843 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/32' 2023-10-25T23:38:07.844 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/30' 2023-10-25T23:38:07.844 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/14' 2023-10-25T23:38:07.844 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/18' 2023-10-25T23:38:07.845 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/13' 2023-10-25T23:38:07.845 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/33' 2023-10-25T23:38:07.845 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/17' 2023-10-25T23:38:07.845 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/35' 2023-10-25T23:38:07.845 INFO:tasks.workunit.client.0.smithi081.stdout:removed './135/37' 2023-10-25T23:38:07.846 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './135' 2023-10-25T23:38:07.846 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/19' 2023-10-25T23:38:07.846 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/15' 2023-10-25T23:38:07.846 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/31' 2023-10-25T23:38:07.846 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/36' 2023-10-25T23:38:07.847 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/20' 2023-10-25T23:38:07.847 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/12' 2023-10-25T23:38:07.847 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/39' 2023-10-25T23:38:07.847 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/10' 2023-10-25T23:38:07.847 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/34' 2023-10-25T23:38:07.848 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/38' 2023-10-25T23:38:07.848 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/11' 2023-10-25T23:38:07.848 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/16' 2023-10-25T23:38:07.848 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/32' 2023-10-25T23:38:07.848 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/30' 2023-10-25T23:38:07.848 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/14' 2023-10-25T23:38:07.849 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/18' 2023-10-25T23:38:07.849 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/13' 2023-10-25T23:38:07.849 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/33' 2023-10-25T23:38:07.849 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/17' 2023-10-25T23:38:07.849 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/35' 2023-10-25T23:38:07.850 INFO:tasks.workunit.client.0.smithi081.stdout:removed './136/37' 2023-10-25T23:38:07.850 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './136' 2023-10-25T23:38:07.850 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/19' 2023-10-25T23:38:07.850 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/15' 2023-10-25T23:38:07.850 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/31' 2023-10-25T23:38:07.851 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/36' 2023-10-25T23:38:07.851 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/20' 2023-10-25T23:38:07.851 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/12' 2023-10-25T23:38:07.851 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/39' 2023-10-25T23:38:07.851 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/10' 2023-10-25T23:38:07.852 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/34' 2023-10-25T23:38:07.852 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/38' 2023-10-25T23:38:07.852 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/11' 2023-10-25T23:38:07.852 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/16' 2023-10-25T23:38:07.852 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/32' 2023-10-25T23:38:07.852 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/30' 2023-10-25T23:38:07.853 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/14' 2023-10-25T23:38:07.853 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/18' 2023-10-25T23:38:07.853 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/13' 2023-10-25T23:38:07.853 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/33' 2023-10-25T23:38:07.853 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/17' 2023-10-25T23:38:07.854 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/35' 2023-10-25T23:38:07.854 INFO:tasks.workunit.client.0.smithi081.stdout:removed './137/37' 2023-10-25T23:38:07.854 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './137' 2023-10-25T23:38:07.854 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/19' 2023-10-25T23:38:07.854 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/15' 2023-10-25T23:38:07.855 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/31' 2023-10-25T23:38:07.855 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/36' 2023-10-25T23:38:07.855 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/20' 2023-10-25T23:38:07.855 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/12' 2023-10-25T23:38:07.855 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/39' 2023-10-25T23:38:07.856 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/10' 2023-10-25T23:38:07.856 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/34' 2023-10-25T23:38:07.856 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/38' 2023-10-25T23:38:07.856 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/11' 2023-10-25T23:38:07.856 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/16' 2023-10-25T23:38:08.515 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/32' 2023-10-25T23:38:08.515 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/30' 2023-10-25T23:38:08.515 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/14' 2023-10-25T23:38:08.516 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/18' 2023-10-25T23:38:08.516 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/13' 2023-10-25T23:38:08.516 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/33' 2023-10-25T23:38:08.516 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/17' 2023-10-25T23:38:08.516 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/35' 2023-10-25T23:38:08.516 INFO:tasks.workunit.client.0.smithi081.stdout:removed './138/37' 2023-10-25T23:38:08.517 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './138' 2023-10-25T23:38:08.517 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/19' 2023-10-25T23:38:08.517 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/15' 2023-10-25T23:38:08.517 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/31' 2023-10-25T23:38:08.518 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/36' 2023-10-25T23:38:08.518 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/20' 2023-10-25T23:38:08.518 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/12' 2023-10-25T23:38:08.518 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/39' 2023-10-25T23:38:08.518 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/10' 2023-10-25T23:38:08.518 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/34' 2023-10-25T23:38:08.519 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/38' 2023-10-25T23:38:08.519 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/11' 2023-10-25T23:38:08.519 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/16' 2023-10-25T23:38:08.519 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/32' 2023-10-25T23:38:08.520 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/30' 2023-10-25T23:38:08.520 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/14' 2023-10-25T23:38:08.520 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/18' 2023-10-25T23:38:08.520 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/13' 2023-10-25T23:38:08.520 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/33' 2023-10-25T23:38:08.521 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/17' 2023-10-25T23:38:08.521 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/35' 2023-10-25T23:38:08.521 INFO:tasks.workunit.client.0.smithi081.stdout:removed './139/37' 2023-10-25T23:38:08.521 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './139' 2023-10-25T23:38:08.521 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/19' 2023-10-25T23:38:08.521 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/15' 2023-10-25T23:38:08.522 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/31' 2023-10-25T23:38:08.522 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/36' 2023-10-25T23:38:08.522 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/20' 2023-10-25T23:38:08.522 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/12' 2023-10-25T23:38:08.523 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/39' 2023-10-25T23:38:08.523 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/10' 2023-10-25T23:38:08.523 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/34' 2023-10-25T23:38:08.523 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/38' 2023-10-25T23:38:08.523 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/11' 2023-10-25T23:38:08.523 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/16' 2023-10-25T23:38:08.524 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/32' 2023-10-25T23:38:08.524 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/30' 2023-10-25T23:38:08.524 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/14' 2023-10-25T23:38:08.524 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/18' 2023-10-25T23:38:08.524 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/13' 2023-10-25T23:38:08.525 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/33' 2023-10-25T23:38:08.525 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/17' 2023-10-25T23:38:08.525 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/35' 2023-10-25T23:38:08.525 INFO:tasks.workunit.client.0.smithi081.stdout:removed './140/37' 2023-10-25T23:38:08.525 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './140' 2023-10-25T23:38:08.525 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/19' 2023-10-25T23:38:08.526 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/15' 2023-10-25T23:38:08.526 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/31' 2023-10-25T23:38:08.526 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/36' 2023-10-25T23:38:08.526 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/20' 2023-10-25T23:38:08.526 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/12' 2023-10-25T23:38:08.527 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/39' 2023-10-25T23:38:08.527 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/10' 2023-10-25T23:38:08.527 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/34' 2023-10-25T23:38:08.527 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/38' 2023-10-25T23:38:08.527 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/11' 2023-10-25T23:38:08.527 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/16' 2023-10-25T23:38:08.528 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/32' 2023-10-25T23:38:08.528 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/30' 2023-10-25T23:38:08.528 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/14' 2023-10-25T23:38:08.528 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/18' 2023-10-25T23:38:08.528 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/13' 2023-10-25T23:38:08.529 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/33' 2023-10-25T23:38:08.529 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/17' 2023-10-25T23:38:08.529 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/35' 2023-10-25T23:38:08.529 INFO:tasks.workunit.client.0.smithi081.stdout:removed './141/37' 2023-10-25T23:38:08.529 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './141' 2023-10-25T23:38:08.529 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/19' 2023-10-25T23:38:08.530 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/15' 2023-10-25T23:38:08.530 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/31' 2023-10-25T23:38:08.530 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/36' 2023-10-25T23:38:08.530 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/20' 2023-10-25T23:38:08.530 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/12' 2023-10-25T23:38:08.531 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/39' 2023-10-25T23:38:08.531 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/10' 2023-10-25T23:38:08.531 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/34' 2023-10-25T23:38:08.531 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/38' 2023-10-25T23:38:08.531 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/11' 2023-10-25T23:38:08.531 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/16' 2023-10-25T23:38:08.532 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/32' 2023-10-25T23:38:08.532 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/30' 2023-10-25T23:38:08.532 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/14' 2023-10-25T23:38:08.532 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/18' 2023-10-25T23:38:08.532 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/13' 2023-10-25T23:38:08.532 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/33' 2023-10-25T23:38:08.533 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/17' 2023-10-25T23:38:08.533 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/35' 2023-10-25T23:38:08.533 INFO:tasks.workunit.client.0.smithi081.stdout:removed './142/37' 2023-10-25T23:38:08.533 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './142' 2023-10-25T23:38:08.533 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/19' 2023-10-25T23:38:08.534 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/15' 2023-10-25T23:38:08.534 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/31' 2023-10-25T23:38:08.534 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/36' 2023-10-25T23:38:08.534 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/20' 2023-10-25T23:38:08.534 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/12' 2023-10-25T23:38:08.535 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/39' 2023-10-25T23:38:08.535 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/10' 2023-10-25T23:38:08.535 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/34' 2023-10-25T23:38:08.535 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/38' 2023-10-25T23:38:08.535 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/11' 2023-10-25T23:38:08.536 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/16' 2023-10-25T23:38:08.536 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/32' 2023-10-25T23:38:08.536 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/30' 2023-10-25T23:38:08.536 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/14' 2023-10-25T23:38:08.536 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/18' 2023-10-25T23:38:08.536 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/13' 2023-10-25T23:38:08.537 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/33' 2023-10-25T23:38:08.537 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/17' 2023-10-25T23:38:08.537 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/35' 2023-10-25T23:38:08.537 INFO:tasks.workunit.client.0.smithi081.stdout:removed './143/37' 2023-10-25T23:38:08.537 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './143' 2023-10-25T23:38:08.538 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/19' 2023-10-25T23:38:08.538 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/15' 2023-10-25T23:38:08.538 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/31' 2023-10-25T23:38:08.538 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/36' 2023-10-25T23:38:08.538 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/20' 2023-10-25T23:38:08.539 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/12' 2023-10-25T23:38:08.539 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/39' 2023-10-25T23:38:08.539 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/10' 2023-10-25T23:38:08.539 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/34' 2023-10-25T23:38:08.539 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/38' 2023-10-25T23:38:08.539 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/11' 2023-10-25T23:38:08.540 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/16' 2023-10-25T23:38:08.540 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/32' 2023-10-25T23:38:08.540 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/30' 2023-10-25T23:38:08.540 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/14' 2023-10-25T23:38:08.540 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/18' 2023-10-25T23:38:08.540 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/13' 2023-10-25T23:38:08.541 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/33' 2023-10-25T23:38:08.541 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/17' 2023-10-25T23:38:08.541 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/35' 2023-10-25T23:38:08.541 INFO:tasks.workunit.client.0.smithi081.stdout:removed './144/37' 2023-10-25T23:38:08.541 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './144' 2023-10-25T23:38:08.542 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/19' 2023-10-25T23:38:08.542 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/15' 2023-10-25T23:38:08.542 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/31' 2023-10-25T23:38:08.542 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/36' 2023-10-25T23:38:08.542 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/20' 2023-10-25T23:38:08.542 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/12' 2023-10-25T23:38:08.543 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/39' 2023-10-25T23:38:08.543 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/10' 2023-10-25T23:38:08.543 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/34' 2023-10-25T23:38:08.543 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/38' 2023-10-25T23:38:08.543 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/11' 2023-10-25T23:38:08.543 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/16' 2023-10-25T23:38:08.544 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/32' 2023-10-25T23:38:08.544 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/30' 2023-10-25T23:38:08.544 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/14' 2023-10-25T23:38:08.544 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/18' 2023-10-25T23:38:08.544 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/13' 2023-10-25T23:38:08.545 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/33' 2023-10-25T23:38:08.545 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/17' 2023-10-25T23:38:08.545 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/35' 2023-10-25T23:38:08.545 INFO:tasks.workunit.client.0.smithi081.stdout:removed './145/37' 2023-10-25T23:38:08.545 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './145' 2023-10-25T23:38:08.545 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/19' 2023-10-25T23:38:08.546 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/15' 2023-10-25T23:38:08.546 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/31' 2023-10-25T23:38:08.546 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/36' 2023-10-25T23:38:08.546 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/20' 2023-10-25T23:38:08.546 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/12' 2023-10-25T23:38:08.547 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/39' 2023-10-25T23:38:08.547 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/10' 2023-10-25T23:38:08.547 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/34' 2023-10-25T23:38:08.547 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/38' 2023-10-25T23:38:08.547 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/11' 2023-10-25T23:38:08.547 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/16' 2023-10-25T23:38:08.548 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/32' 2023-10-25T23:38:08.548 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/30' 2023-10-25T23:38:08.548 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/14' 2023-10-25T23:38:08.548 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/18' 2023-10-25T23:38:08.548 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/13' 2023-10-25T23:38:08.549 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/33' 2023-10-25T23:38:08.549 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/17' 2023-10-25T23:38:08.549 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/35' 2023-10-25T23:38:08.549 INFO:tasks.workunit.client.0.smithi081.stdout:removed './146/37' 2023-10-25T23:38:08.549 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './146' 2023-10-25T23:38:08.549 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/19' 2023-10-25T23:38:08.550 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/15' 2023-10-25T23:38:08.550 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/31' 2023-10-25T23:38:08.550 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/36' 2023-10-25T23:38:08.550 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/20' 2023-10-25T23:38:08.551 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/12' 2023-10-25T23:38:08.551 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/39' 2023-10-25T23:38:08.551 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/10' 2023-10-25T23:38:08.551 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/34' 2023-10-25T23:38:08.551 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/38' 2023-10-25T23:38:08.551 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/11' 2023-10-25T23:38:08.552 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/16' 2023-10-25T23:38:08.552 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/32' 2023-10-25T23:38:08.552 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/30' 2023-10-25T23:38:08.552 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/14' 2023-10-25T23:38:08.553 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/18' 2023-10-25T23:38:08.553 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/13' 2023-10-25T23:38:08.553 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/33' 2023-10-25T23:38:08.553 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/17' 2023-10-25T23:38:08.553 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/35' 2023-10-25T23:38:08.554 INFO:tasks.workunit.client.0.smithi081.stdout:removed './147/37' 2023-10-25T23:38:08.554 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './147' 2023-10-25T23:38:08.554 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/19' 2023-10-25T23:38:08.554 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/15' 2023-10-25T23:38:08.554 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/31' 2023-10-25T23:38:08.555 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/36' 2023-10-25T23:38:09.468 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/20' 2023-10-25T23:38:09.469 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/12' 2023-10-25T23:38:09.469 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/39' 2023-10-25T23:38:09.469 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/10' 2023-10-25T23:38:09.469 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/34' 2023-10-25T23:38:09.469 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/38' 2023-10-25T23:38:09.470 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/11' 2023-10-25T23:38:09.470 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/16' 2023-10-25T23:38:09.470 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/32' 2023-10-25T23:38:09.470 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/30' 2023-10-25T23:38:09.470 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/14' 2023-10-25T23:38:09.470 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/18' 2023-10-25T23:38:09.471 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/13' 2023-10-25T23:38:09.471 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/33' 2023-10-25T23:38:09.471 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/17' 2023-10-25T23:38:09.471 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/35' 2023-10-25T23:38:09.471 INFO:tasks.workunit.client.0.smithi081.stdout:removed './148/37' 2023-10-25T23:38:09.472 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './148' 2023-10-25T23:38:09.472 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/19' 2023-10-25T23:38:09.472 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/15' 2023-10-25T23:38:09.472 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/31' 2023-10-25T23:38:09.472 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/36' 2023-10-25T23:38:09.472 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/20' 2023-10-25T23:38:09.473 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/12' 2023-10-25T23:38:09.473 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/39' 2023-10-25T23:38:09.473 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/10' 2023-10-25T23:38:09.473 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/34' 2023-10-25T23:38:09.473 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/38' 2023-10-25T23:38:09.474 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/11' 2023-10-25T23:38:09.474 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/16' 2023-10-25T23:38:09.474 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/32' 2023-10-25T23:38:09.474 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/30' 2023-10-25T23:38:09.474 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/14' 2023-10-25T23:38:09.475 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/18' 2023-10-25T23:38:09.475 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/13' 2023-10-25T23:38:09.475 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/33' 2023-10-25T23:38:09.475 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/17' 2023-10-25T23:38:09.475 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/35' 2023-10-25T23:38:09.475 INFO:tasks.workunit.client.0.smithi081.stdout:removed './149/37' 2023-10-25T23:38:09.476 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './149' 2023-10-25T23:38:09.476 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/19' 2023-10-25T23:38:09.476 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/15' 2023-10-25T23:38:09.476 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/31' 2023-10-25T23:38:09.476 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/36' 2023-10-25T23:38:09.477 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/20' 2023-10-25T23:38:09.477 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/12' 2023-10-25T23:38:09.477 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/39' 2023-10-25T23:38:09.477 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/10' 2023-10-25T23:38:09.477 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/34' 2023-10-25T23:38:09.477 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/38' 2023-10-25T23:38:09.478 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/11' 2023-10-25T23:38:09.478 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/16' 2023-10-25T23:38:09.478 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/32' 2023-10-25T23:38:09.478 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/30' 2023-10-25T23:38:09.478 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/14' 2023-10-25T23:38:09.479 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/18' 2023-10-25T23:38:09.479 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/13' 2023-10-25T23:38:09.479 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/33' 2023-10-25T23:38:09.479 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/17' 2023-10-25T23:38:09.479 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/35' 2023-10-25T23:38:09.479 INFO:tasks.workunit.client.0.smithi081.stdout:removed './150/37' 2023-10-25T23:38:09.480 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './150' 2023-10-25T23:38:09.480 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/19' 2023-10-25T23:38:09.480 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/15' 2023-10-25T23:38:09.480 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/31' 2023-10-25T23:38:09.480 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/36' 2023-10-25T23:38:09.481 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/20' 2023-10-25T23:38:09.481 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/12' 2023-10-25T23:38:09.481 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/39' 2023-10-25T23:38:09.481 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/10' 2023-10-25T23:38:09.481 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/34' 2023-10-25T23:38:09.482 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/38' 2023-10-25T23:38:09.482 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/11' 2023-10-25T23:38:09.482 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/16' 2023-10-25T23:38:09.482 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/32' 2023-10-25T23:38:09.482 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/30' 2023-10-25T23:38:09.483 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/14' 2023-10-25T23:38:09.483 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/18' 2023-10-25T23:38:09.483 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/13' 2023-10-25T23:38:09.483 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/33' 2023-10-25T23:38:09.483 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/17' 2023-10-25T23:38:09.483 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/35' 2023-10-25T23:38:09.484 INFO:tasks.workunit.client.0.smithi081.stdout:removed './151/37' 2023-10-25T23:38:09.484 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './151' 2023-10-25T23:38:09.484 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/19' 2023-10-25T23:38:09.484 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/15' 2023-10-25T23:38:09.484 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/31' 2023-10-25T23:38:09.485 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/36' 2023-10-25T23:38:09.485 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/20' 2023-10-25T23:38:09.485 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/12' 2023-10-25T23:38:09.485 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/39' 2023-10-25T23:38:09.485 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/10' 2023-10-25T23:38:09.485 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/34' 2023-10-25T23:38:09.486 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/38' 2023-10-25T23:38:09.486 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/11' 2023-10-25T23:38:09.486 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/16' 2023-10-25T23:38:09.486 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/32' 2023-10-25T23:38:09.486 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/30' 2023-10-25T23:38:09.487 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/14' 2023-10-25T23:38:09.487 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/18' 2023-10-25T23:38:09.487 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/13' 2023-10-25T23:38:09.487 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/33' 2023-10-25T23:38:09.487 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/17' 2023-10-25T23:38:09.487 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/35' 2023-10-25T23:38:09.488 INFO:tasks.workunit.client.0.smithi081.stdout:removed './152/37' 2023-10-25T23:38:09.488 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './152' 2023-10-25T23:38:09.488 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/19' 2023-10-25T23:38:09.488 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/15' 2023-10-25T23:38:09.488 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/31' 2023-10-25T23:38:09.489 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/36' 2023-10-25T23:38:09.489 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/20' 2023-10-25T23:38:09.489 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/12' 2023-10-25T23:38:09.489 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/39' 2023-10-25T23:38:09.489 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/10' 2023-10-25T23:38:09.489 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/34' 2023-10-25T23:38:09.490 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/38' 2023-10-25T23:38:09.490 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/11' 2023-10-25T23:38:09.490 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/16' 2023-10-25T23:38:09.490 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/32' 2023-10-25T23:38:09.490 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/30' 2023-10-25T23:38:09.491 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/14' 2023-10-25T23:38:09.491 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/18' 2023-10-25T23:38:09.491 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/13' 2023-10-25T23:38:09.491 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/33' 2023-10-25T23:38:09.491 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/17' 2023-10-25T23:38:09.491 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/35' 2023-10-25T23:38:09.492 INFO:tasks.workunit.client.0.smithi081.stdout:removed './153/37' 2023-10-25T23:38:09.492 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './153' 2023-10-25T23:38:09.492 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/19' 2023-10-25T23:38:09.492 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/15' 2023-10-25T23:38:09.492 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/31' 2023-10-25T23:38:09.492 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/36' 2023-10-25T23:38:09.493 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/20' 2023-10-25T23:38:09.493 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/12' 2023-10-25T23:38:09.493 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/39' 2023-10-25T23:38:09.493 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/10' 2023-10-25T23:38:09.493 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/34' 2023-10-25T23:38:09.494 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/38' 2023-10-25T23:38:09.494 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/11' 2023-10-25T23:38:09.494 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/16' 2023-10-25T23:38:09.494 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/32' 2023-10-25T23:38:09.494 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/30' 2023-10-25T23:38:09.494 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/14' 2023-10-25T23:38:09.495 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/18' 2023-10-25T23:38:09.495 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/13' 2023-10-25T23:38:09.495 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/33' 2023-10-25T23:38:09.495 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/17' 2023-10-25T23:38:09.495 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/35' 2023-10-25T23:38:09.496 INFO:tasks.workunit.client.0.smithi081.stdout:removed './154/37' 2023-10-25T23:38:09.496 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './154' 2023-10-25T23:38:09.496 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/19' 2023-10-25T23:38:09.496 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/15' 2023-10-25T23:38:09.496 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/31' 2023-10-25T23:38:09.496 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/36' 2023-10-25T23:38:09.497 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/20' 2023-10-25T23:38:09.497 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/12' 2023-10-25T23:38:09.497 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/39' 2023-10-25T23:38:09.497 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/10' 2023-10-25T23:38:09.497 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/34' 2023-10-25T23:38:09.497 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/38' 2023-10-25T23:38:09.498 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/11' 2023-10-25T23:38:09.498 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/16' 2023-10-25T23:38:09.498 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/32' 2023-10-25T23:38:09.498 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/30' 2023-10-25T23:38:09.498 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/14' 2023-10-25T23:38:09.499 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/18' 2023-10-25T23:38:09.499 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/13' 2023-10-25T23:38:09.499 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/33' 2023-10-25T23:38:09.499 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/17' 2023-10-25T23:38:09.499 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/35' 2023-10-25T23:38:09.500 INFO:tasks.workunit.client.0.smithi081.stdout:removed './155/37' 2023-10-25T23:38:09.500 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './155' 2023-10-25T23:38:09.500 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/19' 2023-10-25T23:38:09.500 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/15' 2023-10-25T23:38:09.500 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/31' 2023-10-25T23:38:09.500 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/36' 2023-10-25T23:38:09.501 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/20' 2023-10-25T23:38:09.501 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/12' 2023-10-25T23:38:09.501 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/39' 2023-10-25T23:38:09.501 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/10' 2023-10-25T23:38:09.501 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/34' 2023-10-25T23:38:09.502 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/38' 2023-10-25T23:38:09.502 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/11' 2023-10-25T23:38:09.502 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/16' 2023-10-25T23:38:09.502 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/32' 2023-10-25T23:38:09.502 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/30' 2023-10-25T23:38:09.502 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/14' 2023-10-25T23:38:09.503 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/18' 2023-10-25T23:38:09.503 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/13' 2023-10-25T23:38:09.503 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/33' 2023-10-25T23:38:09.503 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/17' 2023-10-25T23:38:09.503 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/35' 2023-10-25T23:38:09.503 INFO:tasks.workunit.client.0.smithi081.stdout:removed './156/37' 2023-10-25T23:38:09.504 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './156' 2023-10-25T23:38:09.504 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/19' 2023-10-25T23:38:09.504 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/15' 2023-10-25T23:38:09.504 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/31' 2023-10-25T23:38:09.505 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/36' 2023-10-25T23:38:09.505 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/20' 2023-10-25T23:38:09.505 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/12' 2023-10-25T23:38:09.505 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/39' 2023-10-25T23:38:09.505 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/10' 2023-10-25T23:38:09.506 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/34' 2023-10-25T23:38:09.506 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/38' 2023-10-25T23:38:09.506 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/11' 2023-10-25T23:38:09.506 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/16' 2023-10-25T23:38:09.506 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/32' 2023-10-25T23:38:09.506 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/30' 2023-10-25T23:38:09.507 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/14' 2023-10-25T23:38:09.507 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/18' 2023-10-25T23:38:09.507 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/13' 2023-10-25T23:38:09.507 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/33' 2023-10-25T23:38:09.880 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/17' 2023-10-25T23:38:09.880 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/35' 2023-10-25T23:38:09.880 INFO:tasks.workunit.client.0.smithi081.stdout:removed './157/37' 2023-10-25T23:38:09.881 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './157' 2023-10-25T23:38:09.881 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/19' 2023-10-25T23:38:09.881 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/15' 2023-10-25T23:38:09.881 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/31' 2023-10-25T23:38:09.881 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/36' 2023-10-25T23:38:09.882 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/20' 2023-10-25T23:38:09.882 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/12' 2023-10-25T23:38:09.882 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/39' 2023-10-25T23:38:09.882 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/10' 2023-10-25T23:38:09.882 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/34' 2023-10-25T23:38:09.882 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/38' 2023-10-25T23:38:09.883 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/11' 2023-10-25T23:38:09.883 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/16' 2023-10-25T23:38:09.883 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/32' 2023-10-25T23:38:09.883 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/30' 2023-10-25T23:38:09.883 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/14' 2023-10-25T23:38:09.884 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/18' 2023-10-25T23:38:09.884 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/13' 2023-10-25T23:38:09.884 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/33' 2023-10-25T23:38:09.884 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/17' 2023-10-25T23:38:09.884 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/35' 2023-10-25T23:38:09.884 INFO:tasks.workunit.client.0.smithi081.stdout:removed './158/37' 2023-10-25T23:38:09.885 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './158' 2023-10-25T23:38:09.885 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/19' 2023-10-25T23:38:09.885 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/15' 2023-10-25T23:38:09.885 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/31' 2023-10-25T23:38:09.885 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/36' 2023-10-25T23:38:09.886 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/20' 2023-10-25T23:38:09.886 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/12' 2023-10-25T23:38:09.886 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/39' 2023-10-25T23:38:09.886 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/10' 2023-10-25T23:38:09.886 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/34' 2023-10-25T23:38:09.886 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/38' 2023-10-25T23:38:09.887 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/11' 2023-10-25T23:38:09.887 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/16' 2023-10-25T23:38:09.887 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/32' 2023-10-25T23:38:09.887 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/30' 2023-10-25T23:38:09.887 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/14' 2023-10-25T23:38:09.888 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/18' 2023-10-25T23:38:09.888 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/13' 2023-10-25T23:38:09.888 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/33' 2023-10-25T23:38:09.888 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/17' 2023-10-25T23:38:09.888 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/35' 2023-10-25T23:38:09.889 INFO:tasks.workunit.client.0.smithi081.stdout:removed './159/37' 2023-10-25T23:38:09.889 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './159' 2023-10-25T23:38:09.889 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/19' 2023-10-25T23:38:09.889 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/15' 2023-10-25T23:38:09.889 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/31' 2023-10-25T23:38:09.889 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/36' 2023-10-25T23:38:09.890 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/20' 2023-10-25T23:38:09.890 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/12' 2023-10-25T23:38:09.890 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/39' 2023-10-25T23:38:09.890 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/10' 2023-10-25T23:38:09.890 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/34' 2023-10-25T23:38:09.891 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/38' 2023-10-25T23:38:09.891 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/11' 2023-10-25T23:38:09.891 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/16' 2023-10-25T23:38:09.891 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/32' 2023-10-25T23:38:09.891 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/30' 2023-10-25T23:38:09.891 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/14' 2023-10-25T23:38:09.892 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/18' 2023-10-25T23:38:09.892 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/13' 2023-10-25T23:38:09.892 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/33' 2023-10-25T23:38:09.892 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/17' 2023-10-25T23:38:09.892 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/35' 2023-10-25T23:38:09.893 INFO:tasks.workunit.client.0.smithi081.stdout:removed './160/37' 2023-10-25T23:38:09.893 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './160' 2023-10-25T23:38:09.893 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/19' 2023-10-25T23:38:09.893 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/15' 2023-10-25T23:38:09.893 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/31' 2023-10-25T23:38:09.893 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/36' 2023-10-25T23:38:09.894 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/20' 2023-10-25T23:38:09.894 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/12' 2023-10-25T23:38:09.894 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/39' 2023-10-25T23:38:09.894 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/10' 2023-10-25T23:38:09.894 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/34' 2023-10-25T23:38:09.894 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/38' 2023-10-25T23:38:09.895 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/11' 2023-10-25T23:38:09.895 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/16' 2023-10-25T23:38:09.895 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/32' 2023-10-25T23:38:09.895 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/30' 2023-10-25T23:38:09.895 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/14' 2023-10-25T23:38:09.896 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/18' 2023-10-25T23:38:09.896 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/13' 2023-10-25T23:38:09.896 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/33' 2023-10-25T23:38:09.896 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/17' 2023-10-25T23:38:09.896 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/35' 2023-10-25T23:38:09.896 INFO:tasks.workunit.client.0.smithi081.stdout:removed './161/37' 2023-10-25T23:38:09.897 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './161' 2023-10-25T23:38:09.897 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/19' 2023-10-25T23:38:09.897 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/15' 2023-10-25T23:38:09.897 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/31' 2023-10-25T23:38:09.897 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/36' 2023-10-25T23:38:09.898 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/20' 2023-10-25T23:38:09.898 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/12' 2023-10-25T23:38:09.898 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/39' 2023-10-25T23:38:09.898 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/10' 2023-10-25T23:38:09.898 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/34' 2023-10-25T23:38:09.898 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/38' 2023-10-25T23:38:09.899 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/11' 2023-10-25T23:38:09.899 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/16' 2023-10-25T23:38:09.899 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/32' 2023-10-25T23:38:09.899 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/30' 2023-10-25T23:38:09.899 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/14' 2023-10-25T23:38:09.900 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/18' 2023-10-25T23:38:09.900 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/13' 2023-10-25T23:38:09.900 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/33' 2023-10-25T23:38:09.900 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/17' 2023-10-25T23:38:09.900 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/35' 2023-10-25T23:38:09.900 INFO:tasks.workunit.client.0.smithi081.stdout:removed './162/37' 2023-10-25T23:38:09.901 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './162' 2023-10-25T23:38:09.901 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/19' 2023-10-25T23:38:09.901 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/15' 2023-10-25T23:38:09.901 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/31' 2023-10-25T23:38:09.901 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/36' 2023-10-25T23:38:09.902 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/20' 2023-10-25T23:38:09.902 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/12' 2023-10-25T23:38:09.902 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/39' 2023-10-25T23:38:09.902 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/10' 2023-10-25T23:38:09.902 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/34' 2023-10-25T23:38:09.902 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/38' 2023-10-25T23:38:09.903 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/11' 2023-10-25T23:38:09.903 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/16' 2023-10-25T23:38:09.903 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/32' 2023-10-25T23:38:09.903 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/30' 2023-10-25T23:38:09.903 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/14' 2023-10-25T23:38:09.904 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/18' 2023-10-25T23:38:09.904 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/13' 2023-10-25T23:38:09.904 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/33' 2023-10-25T23:38:09.904 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/17' 2023-10-25T23:38:09.904 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/35' 2023-10-25T23:38:09.904 INFO:tasks.workunit.client.0.smithi081.stdout:removed './163/37' 2023-10-25T23:38:09.905 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './163' 2023-10-25T23:38:09.905 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/19' 2023-10-25T23:38:09.905 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/15' 2023-10-25T23:38:09.905 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/31' 2023-10-25T23:38:09.905 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/36' 2023-10-25T23:38:09.906 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/20' 2023-10-25T23:38:09.906 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/12' 2023-10-25T23:38:09.906 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/39' 2023-10-25T23:38:09.906 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/10' 2023-10-25T23:38:09.906 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/34' 2023-10-25T23:38:09.906 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/38' 2023-10-25T23:38:09.907 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/11' 2023-10-25T23:38:09.907 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/16' 2023-10-25T23:38:09.907 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/32' 2023-10-25T23:38:09.907 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/30' 2023-10-25T23:38:09.907 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/14' 2023-10-25T23:38:09.908 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/18' 2023-10-25T23:38:09.908 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/13' 2023-10-25T23:38:09.908 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/33' 2023-10-25T23:38:09.908 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/17' 2023-10-25T23:38:09.908 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/35' 2023-10-25T23:38:09.908 INFO:tasks.workunit.client.0.smithi081.stdout:removed './164/37' 2023-10-25T23:38:09.909 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './164' 2023-10-25T23:38:09.909 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/19' 2023-10-25T23:38:09.909 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/15' 2023-10-25T23:38:09.909 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/31' 2023-10-25T23:38:09.909 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/36' 2023-10-25T23:38:09.909 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/20' 2023-10-25T23:38:09.910 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/12' 2023-10-25T23:38:09.910 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/39' 2023-10-25T23:38:09.910 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/10' 2023-10-25T23:38:09.910 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/34' 2023-10-25T23:38:09.910 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/38' 2023-10-25T23:38:09.911 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/11' 2023-10-25T23:38:09.911 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/16' 2023-10-25T23:38:09.911 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/32' 2023-10-25T23:38:09.911 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/30' 2023-10-25T23:38:09.911 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/14' 2023-10-25T23:38:09.911 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/18' 2023-10-25T23:38:09.912 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/13' 2023-10-25T23:38:09.912 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/33' 2023-10-25T23:38:09.912 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/17' 2023-10-25T23:38:09.912 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/35' 2023-10-25T23:38:09.912 INFO:tasks.workunit.client.0.smithi081.stdout:removed './165/37' 2023-10-25T23:38:09.913 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './165' 2023-10-25T23:38:09.913 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/19' 2023-10-25T23:38:09.913 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/15' 2023-10-25T23:38:09.913 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/31' 2023-10-25T23:38:09.913 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/36' 2023-10-25T23:38:09.913 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/20' 2023-10-25T23:38:09.914 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/12' 2023-10-25T23:38:09.914 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/39' 2023-10-25T23:38:09.914 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/10' 2023-10-25T23:38:09.914 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/34' 2023-10-25T23:38:09.914 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/38' 2023-10-25T23:38:09.914 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/11' 2023-10-25T23:38:09.915 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/16' 2023-10-25T23:38:09.915 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/32' 2023-10-25T23:38:09.915 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/30' 2023-10-25T23:38:09.915 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/14' 2023-10-25T23:38:09.915 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/18' 2023-10-25T23:38:09.916 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/13' 2023-10-25T23:38:09.916 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/33' 2023-10-25T23:38:09.916 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/17' 2023-10-25T23:38:09.916 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/35' 2023-10-25T23:38:09.916 INFO:tasks.workunit.client.0.smithi081.stdout:removed './166/37' 2023-10-25T23:38:09.916 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './166' 2023-10-25T23:38:09.917 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/19' 2023-10-25T23:38:09.917 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/15' 2023-10-25T23:38:09.917 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/31' 2023-10-25T23:38:09.917 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/36' 2023-10-25T23:38:09.917 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/20' 2023-10-25T23:38:09.917 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/12' 2023-10-25T23:38:09.918 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/39' 2023-10-25T23:38:09.918 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/10' 2023-10-25T23:38:09.918 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/34' 2023-10-25T23:38:09.918 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/38' 2023-10-25T23:38:10.261 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/11' 2023-10-25T23:38:10.261 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/16' 2023-10-25T23:38:10.261 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/32' 2023-10-25T23:38:10.262 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/30' 2023-10-25T23:38:10.262 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/14' 2023-10-25T23:38:10.262 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/18' 2023-10-25T23:38:10.262 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/13' 2023-10-25T23:38:10.262 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/33' 2023-10-25T23:38:10.263 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/17' 2023-10-25T23:38:10.263 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/35' 2023-10-25T23:38:10.263 INFO:tasks.workunit.client.0.smithi081.stdout:removed './167/37' 2023-10-25T23:38:10.263 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './167' 2023-10-25T23:38:10.263 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/19' 2023-10-25T23:38:10.264 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/15' 2023-10-25T23:38:10.264 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/31' 2023-10-25T23:38:10.264 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/36' 2023-10-25T23:38:10.264 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/20' 2023-10-25T23:38:10.264 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/12' 2023-10-25T23:38:10.265 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/39' 2023-10-25T23:38:10.265 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/10' 2023-10-25T23:38:10.265 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/34' 2023-10-25T23:38:10.265 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/38' 2023-10-25T23:38:10.265 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/11' 2023-10-25T23:38:10.265 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/16' 2023-10-25T23:38:10.266 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/32' 2023-10-25T23:38:10.266 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/30' 2023-10-25T23:38:10.266 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/14' 2023-10-25T23:38:10.266 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/18' 2023-10-25T23:38:10.266 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/13' 2023-10-25T23:38:10.267 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/33' 2023-10-25T23:38:10.267 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/17' 2023-10-25T23:38:10.267 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/35' 2023-10-25T23:38:10.267 INFO:tasks.workunit.client.0.smithi081.stdout:removed './168/37' 2023-10-25T23:38:10.267 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './168' 2023-10-25T23:38:10.268 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/19' 2023-10-25T23:38:10.268 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/15' 2023-10-25T23:38:10.268 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/31' 2023-10-25T23:38:10.268 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/36' 2023-10-25T23:38:10.268 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/20' 2023-10-25T23:38:10.269 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/12' 2023-10-25T23:38:10.269 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/39' 2023-10-25T23:38:10.269 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/10' 2023-10-25T23:38:10.269 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/34' 2023-10-25T23:38:10.269 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/38' 2023-10-25T23:38:10.270 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/11' 2023-10-25T23:38:10.270 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/16' 2023-10-25T23:38:10.270 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/32' 2023-10-25T23:38:10.270 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/30' 2023-10-25T23:38:10.270 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/14' 2023-10-25T23:38:10.271 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/18' 2023-10-25T23:38:10.271 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/13' 2023-10-25T23:38:10.271 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/33' 2023-10-25T23:38:10.271 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/17' 2023-10-25T23:38:10.271 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/35' 2023-10-25T23:38:10.272 INFO:tasks.workunit.client.0.smithi081.stdout:removed './169/37' 2023-10-25T23:38:10.272 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './169' 2023-10-25T23:38:10.272 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/19' 2023-10-25T23:38:10.272 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/15' 2023-10-25T23:38:10.273 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/31' 2023-10-25T23:38:10.273 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/36' 2023-10-25T23:38:10.273 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/20' 2023-10-25T23:38:10.274 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/12' 2023-10-25T23:38:10.274 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/39' 2023-10-25T23:38:10.274 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/10' 2023-10-25T23:38:10.274 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/34' 2023-10-25T23:38:10.274 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/38' 2023-10-25T23:38:10.275 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/11' 2023-10-25T23:38:10.275 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/16' 2023-10-25T23:38:10.275 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/32' 2023-10-25T23:38:10.276 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/30' 2023-10-25T23:38:10.276 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/14' 2023-10-25T23:38:10.276 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/18' 2023-10-25T23:38:10.276 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/13' 2023-10-25T23:38:10.277 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/33' 2023-10-25T23:38:10.277 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/17' 2023-10-25T23:38:10.277 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/35' 2023-10-25T23:38:10.277 INFO:tasks.workunit.client.0.smithi081.stdout:removed './170/37' 2023-10-25T23:38:10.278 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './170' 2023-10-25T23:38:10.278 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/19' 2023-10-25T23:38:10.278 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/15' 2023-10-25T23:38:10.278 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/31' 2023-10-25T23:38:10.278 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/36' 2023-10-25T23:38:10.279 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/20' 2023-10-25T23:38:10.279 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/12' 2023-10-25T23:38:10.279 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/39' 2023-10-25T23:38:10.279 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/10' 2023-10-25T23:38:10.279 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/34' 2023-10-25T23:38:10.279 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/38' 2023-10-25T23:38:10.280 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/11' 2023-10-25T23:38:10.280 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/16' 2023-10-25T23:38:10.280 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/32' 2023-10-25T23:38:10.280 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/30' 2023-10-25T23:38:10.280 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/14' 2023-10-25T23:38:10.281 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/18' 2023-10-25T23:38:10.281 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/13' 2023-10-25T23:38:10.281 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/33' 2023-10-25T23:38:10.281 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/17' 2023-10-25T23:38:10.281 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/35' 2023-10-25T23:38:10.282 INFO:tasks.workunit.client.0.smithi081.stdout:removed './171/37' 2023-10-25T23:38:10.282 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './171' 2023-10-25T23:38:10.282 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/19' 2023-10-25T23:38:10.282 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/15' 2023-10-25T23:38:10.282 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/31' 2023-10-25T23:38:10.283 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/36' 2023-10-25T23:38:10.283 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/20' 2023-10-25T23:38:10.283 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/12' 2023-10-25T23:38:10.283 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/39' 2023-10-25T23:38:10.283 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/10' 2023-10-25T23:38:10.283 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/34' 2023-10-25T23:38:10.284 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/38' 2023-10-25T23:38:10.284 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/11' 2023-10-25T23:38:10.284 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/16' 2023-10-25T23:38:10.284 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/32' 2023-10-25T23:38:10.284 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/30' 2023-10-25T23:38:10.285 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/14' 2023-10-25T23:38:10.285 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/18' 2023-10-25T23:38:10.285 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/13' 2023-10-25T23:38:10.285 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/33' 2023-10-25T23:38:10.285 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/17' 2023-10-25T23:38:10.285 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/35' 2023-10-25T23:38:10.286 INFO:tasks.workunit.client.0.smithi081.stdout:removed './172/37' 2023-10-25T23:38:10.286 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './172' 2023-10-25T23:38:10.286 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/19' 2023-10-25T23:38:10.286 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/15' 2023-10-25T23:38:10.286 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/31' 2023-10-25T23:38:10.287 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/36' 2023-10-25T23:38:10.287 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/20' 2023-10-25T23:38:10.287 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/12' 2023-10-25T23:38:10.287 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/39' 2023-10-25T23:38:10.287 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/10' 2023-10-25T23:38:10.288 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/34' 2023-10-25T23:38:10.288 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/38' 2023-10-25T23:38:10.288 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/11' 2023-10-25T23:38:10.288 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/16' 2023-10-25T23:38:10.288 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/32' 2023-10-25T23:38:10.289 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/30' 2023-10-25T23:38:10.289 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/14' 2023-10-25T23:38:10.289 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/18' 2023-10-25T23:38:10.289 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/13' 2023-10-25T23:38:10.289 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/33' 2023-10-25T23:38:10.290 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/17' 2023-10-25T23:38:10.290 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/35' 2023-10-25T23:38:10.290 INFO:tasks.workunit.client.0.smithi081.stdout:removed './173/37' 2023-10-25T23:38:10.290 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './173' 2023-10-25T23:38:10.290 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/19' 2023-10-25T23:38:10.290 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/15' 2023-10-25T23:38:10.291 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/31' 2023-10-25T23:38:10.291 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/36' 2023-10-25T23:38:10.291 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/20' 2023-10-25T23:38:10.291 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/12' 2023-10-25T23:38:10.291 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/39' 2023-10-25T23:38:10.291 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/10' 2023-10-25T23:38:10.292 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/34' 2023-10-25T23:38:10.292 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/38' 2023-10-25T23:38:10.292 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/11' 2023-10-25T23:38:10.292 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/16' 2023-10-25T23:38:10.292 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/32' 2023-10-25T23:38:10.293 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/30' 2023-10-25T23:38:10.293 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/14' 2023-10-25T23:38:10.293 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/18' 2023-10-25T23:38:10.293 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/13' 2023-10-25T23:38:10.293 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/33' 2023-10-25T23:38:10.294 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/17' 2023-10-25T23:38:10.294 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/35' 2023-10-25T23:38:10.294 INFO:tasks.workunit.client.0.smithi081.stdout:removed './174/37' 2023-10-25T23:38:10.294 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './174' 2023-10-25T23:38:10.294 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/19' 2023-10-25T23:38:10.295 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/15' 2023-10-25T23:38:10.295 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/31' 2023-10-25T23:38:10.295 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/36' 2023-10-25T23:38:10.295 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/20' 2023-10-25T23:38:10.295 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/12' 2023-10-25T23:38:10.295 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/39' 2023-10-25T23:38:10.296 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/10' 2023-10-25T23:38:10.296 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/34' 2023-10-25T23:38:10.296 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/38' 2023-10-25T23:38:10.296 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/11' 2023-10-25T23:38:10.296 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/16' 2023-10-25T23:38:10.297 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/32' 2023-10-25T23:38:10.297 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/30' 2023-10-25T23:38:10.297 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/14' 2023-10-25T23:38:10.298 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/18' 2023-10-25T23:38:10.298 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/13' 2023-10-25T23:38:10.298 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/33' 2023-10-25T23:38:10.298 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/17' 2023-10-25T23:38:10.298 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/35' 2023-10-25T23:38:10.299 INFO:tasks.workunit.client.0.smithi081.stdout:removed './175/37' 2023-10-25T23:38:10.299 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './175' 2023-10-25T23:38:10.299 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/19' 2023-10-25T23:38:10.299 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/15' 2023-10-25T23:38:10.299 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/31' 2023-10-25T23:38:10.300 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/36' 2023-10-25T23:38:10.300 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/20' 2023-10-25T23:38:10.300 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/12' 2023-10-25T23:38:10.300 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/39' 2023-10-25T23:38:10.300 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/10' 2023-10-25T23:38:10.300 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/34' 2023-10-25T23:38:10.301 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/38' 2023-10-25T23:38:10.301 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/11' 2023-10-25T23:38:10.301 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/16' 2023-10-25T23:38:10.301 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/32' 2023-10-25T23:38:10.301 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/30' 2023-10-25T23:38:10.302 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/14' 2023-10-25T23:38:10.302 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/18' 2023-10-25T23:38:10.302 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/13' 2023-10-25T23:38:10.302 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/33' 2023-10-25T23:38:10.303 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/17' 2023-10-25T23:38:10.303 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/35' 2023-10-25T23:38:10.303 INFO:tasks.workunit.client.0.smithi081.stdout:removed './176/37' 2023-10-25T23:38:10.303 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './176' 2023-10-25T23:38:10.303 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/19' 2023-10-25T23:38:10.304 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/15' 2023-10-25T23:38:10.737 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/31' 2023-10-25T23:38:10.738 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/36' 2023-10-25T23:38:10.738 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/20' 2023-10-25T23:38:10.738 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/12' 2023-10-25T23:38:10.738 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/39' 2023-10-25T23:38:10.739 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/10' 2023-10-25T23:38:10.739 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/34' 2023-10-25T23:38:10.739 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/38' 2023-10-25T23:38:10.739 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/11' 2023-10-25T23:38:10.740 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/16' 2023-10-25T23:38:10.740 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/32' 2023-10-25T23:38:10.740 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/30' 2023-10-25T23:38:10.740 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/14' 2023-10-25T23:38:10.740 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/18' 2023-10-25T23:38:10.741 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/13' 2023-10-25T23:38:10.741 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/33' 2023-10-25T23:38:10.741 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/17' 2023-10-25T23:38:10.741 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/35' 2023-10-25T23:38:10.741 INFO:tasks.workunit.client.0.smithi081.stdout:removed './177/37' 2023-10-25T23:38:10.741 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './177' 2023-10-25T23:38:10.742 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/19' 2023-10-25T23:38:10.742 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/15' 2023-10-25T23:38:10.742 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/31' 2023-10-25T23:38:10.742 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/36' 2023-10-25T23:38:10.742 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/20' 2023-10-25T23:38:10.743 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/12' 2023-10-25T23:38:10.743 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/39' 2023-10-25T23:38:10.743 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/10' 2023-10-25T23:38:10.743 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/34' 2023-10-25T23:38:10.743 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/38' 2023-10-25T23:38:10.744 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/11' 2023-10-25T23:38:10.744 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/16' 2023-10-25T23:38:10.744 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/32' 2023-10-25T23:38:10.744 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/30' 2023-10-25T23:38:10.744 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/14' 2023-10-25T23:38:10.745 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/18' 2023-10-25T23:38:10.745 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/13' 2023-10-25T23:38:10.745 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/33' 2023-10-25T23:38:10.745 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/17' 2023-10-25T23:38:10.745 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/35' 2023-10-25T23:38:10.745 INFO:tasks.workunit.client.0.smithi081.stdout:removed './178/37' 2023-10-25T23:38:10.746 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './178' 2023-10-25T23:38:10.746 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/19' 2023-10-25T23:38:10.746 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/15' 2023-10-25T23:38:10.746 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/31' 2023-10-25T23:38:10.746 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/36' 2023-10-25T23:38:10.747 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/20' 2023-10-25T23:38:10.747 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/12' 2023-10-25T23:38:10.747 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/39' 2023-10-25T23:38:10.747 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/10' 2023-10-25T23:38:10.747 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/34' 2023-10-25T23:38:10.748 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/38' 2023-10-25T23:38:10.748 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/11' 2023-10-25T23:38:10.748 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/16' 2023-10-25T23:38:10.748 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/32' 2023-10-25T23:38:10.748 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/30' 2023-10-25T23:38:10.748 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/14' 2023-10-25T23:38:10.749 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/18' 2023-10-25T23:38:10.749 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/13' 2023-10-25T23:38:10.749 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/33' 2023-10-25T23:38:10.749 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/17' 2023-10-25T23:38:10.749 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/35' 2023-10-25T23:38:10.750 INFO:tasks.workunit.client.0.smithi081.stdout:removed './179/37' 2023-10-25T23:38:10.750 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './179' 2023-10-25T23:38:10.750 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/19' 2023-10-25T23:38:10.750 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/15' 2023-10-25T23:38:10.751 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/31' 2023-10-25T23:38:10.753 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/36' 2023-10-25T23:38:10.753 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/20' 2023-10-25T23:38:10.753 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/12' 2023-10-25T23:38:10.754 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/39' 2023-10-25T23:38:10.754 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/10' 2023-10-25T23:38:10.754 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/34' 2023-10-25T23:38:10.754 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/38' 2023-10-25T23:38:10.754 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/11' 2023-10-25T23:38:10.755 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/16' 2023-10-25T23:38:10.755 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/32' 2023-10-25T23:38:10.755 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/30' 2023-10-25T23:38:10.755 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/14' 2023-10-25T23:38:10.755 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/18' 2023-10-25T23:38:10.756 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/13' 2023-10-25T23:38:10.756 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/33' 2023-10-25T23:38:10.756 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/17' 2023-10-25T23:38:10.756 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/35' 2023-10-25T23:38:10.756 INFO:tasks.workunit.client.0.smithi081.stdout:removed './180/37' 2023-10-25T23:38:10.757 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './180' 2023-10-25T23:38:10.757 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/19' 2023-10-25T23:38:10.757 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/15' 2023-10-25T23:38:10.757 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/31' 2023-10-25T23:38:10.757 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/36' 2023-10-25T23:38:10.758 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/20' 2023-10-25T23:38:10.758 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/12' 2023-10-25T23:38:10.758 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/39' 2023-10-25T23:38:10.758 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/10' 2023-10-25T23:38:10.758 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/34' 2023-10-25T23:38:10.759 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/38' 2023-10-25T23:38:10.759 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/11' 2023-10-25T23:38:10.760 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/16' 2023-10-25T23:38:10.760 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/32' 2023-10-25T23:38:10.760 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/30' 2023-10-25T23:38:10.760 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/14' 2023-10-25T23:38:10.760 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/18' 2023-10-25T23:38:10.760 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/13' 2023-10-25T23:38:10.761 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/33' 2023-10-25T23:38:10.761 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/17' 2023-10-25T23:38:10.761 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/35' 2023-10-25T23:38:10.761 INFO:tasks.workunit.client.0.smithi081.stdout:removed './181/37' 2023-10-25T23:38:10.761 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './181' 2023-10-25T23:38:10.762 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/19' 2023-10-25T23:38:10.762 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/15' 2023-10-25T23:38:10.762 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/31' 2023-10-25T23:38:10.762 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/36' 2023-10-25T23:38:10.762 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/20' 2023-10-25T23:38:10.763 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/12' 2023-10-25T23:38:10.763 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/39' 2023-10-25T23:38:10.763 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/10' 2023-10-25T23:38:10.763 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/34' 2023-10-25T23:38:10.763 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/38' 2023-10-25T23:38:10.764 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/11' 2023-10-25T23:38:10.764 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/16' 2023-10-25T23:38:10.764 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/32' 2023-10-25T23:38:10.764 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/30' 2023-10-25T23:38:10.764 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/14' 2023-10-25T23:38:10.765 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/18' 2023-10-25T23:38:10.765 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/13' 2023-10-25T23:38:10.765 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/33' 2023-10-25T23:38:10.765 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/17' 2023-10-25T23:38:10.765 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/35' 2023-10-25T23:38:10.766 INFO:tasks.workunit.client.0.smithi081.stdout:removed './182/37' 2023-10-25T23:38:10.766 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './182' 2023-10-25T23:38:10.766 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/19' 2023-10-25T23:38:10.766 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/15' 2023-10-25T23:38:10.766 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/31' 2023-10-25T23:38:10.766 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/36' 2023-10-25T23:38:10.767 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/20' 2023-10-25T23:38:10.767 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/12' 2023-10-25T23:38:10.767 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/39' 2023-10-25T23:38:10.767 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/10' 2023-10-25T23:38:10.767 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/34' 2023-10-25T23:38:10.768 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/38' 2023-10-25T23:38:10.768 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/11' 2023-10-25T23:38:10.768 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/16' 2023-10-25T23:38:10.768 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/32' 2023-10-25T23:38:10.768 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/30' 2023-10-25T23:38:10.768 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/14' 2023-10-25T23:38:10.769 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/18' 2023-10-25T23:38:10.769 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/13' 2023-10-25T23:38:10.769 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/33' 2023-10-25T23:38:10.769 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/17' 2023-10-25T23:38:10.769 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/35' 2023-10-25T23:38:10.770 INFO:tasks.workunit.client.0.smithi081.stdout:removed './183/37' 2023-10-25T23:38:10.770 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './183' 2023-10-25T23:38:10.770 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/19' 2023-10-25T23:38:10.770 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/15' 2023-10-25T23:38:10.770 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/31' 2023-10-25T23:38:10.771 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/36' 2023-10-25T23:38:10.771 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/20' 2023-10-25T23:38:10.771 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/12' 2023-10-25T23:38:10.771 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/39' 2023-10-25T23:38:10.771 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/10' 2023-10-25T23:38:10.772 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/34' 2023-10-25T23:38:10.772 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/38' 2023-10-25T23:38:10.772 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/11' 2023-10-25T23:38:10.772 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/16' 2023-10-25T23:38:10.772 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/32' 2023-10-25T23:38:10.772 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/30' 2023-10-25T23:38:10.773 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/14' 2023-10-25T23:38:10.773 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/18' 2023-10-25T23:38:10.773 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/13' 2023-10-25T23:38:10.773 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/33' 2023-10-25T23:38:10.773 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/17' 2023-10-25T23:38:10.774 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/35' 2023-10-25T23:38:10.774 INFO:tasks.workunit.client.0.smithi081.stdout:removed './184/37' 2023-10-25T23:38:10.774 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './184' 2023-10-25T23:38:10.774 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/19' 2023-10-25T23:38:10.774 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/15' 2023-10-25T23:38:10.775 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/31' 2023-10-25T23:38:10.775 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/36' 2023-10-25T23:38:10.775 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/20' 2023-10-25T23:38:10.775 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/12' 2023-10-25T23:38:10.775 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/39' 2023-10-25T23:38:10.776 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/10' 2023-10-25T23:38:10.776 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/34' 2023-10-25T23:38:10.776 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/38' 2023-10-25T23:38:10.776 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/11' 2023-10-25T23:38:10.776 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/16' 2023-10-25T23:38:10.776 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/32' 2023-10-25T23:38:10.777 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/30' 2023-10-25T23:38:10.777 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/14' 2023-10-25T23:38:10.777 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/18' 2023-10-25T23:38:10.777 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/13' 2023-10-25T23:38:10.777 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/33' 2023-10-25T23:38:10.778 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/17' 2023-10-25T23:38:10.778 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/35' 2023-10-25T23:38:10.778 INFO:tasks.workunit.client.0.smithi081.stdout:removed './185/37' 2023-10-25T23:38:10.778 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './185' 2023-10-25T23:38:10.778 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/19' 2023-10-25T23:38:10.779 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/15' 2023-10-25T23:38:10.779 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/31' 2023-10-25T23:38:10.779 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/36' 2023-10-25T23:38:10.779 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/20' 2023-10-25T23:38:10.779 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/12' 2023-10-25T23:38:10.779 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/39' 2023-10-25T23:38:10.780 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/10' 2023-10-25T23:38:10.780 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/34' 2023-10-25T23:38:10.780 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/38' 2023-10-25T23:38:10.780 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/11' 2023-10-25T23:38:10.780 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/16' 2023-10-25T23:38:10.781 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/32' 2023-10-25T23:38:10.781 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/30' 2023-10-25T23:38:10.781 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/14' 2023-10-25T23:38:10.781 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/18' 2023-10-25T23:38:11.126 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/13' 2023-10-25T23:38:11.126 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/33' 2023-10-25T23:38:11.127 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/17' 2023-10-25T23:38:11.127 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/35' 2023-10-25T23:38:11.127 INFO:tasks.workunit.client.0.smithi081.stdout:removed './186/37' 2023-10-25T23:38:11.127 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './186' 2023-10-25T23:38:11.127 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/19' 2023-10-25T23:38:11.128 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/15' 2023-10-25T23:38:11.128 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/31' 2023-10-25T23:38:11.128 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/36' 2023-10-25T23:38:11.128 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/20' 2023-10-25T23:38:11.128 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/12' 2023-10-25T23:38:11.129 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/39' 2023-10-25T23:38:11.129 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/10' 2023-10-25T23:38:11.129 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/34' 2023-10-25T23:38:11.129 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/38' 2023-10-25T23:38:11.129 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/11' 2023-10-25T23:38:11.130 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/16' 2023-10-25T23:38:11.130 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/32' 2023-10-25T23:38:11.130 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/30' 2023-10-25T23:38:11.130 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/14' 2023-10-25T23:38:11.130 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/18' 2023-10-25T23:38:11.131 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/13' 2023-10-25T23:38:11.131 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/33' 2023-10-25T23:38:11.131 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/17' 2023-10-25T23:38:11.131 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/35' 2023-10-25T23:38:11.131 INFO:tasks.workunit.client.0.smithi081.stdout:removed './187/37' 2023-10-25T23:38:11.132 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './187' 2023-10-25T23:38:11.132 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/19' 2023-10-25T23:38:11.132 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/15' 2023-10-25T23:38:11.132 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/31' 2023-10-25T23:38:11.132 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/36' 2023-10-25T23:38:11.133 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/20' 2023-10-25T23:38:11.133 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/12' 2023-10-25T23:38:11.133 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/39' 2023-10-25T23:38:11.133 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/10' 2023-10-25T23:38:11.133 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/34' 2023-10-25T23:38:11.134 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/38' 2023-10-25T23:38:11.134 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/11' 2023-10-25T23:38:11.134 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/16' 2023-10-25T23:38:11.134 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/32' 2023-10-25T23:38:11.134 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/30' 2023-10-25T23:38:11.135 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/14' 2023-10-25T23:38:11.135 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/18' 2023-10-25T23:38:11.135 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/13' 2023-10-25T23:38:11.135 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/33' 2023-10-25T23:38:11.135 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/17' 2023-10-25T23:38:11.135 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/35' 2023-10-25T23:38:11.136 INFO:tasks.workunit.client.0.smithi081.stdout:removed './188/37' 2023-10-25T23:38:11.136 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './188' 2023-10-25T23:38:11.136 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/19' 2023-10-25T23:38:11.136 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/15' 2023-10-25T23:38:11.136 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/31' 2023-10-25T23:38:11.137 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/36' 2023-10-25T23:38:11.137 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/20' 2023-10-25T23:38:11.137 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/12' 2023-10-25T23:38:11.137 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/39' 2023-10-25T23:38:11.137 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/10' 2023-10-25T23:38:11.138 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/34' 2023-10-25T23:38:11.138 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/38' 2023-10-25T23:38:11.138 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/11' 2023-10-25T23:38:11.138 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/16' 2023-10-25T23:38:11.139 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/32' 2023-10-25T23:38:11.139 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/30' 2023-10-25T23:38:11.139 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/14' 2023-10-25T23:38:11.139 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/18' 2023-10-25T23:38:11.139 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/13' 2023-10-25T23:38:11.140 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/33' 2023-10-25T23:38:11.140 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/17' 2023-10-25T23:38:11.140 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/35' 2023-10-25T23:38:11.140 INFO:tasks.workunit.client.0.smithi081.stdout:removed './189/37' 2023-10-25T23:38:11.140 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './189' 2023-10-25T23:38:11.141 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/19' 2023-10-25T23:38:11.141 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/15' 2023-10-25T23:38:11.141 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/31' 2023-10-25T23:38:11.141 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/36' 2023-10-25T23:38:11.141 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/20' 2023-10-25T23:38:11.141 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/12' 2023-10-25T23:38:11.142 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/39' 2023-10-25T23:38:11.142 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/10' 2023-10-25T23:38:11.142 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/34' 2023-10-25T23:38:11.142 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/38' 2023-10-25T23:38:11.142 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/11' 2023-10-25T23:38:11.143 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/16' 2023-10-25T23:38:11.143 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/32' 2023-10-25T23:38:11.143 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/30' 2023-10-25T23:38:11.143 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/14' 2023-10-25T23:38:11.143 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/18' 2023-10-25T23:38:11.143 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/13' 2023-10-25T23:38:11.144 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/33' 2023-10-25T23:38:11.144 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/17' 2023-10-25T23:38:11.144 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/35' 2023-10-25T23:38:11.144 INFO:tasks.workunit.client.0.smithi081.stdout:removed './190/37' 2023-10-25T23:38:11.144 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './190' 2023-10-25T23:38:11.144 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/19' 2023-10-25T23:38:11.145 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/15' 2023-10-25T23:38:11.145 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/31' 2023-10-25T23:38:11.145 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/36' 2023-10-25T23:38:11.145 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/20' 2023-10-25T23:38:11.145 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/12' 2023-10-25T23:38:11.146 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/39' 2023-10-25T23:38:11.146 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/10' 2023-10-25T23:38:11.146 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/34' 2023-10-25T23:38:11.146 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/38' 2023-10-25T23:38:11.146 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/11' 2023-10-25T23:38:11.147 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/16' 2023-10-25T23:38:11.147 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/32' 2023-10-25T23:38:11.147 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/30' 2023-10-25T23:38:11.147 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/14' 2023-10-25T23:38:11.147 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/18' 2023-10-25T23:38:11.148 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/13' 2023-10-25T23:38:11.148 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/33' 2023-10-25T23:38:11.148 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/17' 2023-10-25T23:38:11.148 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/35' 2023-10-25T23:38:11.148 INFO:tasks.workunit.client.0.smithi081.stdout:removed './191/37' 2023-10-25T23:38:11.148 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './191' 2023-10-25T23:38:11.149 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/19' 2023-10-25T23:38:11.149 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/15' 2023-10-25T23:38:11.149 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/31' 2023-10-25T23:38:11.149 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/36' 2023-10-25T23:38:11.149 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/20' 2023-10-25T23:38:11.150 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/12' 2023-10-25T23:38:11.150 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/39' 2023-10-25T23:38:11.150 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/10' 2023-10-25T23:38:11.150 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/34' 2023-10-25T23:38:11.151 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/38' 2023-10-25T23:38:11.151 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/11' 2023-10-25T23:38:11.151 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/16' 2023-10-25T23:38:11.151 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/32' 2023-10-25T23:38:11.151 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/30' 2023-10-25T23:38:11.151 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/14' 2023-10-25T23:38:11.152 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/18' 2023-10-25T23:38:11.152 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/13' 2023-10-25T23:38:11.152 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/33' 2023-10-25T23:38:11.152 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/17' 2023-10-25T23:38:11.152 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/35' 2023-10-25T23:38:11.153 INFO:tasks.workunit.client.0.smithi081.stdout:removed './192/37' 2023-10-25T23:38:11.153 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './192' 2023-10-25T23:38:11.153 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/19' 2023-10-25T23:38:11.153 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/15' 2023-10-25T23:38:11.153 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/31' 2023-10-25T23:38:11.154 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/36' 2023-10-25T23:38:11.154 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/20' 2023-10-25T23:38:11.154 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/12' 2023-10-25T23:38:11.154 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/39' 2023-10-25T23:38:11.154 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/10' 2023-10-25T23:38:11.154 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/34' 2023-10-25T23:38:11.155 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/38' 2023-10-25T23:38:11.155 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/11' 2023-10-25T23:38:11.155 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/16' 2023-10-25T23:38:11.155 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/32' 2023-10-25T23:38:11.155 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/30' 2023-10-25T23:38:11.156 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/14' 2023-10-25T23:38:11.156 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/18' 2023-10-25T23:38:11.156 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/13' 2023-10-25T23:38:11.156 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/33' 2023-10-25T23:38:11.156 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/17' 2023-10-25T23:38:11.156 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/35' 2023-10-25T23:38:11.157 INFO:tasks.workunit.client.0.smithi081.stdout:removed './193/37' 2023-10-25T23:38:11.157 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './193' 2023-10-25T23:38:11.157 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/19' 2023-10-25T23:38:11.157 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/15' 2023-10-25T23:38:11.157 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/31' 2023-10-25T23:38:11.158 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/36' 2023-10-25T23:38:11.158 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/20' 2023-10-25T23:38:11.158 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/12' 2023-10-25T23:38:11.158 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/39' 2023-10-25T23:38:11.158 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/10' 2023-10-25T23:38:11.159 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/34' 2023-10-25T23:38:11.159 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/38' 2023-10-25T23:38:11.159 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/11' 2023-10-25T23:38:11.159 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/16' 2023-10-25T23:38:11.159 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/32' 2023-10-25T23:38:11.161 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/30' 2023-10-25T23:38:11.161 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/14' 2023-10-25T23:38:11.162 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/18' 2023-10-25T23:38:11.162 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/13' 2023-10-25T23:38:11.162 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/33' 2023-10-25T23:38:11.162 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/17' 2023-10-25T23:38:11.162 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/35' 2023-10-25T23:38:11.163 INFO:tasks.workunit.client.0.smithi081.stdout:removed './194/37' 2023-10-25T23:38:11.163 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './194' 2023-10-25T23:38:11.163 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/19' 2023-10-25T23:38:11.163 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/15' 2023-10-25T23:38:11.163 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/31' 2023-10-25T23:38:11.164 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/36' 2023-10-25T23:38:11.164 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/20' 2023-10-25T23:38:11.164 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/12' 2023-10-25T23:38:11.164 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/39' 2023-10-25T23:38:11.164 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/10' 2023-10-25T23:38:11.165 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/34' 2023-10-25T23:38:11.165 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/38' 2023-10-25T23:38:11.165 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/11' 2023-10-25T23:38:11.165 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/16' 2023-10-25T23:38:11.165 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/32' 2023-10-25T23:38:11.166 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/30' 2023-10-25T23:38:11.166 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/14' 2023-10-25T23:38:11.166 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/18' 2023-10-25T23:38:11.166 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/13' 2023-10-25T23:38:11.166 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/33' 2023-10-25T23:38:11.167 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/17' 2023-10-25T23:38:11.167 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/35' 2023-10-25T23:38:11.167 INFO:tasks.workunit.client.0.smithi081.stdout:removed './195/37' 2023-10-25T23:38:11.167 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './195' 2023-10-25T23:38:11.167 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/19' 2023-10-25T23:38:11.168 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/15' 2023-10-25T23:38:11.168 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/31' 2023-10-25T23:38:11.168 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/36' 2023-10-25T23:38:11.168 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/20' 2023-10-25T23:38:11.168 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/12' 2023-10-25T23:38:11.169 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/39' 2023-10-25T23:38:11.169 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/10' 2023-10-25T23:38:11.625 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/34' 2023-10-25T23:38:11.626 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/38' 2023-10-25T23:38:11.626 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/11' 2023-10-25T23:38:11.626 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/16' 2023-10-25T23:38:11.626 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/32' 2023-10-25T23:38:11.627 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/30' 2023-10-25T23:38:11.627 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/14' 2023-10-25T23:38:11.627 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/18' 2023-10-25T23:38:11.627 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/13' 2023-10-25T23:38:11.627 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/33' 2023-10-25T23:38:11.628 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/17' 2023-10-25T23:38:11.628 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/35' 2023-10-25T23:38:11.628 INFO:tasks.workunit.client.0.smithi081.stdout:removed './196/37' 2023-10-25T23:38:11.628 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './196' 2023-10-25T23:38:11.628 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/19' 2023-10-25T23:38:11.629 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/15' 2023-10-25T23:38:11.629 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/31' 2023-10-25T23:38:11.629 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/36' 2023-10-25T23:38:11.629 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/20' 2023-10-25T23:38:11.629 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/12' 2023-10-25T23:38:11.629 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/39' 2023-10-25T23:38:11.630 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/10' 2023-10-25T23:38:11.630 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/34' 2023-10-25T23:38:11.630 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/38' 2023-10-25T23:38:11.630 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/11' 2023-10-25T23:38:11.630 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/16' 2023-10-25T23:38:11.631 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/32' 2023-10-25T23:38:11.631 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/30' 2023-10-25T23:38:11.631 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/14' 2023-10-25T23:38:11.631 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/18' 2023-10-25T23:38:11.631 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/13' 2023-10-25T23:38:11.631 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/33' 2023-10-25T23:38:11.632 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/17' 2023-10-25T23:38:11.632 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/35' 2023-10-25T23:38:11.632 INFO:tasks.workunit.client.0.smithi081.stdout:removed './197/37' 2023-10-25T23:38:11.632 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './197' 2023-10-25T23:38:11.632 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/19' 2023-10-25T23:38:11.633 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/15' 2023-10-25T23:38:11.633 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/31' 2023-10-25T23:38:11.633 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/36' 2023-10-25T23:38:11.633 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/20' 2023-10-25T23:38:11.633 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/12' 2023-10-25T23:38:11.634 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/39' 2023-10-25T23:38:11.634 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/10' 2023-10-25T23:38:11.634 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/34' 2023-10-25T23:38:11.634 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/38' 2023-10-25T23:38:11.634 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/11' 2023-10-25T23:38:11.635 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/16' 2023-10-25T23:38:11.635 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/32' 2023-10-25T23:38:11.635 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/30' 2023-10-25T23:38:11.635 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/14' 2023-10-25T23:38:11.635 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/18' 2023-10-25T23:38:11.635 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/13' 2023-10-25T23:38:11.636 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/33' 2023-10-25T23:38:11.636 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/17' 2023-10-25T23:38:11.636 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/35' 2023-10-25T23:38:11.636 INFO:tasks.workunit.client.0.smithi081.stdout:removed './198/37' 2023-10-25T23:38:11.636 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './198' 2023-10-25T23:38:11.637 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/19' 2023-10-25T23:38:11.637 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/15' 2023-10-25T23:38:11.637 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/31' 2023-10-25T23:38:11.637 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/36' 2023-10-25T23:38:11.637 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/20' 2023-10-25T23:38:11.637 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/12' 2023-10-25T23:38:11.638 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/39' 2023-10-25T23:38:11.638 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/10' 2023-10-25T23:38:11.638 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/34' 2023-10-25T23:38:11.638 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/38' 2023-10-25T23:38:11.638 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/11' 2023-10-25T23:38:11.639 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/16' 2023-10-25T23:38:11.639 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/32' 2023-10-25T23:38:11.639 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/30' 2023-10-25T23:38:11.639 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/14' 2023-10-25T23:38:11.639 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/18' 2023-10-25T23:38:11.640 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/13' 2023-10-25T23:38:11.640 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/33' 2023-10-25T23:38:11.640 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/17' 2023-10-25T23:38:11.640 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/35' 2023-10-25T23:38:11.640 INFO:tasks.workunit.client.0.smithi081.stdout:removed './199/37' 2023-10-25T23:38:11.640 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './199' 2023-10-25T23:38:11.641 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/21' 2023-10-25T23:38:11.641 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/27' 2023-10-25T23:38:11.641 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/31' 2023-10-25T23:38:11.641 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/36' 2023-10-25T23:38:11.641 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/20' 2023-10-25T23:38:11.641 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/39' 2023-10-25T23:38:11.642 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/34' 2023-10-25T23:38:11.642 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/38' 2023-10-25T23:38:11.642 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/28' 2023-10-25T23:38:11.642 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/24' 2023-10-25T23:38:11.642 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/29' 2023-10-25T23:38:11.643 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/32' 2023-10-25T23:38:11.643 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/22' 2023-10-25T23:38:11.643 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/25' 2023-10-25T23:38:11.643 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/30' 2023-10-25T23:38:11.643 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/33' 2023-10-25T23:38:11.644 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/23' 2023-10-25T23:38:11.644 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/35' 2023-10-25T23:38:11.644 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/26' 2023-10-25T23:38:11.644 INFO:tasks.workunit.client.0.smithi081.stdout:removed './200/37' 2023-10-25T23:38:11.644 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './200' 2023-10-25T23:38:11.644 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/21' 2023-10-25T23:38:11.645 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/27' 2023-10-25T23:38:11.645 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/31' 2023-10-25T23:38:11.645 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/36' 2023-10-25T23:38:11.645 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/20' 2023-10-25T23:38:11.645 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/39' 2023-10-25T23:38:11.645 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/34' 2023-10-25T23:38:11.646 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/38' 2023-10-25T23:38:11.646 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/28' 2023-10-25T23:38:11.646 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/24' 2023-10-25T23:38:11.646 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/29' 2023-10-25T23:38:11.646 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/32' 2023-10-25T23:38:11.647 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/22' 2023-10-25T23:38:11.647 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/25' 2023-10-25T23:38:11.647 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/30' 2023-10-25T23:38:11.647 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/33' 2023-10-25T23:38:11.647 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/23' 2023-10-25T23:38:11.647 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/35' 2023-10-25T23:38:11.648 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/26' 2023-10-25T23:38:11.648 INFO:tasks.workunit.client.0.smithi081.stdout:removed './201/37' 2023-10-25T23:38:11.648 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './201' 2023-10-25T23:38:11.648 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/21' 2023-10-25T23:38:11.648 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/27' 2023-10-25T23:38:11.649 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/31' 2023-10-25T23:38:11.649 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/36' 2023-10-25T23:38:11.649 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/20' 2023-10-25T23:38:11.649 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/39' 2023-10-25T23:38:11.649 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/34' 2023-10-25T23:38:11.649 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/38' 2023-10-25T23:38:11.650 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/28' 2023-10-25T23:38:11.650 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/24' 2023-10-25T23:38:11.650 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/29' 2023-10-25T23:38:11.650 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/32' 2023-10-25T23:38:11.650 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/22' 2023-10-25T23:38:11.651 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/25' 2023-10-25T23:38:11.651 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/30' 2023-10-25T23:38:11.651 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/33' 2023-10-25T23:38:11.651 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/23' 2023-10-25T23:38:11.651 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/35' 2023-10-25T23:38:11.651 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/26' 2023-10-25T23:38:11.652 INFO:tasks.workunit.client.0.smithi081.stdout:removed './202/37' 2023-10-25T23:38:11.652 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './202' 2023-10-25T23:38:11.652 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/21' 2023-10-25T23:38:11.652 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/27' 2023-10-25T23:38:11.652 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/31' 2023-10-25T23:38:11.653 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/36' 2023-10-25T23:38:11.653 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/20' 2023-10-25T23:38:11.653 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/39' 2023-10-25T23:38:11.653 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/34' 2023-10-25T23:38:11.653 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/38' 2023-10-25T23:38:11.654 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/28' 2023-10-25T23:38:11.654 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/24' 2023-10-25T23:38:11.654 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/29' 2023-10-25T23:38:11.654 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/32' 2023-10-25T23:38:11.654 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/22' 2023-10-25T23:38:11.655 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/25' 2023-10-25T23:38:11.655 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/30' 2023-10-25T23:38:11.655 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/33' 2023-10-25T23:38:11.655 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/23' 2023-10-25T23:38:11.656 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/35' 2023-10-25T23:38:11.656 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/26' 2023-10-25T23:38:11.656 INFO:tasks.workunit.client.0.smithi081.stdout:removed './203/37' 2023-10-25T23:38:11.656 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './203' 2023-10-25T23:38:11.656 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/21' 2023-10-25T23:38:11.656 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/27' 2023-10-25T23:38:11.657 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/31' 2023-10-25T23:38:11.657 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/36' 2023-10-25T23:38:11.657 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/20' 2023-10-25T23:38:11.657 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/39' 2023-10-25T23:38:11.657 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/34' 2023-10-25T23:38:11.658 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/38' 2023-10-25T23:38:11.658 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/28' 2023-10-25T23:38:11.658 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/24' 2023-10-25T23:38:11.658 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/29' 2023-10-25T23:38:11.658 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/32' 2023-10-25T23:38:11.659 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/22' 2023-10-25T23:38:11.659 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/25' 2023-10-25T23:38:11.659 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/30' 2023-10-25T23:38:11.659 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/33' 2023-10-25T23:38:11.659 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/23' 2023-10-25T23:38:11.660 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/35' 2023-10-25T23:38:11.660 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/26' 2023-10-25T23:38:11.660 INFO:tasks.workunit.client.0.smithi081.stdout:removed './204/37' 2023-10-25T23:38:11.660 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './204' 2023-10-25T23:38:11.660 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/21' 2023-10-25T23:38:11.661 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/27' 2023-10-25T23:38:11.661 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/31' 2023-10-25T23:38:11.661 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/36' 2023-10-25T23:38:11.661 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/20' 2023-10-25T23:38:11.661 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/39' 2023-10-25T23:38:11.662 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/34' 2023-10-25T23:38:11.662 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/38' 2023-10-25T23:38:11.662 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/28' 2023-10-25T23:38:11.662 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/24' 2023-10-25T23:38:11.662 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/29' 2023-10-25T23:38:11.662 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/32' 2023-10-25T23:38:11.663 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/22' 2023-10-25T23:38:11.663 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/25' 2023-10-25T23:38:11.663 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/30' 2023-10-25T23:38:11.663 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/33' 2023-10-25T23:38:11.663 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/23' 2023-10-25T23:38:11.664 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/35' 2023-10-25T23:38:11.664 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/26' 2023-10-25T23:38:11.664 INFO:tasks.workunit.client.0.smithi081.stdout:removed './205/37' 2023-10-25T23:38:11.664 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './205' 2023-10-25T23:38:11.664 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/21' 2023-10-25T23:38:11.664 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/27' 2023-10-25T23:38:11.665 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/31' 2023-10-25T23:38:11.665 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/36' 2023-10-25T23:38:11.665 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/20' 2023-10-25T23:38:11.665 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/39' 2023-10-25T23:38:12.028 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/34' 2023-10-25T23:38:12.028 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/38' 2023-10-25T23:38:12.028 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/28' 2023-10-25T23:38:12.028 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/24' 2023-10-25T23:38:12.029 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/29' 2023-10-25T23:38:12.029 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/32' 2023-10-25T23:38:12.029 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/22' 2023-10-25T23:38:12.029 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/25' 2023-10-25T23:38:12.029 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/30' 2023-10-25T23:38:12.030 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/33' 2023-10-25T23:38:12.030 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/23' 2023-10-25T23:38:12.030 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/35' 2023-10-25T23:38:12.030 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/26' 2023-10-25T23:38:12.030 INFO:tasks.workunit.client.0.smithi081.stdout:removed './206/37' 2023-10-25T23:38:12.031 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './206' 2023-10-25T23:38:12.031 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/21' 2023-10-25T23:38:12.031 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/27' 2023-10-25T23:38:12.031 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/31' 2023-10-25T23:38:12.032 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/36' 2023-10-25T23:38:12.032 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/20' 2023-10-25T23:38:12.032 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/39' 2023-10-25T23:38:12.032 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/34' 2023-10-25T23:38:12.033 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/38' 2023-10-25T23:38:12.033 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/28' 2023-10-25T23:38:12.033 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/24' 2023-10-25T23:38:12.033 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/29' 2023-10-25T23:38:12.034 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/32' 2023-10-25T23:38:12.034 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/22' 2023-10-25T23:38:12.034 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/25' 2023-10-25T23:38:12.034 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/30' 2023-10-25T23:38:12.034 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/33' 2023-10-25T23:38:12.035 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/23' 2023-10-25T23:38:12.035 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/35' 2023-10-25T23:38:12.035 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/26' 2023-10-25T23:38:12.035 INFO:tasks.workunit.client.0.smithi081.stdout:removed './207/37' 2023-10-25T23:38:12.036 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './207' 2023-10-25T23:38:12.036 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/21' 2023-10-25T23:38:12.036 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/27' 2023-10-25T23:38:12.036 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/31' 2023-10-25T23:38:12.036 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/36' 2023-10-25T23:38:12.037 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/20' 2023-10-25T23:38:12.037 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/39' 2023-10-25T23:38:12.037 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/34' 2023-10-25T23:38:12.037 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/38' 2023-10-25T23:38:12.037 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/28' 2023-10-25T23:38:12.038 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/24' 2023-10-25T23:38:12.038 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/29' 2023-10-25T23:38:12.038 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/32' 2023-10-25T23:38:12.038 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/22' 2023-10-25T23:38:12.038 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/25' 2023-10-25T23:38:12.039 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/30' 2023-10-25T23:38:12.039 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/33' 2023-10-25T23:38:12.039 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/23' 2023-10-25T23:38:12.039 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/35' 2023-10-25T23:38:12.039 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/26' 2023-10-25T23:38:12.040 INFO:tasks.workunit.client.0.smithi081.stdout:removed './208/37' 2023-10-25T23:38:12.040 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './208' 2023-10-25T23:38:12.040 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/21' 2023-10-25T23:38:12.040 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/27' 2023-10-25T23:38:12.040 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/31' 2023-10-25T23:38:12.041 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/36' 2023-10-25T23:38:12.041 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/20' 2023-10-25T23:38:12.041 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/39' 2023-10-25T23:38:12.041 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/34' 2023-10-25T23:38:12.042 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/38' 2023-10-25T23:38:12.042 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/28' 2023-10-25T23:38:12.042 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/24' 2023-10-25T23:38:12.042 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/29' 2023-10-25T23:38:12.042 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/32' 2023-10-25T23:38:12.043 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/22' 2023-10-25T23:38:12.043 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/25' 2023-10-25T23:38:12.043 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/30' 2023-10-25T23:38:12.043 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/33' 2023-10-25T23:38:12.044 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/23' 2023-10-25T23:38:12.044 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/35' 2023-10-25T23:38:12.044 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/26' 2023-10-25T23:38:12.044 INFO:tasks.workunit.client.0.smithi081.stdout:removed './209/37' 2023-10-25T23:38:12.044 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './209' 2023-10-25T23:38:12.045 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/21' 2023-10-25T23:38:12.045 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/27' 2023-10-25T23:38:12.045 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/31' 2023-10-25T23:38:12.045 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/36' 2023-10-25T23:38:12.046 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/20' 2023-10-25T23:38:12.046 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/39' 2023-10-25T23:38:12.046 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/34' 2023-10-25T23:38:12.046 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/38' 2023-10-25T23:38:12.046 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/28' 2023-10-25T23:38:12.047 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/24' 2023-10-25T23:38:12.047 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/29' 2023-10-25T23:38:12.047 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/32' 2023-10-25T23:38:12.047 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/22' 2023-10-25T23:38:12.047 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/25' 2023-10-25T23:38:12.048 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/30' 2023-10-25T23:38:12.048 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/33' 2023-10-25T23:38:12.048 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/23' 2023-10-25T23:38:12.048 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/35' 2023-10-25T23:38:12.048 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/26' 2023-10-25T23:38:12.048 INFO:tasks.workunit.client.0.smithi081.stdout:removed './210/37' 2023-10-25T23:38:12.049 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './210' 2023-10-25T23:38:12.049 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/21' 2023-10-25T23:38:12.049 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/27' 2023-10-25T23:38:12.049 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/31' 2023-10-25T23:38:12.049 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/36' 2023-10-25T23:38:12.050 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/20' 2023-10-25T23:38:12.050 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/39' 2023-10-25T23:38:12.050 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/34' 2023-10-25T23:38:12.050 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/38' 2023-10-25T23:38:12.050 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/28' 2023-10-25T23:38:12.051 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/24' 2023-10-25T23:38:12.051 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/29' 2023-10-25T23:38:12.051 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/32' 2023-10-25T23:38:12.051 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/22' 2023-10-25T23:38:12.051 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/25' 2023-10-25T23:38:12.051 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/30' 2023-10-25T23:38:12.052 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/33' 2023-10-25T23:38:12.052 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/23' 2023-10-25T23:38:12.052 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/35' 2023-10-25T23:38:12.052 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/26' 2023-10-25T23:38:12.053 INFO:tasks.workunit.client.0.smithi081.stdout:removed './211/37' 2023-10-25T23:38:12.053 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './211' 2023-10-25T23:38:12.053 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/21' 2023-10-25T23:38:12.053 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/27' 2023-10-25T23:38:12.053 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/31' 2023-10-25T23:38:12.053 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/36' 2023-10-25T23:38:12.054 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/20' 2023-10-25T23:38:12.054 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/39' 2023-10-25T23:38:12.054 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/34' 2023-10-25T23:38:12.054 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/38' 2023-10-25T23:38:12.054 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/28' 2023-10-25T23:38:12.055 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/24' 2023-10-25T23:38:12.055 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/29' 2023-10-25T23:38:12.055 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/32' 2023-10-25T23:38:12.055 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/22' 2023-10-25T23:38:12.055 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/25' 2023-10-25T23:38:12.055 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/30' 2023-10-25T23:38:12.056 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/33' 2023-10-25T23:38:12.056 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/23' 2023-10-25T23:38:12.056 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/35' 2023-10-25T23:38:12.056 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/26' 2023-10-25T23:38:12.056 INFO:tasks.workunit.client.0.smithi081.stdout:removed './212/37' 2023-10-25T23:38:12.057 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './212' 2023-10-25T23:38:12.057 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/21' 2023-10-25T23:38:12.057 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/27' 2023-10-25T23:38:12.057 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/31' 2023-10-25T23:38:12.057 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/36' 2023-10-25T23:38:12.057 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/20' 2023-10-25T23:38:12.058 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/39' 2023-10-25T23:38:12.058 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/34' 2023-10-25T23:38:12.058 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/38' 2023-10-25T23:38:12.058 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/28' 2023-10-25T23:38:12.058 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/24' 2023-10-25T23:38:12.059 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/29' 2023-10-25T23:38:12.059 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/32' 2023-10-25T23:38:12.059 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/22' 2023-10-25T23:38:12.059 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/25' 2023-10-25T23:38:12.059 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/30' 2023-10-25T23:38:12.060 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/33' 2023-10-25T23:38:12.060 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/23' 2023-10-25T23:38:12.060 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/35' 2023-10-25T23:38:12.060 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/26' 2023-10-25T23:38:12.060 INFO:tasks.workunit.client.0.smithi081.stdout:removed './213/37' 2023-10-25T23:38:12.060 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './213' 2023-10-25T23:38:12.061 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/21' 2023-10-25T23:38:12.061 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/27' 2023-10-25T23:38:12.061 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/31' 2023-10-25T23:38:12.061 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/36' 2023-10-25T23:38:12.061 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/20' 2023-10-25T23:38:12.061 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/39' 2023-10-25T23:38:12.062 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/34' 2023-10-25T23:38:12.062 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/38' 2023-10-25T23:38:12.062 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/28' 2023-10-25T23:38:12.062 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/24' 2023-10-25T23:38:12.062 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/29' 2023-10-25T23:38:12.063 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/32' 2023-10-25T23:38:12.063 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/22' 2023-10-25T23:38:12.063 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/25' 2023-10-25T23:38:12.063 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/30' 2023-10-25T23:38:12.063 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/33' 2023-10-25T23:38:12.063 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/23' 2023-10-25T23:38:12.064 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/35' 2023-10-25T23:38:12.064 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/26' 2023-10-25T23:38:12.064 INFO:tasks.workunit.client.0.smithi081.stdout:removed './214/37' 2023-10-25T23:38:12.064 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './214' 2023-10-25T23:38:12.064 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/21' 2023-10-25T23:38:12.065 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/27' 2023-10-25T23:38:12.065 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/31' 2023-10-25T23:38:12.065 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/36' 2023-10-25T23:38:12.065 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/20' 2023-10-25T23:38:12.065 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/39' 2023-10-25T23:38:12.065 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/34' 2023-10-25T23:38:12.066 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/38' 2023-10-25T23:38:12.066 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/28' 2023-10-25T23:38:12.066 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/24' 2023-10-25T23:38:12.066 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/29' 2023-10-25T23:38:12.066 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/32' 2023-10-25T23:38:12.067 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/22' 2023-10-25T23:38:12.067 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/25' 2023-10-25T23:38:12.067 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/30' 2023-10-25T23:38:12.067 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/33' 2023-10-25T23:38:12.067 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/23' 2023-10-25T23:38:12.067 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/35' 2023-10-25T23:38:12.068 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/26' 2023-10-25T23:38:12.068 INFO:tasks.workunit.client.0.smithi081.stdout:removed './215/37' 2023-10-25T23:38:12.068 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './215' 2023-10-25T23:38:12.068 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/21' 2023-10-25T23:38:12.068 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/27' 2023-10-25T23:38:12.069 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/31' 2023-10-25T23:38:12.069 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/36' 2023-10-25T23:38:12.069 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/20' 2023-10-25T23:38:12.069 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/39' 2023-10-25T23:38:12.069 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/34' 2023-10-25T23:38:12.069 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/38' 2023-10-25T23:38:12.416 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/28' 2023-10-25T23:38:12.416 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/24' 2023-10-25T23:38:12.416 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/29' 2023-10-25T23:38:12.417 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/32' 2023-10-25T23:38:12.417 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/22' 2023-10-25T23:38:12.417 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/25' 2023-10-25T23:38:12.417 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/30' 2023-10-25T23:38:12.417 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/33' 2023-10-25T23:38:12.418 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/23' 2023-10-25T23:38:12.418 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/35' 2023-10-25T23:38:12.418 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/26' 2023-10-25T23:38:12.418 INFO:tasks.workunit.client.0.smithi081.stdout:removed './216/37' 2023-10-25T23:38:12.418 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './216' 2023-10-25T23:38:12.419 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/21' 2023-10-25T23:38:12.419 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/27' 2023-10-25T23:38:12.419 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/31' 2023-10-25T23:38:12.419 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/36' 2023-10-25T23:38:12.419 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/20' 2023-10-25T23:38:12.420 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/39' 2023-10-25T23:38:12.420 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/34' 2023-10-25T23:38:12.420 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/38' 2023-10-25T23:38:12.420 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/28' 2023-10-25T23:38:12.420 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/24' 2023-10-25T23:38:12.420 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/29' 2023-10-25T23:38:12.421 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/32' 2023-10-25T23:38:12.421 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/22' 2023-10-25T23:38:12.421 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/25' 2023-10-25T23:38:12.421 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/30' 2023-10-25T23:38:12.421 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/33' 2023-10-25T23:38:12.422 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/23' 2023-10-25T23:38:12.422 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/35' 2023-10-25T23:38:12.422 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/26' 2023-10-25T23:38:12.422 INFO:tasks.workunit.client.0.smithi081.stdout:removed './217/37' 2023-10-25T23:38:12.422 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './217' 2023-10-25T23:38:12.423 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/21' 2023-10-25T23:38:12.423 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/27' 2023-10-25T23:38:12.423 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/31' 2023-10-25T23:38:12.423 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/36' 2023-10-25T23:38:12.423 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/20' 2023-10-25T23:38:12.423 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/39' 2023-10-25T23:38:12.424 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/34' 2023-10-25T23:38:12.424 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/38' 2023-10-25T23:38:12.424 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/28' 2023-10-25T23:38:12.424 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/24' 2023-10-25T23:38:12.424 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/29' 2023-10-25T23:38:12.425 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/32' 2023-10-25T23:38:12.425 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/22' 2023-10-25T23:38:12.425 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/25' 2023-10-25T23:38:12.425 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/30' 2023-10-25T23:38:12.425 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/33' 2023-10-25T23:38:12.426 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/23' 2023-10-25T23:38:12.426 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/35' 2023-10-25T23:38:12.426 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/26' 2023-10-25T23:38:12.426 INFO:tasks.workunit.client.0.smithi081.stdout:removed './218/37' 2023-10-25T23:38:12.426 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './218' 2023-10-25T23:38:12.427 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/21' 2023-10-25T23:38:12.427 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/27' 2023-10-25T23:38:12.427 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/31' 2023-10-25T23:38:12.427 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/36' 2023-10-25T23:38:12.427 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/20' 2023-10-25T23:38:12.428 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/39' 2023-10-25T23:38:12.428 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/34' 2023-10-25T23:38:12.428 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/38' 2023-10-25T23:38:12.428 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/28' 2023-10-25T23:38:12.428 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/24' 2023-10-25T23:38:12.429 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/29' 2023-10-25T23:38:12.429 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/32' 2023-10-25T23:38:12.429 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/22' 2023-10-25T23:38:12.429 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/25' 2023-10-25T23:38:12.429 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/30' 2023-10-25T23:38:12.429 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/33' 2023-10-25T23:38:12.430 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/23' 2023-10-25T23:38:12.430 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/35' 2023-10-25T23:38:12.430 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/26' 2023-10-25T23:38:12.430 INFO:tasks.workunit.client.0.smithi081.stdout:removed './219/37' 2023-10-25T23:38:12.430 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './219' 2023-10-25T23:38:12.431 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/21' 2023-10-25T23:38:12.431 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/27' 2023-10-25T23:38:12.431 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/31' 2023-10-25T23:38:12.431 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/36' 2023-10-25T23:38:12.431 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/20' 2023-10-25T23:38:12.432 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/39' 2023-10-25T23:38:12.432 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/34' 2023-10-25T23:38:12.432 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/38' 2023-10-25T23:38:12.432 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/28' 2023-10-25T23:38:12.432 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/24' 2023-10-25T23:38:12.433 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/29' 2023-10-25T23:38:12.433 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/32' 2023-10-25T23:38:12.433 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/22' 2023-10-25T23:38:12.433 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/25' 2023-10-25T23:38:12.433 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/30' 2023-10-25T23:38:12.433 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/33' 2023-10-25T23:38:12.434 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/23' 2023-10-25T23:38:12.434 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/35' 2023-10-25T23:38:12.434 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/26' 2023-10-25T23:38:12.434 INFO:tasks.workunit.client.0.smithi081.stdout:removed './220/37' 2023-10-25T23:38:12.434 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './220' 2023-10-25T23:38:12.435 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/21' 2023-10-25T23:38:12.435 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/27' 2023-10-25T23:38:12.435 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/31' 2023-10-25T23:38:12.435 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/36' 2023-10-25T23:38:12.435 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/20' 2023-10-25T23:38:12.435 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/39' 2023-10-25T23:38:12.436 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/34' 2023-10-25T23:38:12.436 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/38' 2023-10-25T23:38:12.436 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/28' 2023-10-25T23:38:12.436 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/24' 2023-10-25T23:38:12.436 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/29' 2023-10-25T23:38:12.437 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/32' 2023-10-25T23:38:12.437 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/22' 2023-10-25T23:38:12.437 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/25' 2023-10-25T23:38:12.437 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/30' 2023-10-25T23:38:12.437 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/33' 2023-10-25T23:38:12.437 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/23' 2023-10-25T23:38:12.438 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/35' 2023-10-25T23:38:12.438 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/26' 2023-10-25T23:38:12.438 INFO:tasks.workunit.client.0.smithi081.stdout:removed './221/37' 2023-10-25T23:38:12.438 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './221' 2023-10-25T23:38:12.438 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/21' 2023-10-25T23:38:12.439 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/27' 2023-10-25T23:38:12.439 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/31' 2023-10-25T23:38:12.439 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/36' 2023-10-25T23:38:12.439 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/20' 2023-10-25T23:38:12.439 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/39' 2023-10-25T23:38:12.440 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/34' 2023-10-25T23:38:12.440 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/38' 2023-10-25T23:38:12.440 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/28' 2023-10-25T23:38:12.440 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/24' 2023-10-25T23:38:12.440 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/29' 2023-10-25T23:38:12.440 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/32' 2023-10-25T23:38:12.441 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/22' 2023-10-25T23:38:12.441 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/25' 2023-10-25T23:38:12.441 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/30' 2023-10-25T23:38:12.441 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/33' 2023-10-25T23:38:12.441 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/23' 2023-10-25T23:38:12.442 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/35' 2023-10-25T23:38:12.442 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/26' 2023-10-25T23:38:12.442 INFO:tasks.workunit.client.0.smithi081.stdout:removed './222/37' 2023-10-25T23:38:12.442 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './222' 2023-10-25T23:38:12.442 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/21' 2023-10-25T23:38:12.442 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/27' 2023-10-25T23:38:12.443 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/31' 2023-10-25T23:38:12.443 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/36' 2023-10-25T23:38:12.443 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/20' 2023-10-25T23:38:12.443 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/39' 2023-10-25T23:38:12.443 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/34' 2023-10-25T23:38:12.444 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/38' 2023-10-25T23:38:12.444 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/28' 2023-10-25T23:38:12.444 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/24' 2023-10-25T23:38:12.444 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/29' 2023-10-25T23:38:12.444 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/32' 2023-10-25T23:38:12.444 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/22' 2023-10-25T23:38:12.445 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/25' 2023-10-25T23:38:12.445 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/30' 2023-10-25T23:38:12.445 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/33' 2023-10-25T23:38:12.445 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/23' 2023-10-25T23:38:12.445 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/35' 2023-10-25T23:38:12.446 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/26' 2023-10-25T23:38:12.446 INFO:tasks.workunit.client.0.smithi081.stdout:removed './223/37' 2023-10-25T23:38:12.446 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './223' 2023-10-25T23:38:12.446 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/21' 2023-10-25T23:38:12.446 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/27' 2023-10-25T23:38:12.447 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/31' 2023-10-25T23:38:12.447 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/36' 2023-10-25T23:38:12.447 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/20' 2023-10-25T23:38:12.447 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/39' 2023-10-25T23:38:12.447 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/34' 2023-10-25T23:38:12.447 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/38' 2023-10-25T23:38:12.448 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/28' 2023-10-25T23:38:12.448 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/24' 2023-10-25T23:38:12.448 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/29' 2023-10-25T23:38:12.448 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/32' 2023-10-25T23:38:12.448 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/22' 2023-10-25T23:38:12.449 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/25' 2023-10-25T23:38:12.449 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/30' 2023-10-25T23:38:12.449 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/33' 2023-10-25T23:38:12.449 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/23' 2023-10-25T23:38:12.449 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/35' 2023-10-25T23:38:12.449 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/26' 2023-10-25T23:38:12.450 INFO:tasks.workunit.client.0.smithi081.stdout:removed './224/37' 2023-10-25T23:38:12.450 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './224' 2023-10-25T23:38:12.450 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/21' 2023-10-25T23:38:12.450 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/27' 2023-10-25T23:38:12.450 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/31' 2023-10-25T23:38:12.451 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/36' 2023-10-25T23:38:12.451 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/20' 2023-10-25T23:38:12.451 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/39' 2023-10-25T23:38:12.451 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/34' 2023-10-25T23:38:12.451 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/38' 2023-10-25T23:38:12.451 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/28' 2023-10-25T23:38:12.452 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/24' 2023-10-25T23:38:12.452 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/29' 2023-10-25T23:38:12.452 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/32' 2023-10-25T23:38:12.452 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/22' 2023-10-25T23:38:12.452 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/25' 2023-10-25T23:38:12.453 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/30' 2023-10-25T23:38:12.453 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/33' 2023-10-25T23:38:12.453 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/23' 2023-10-25T23:38:12.453 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/35' 2023-10-25T23:38:12.453 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/26' 2023-10-25T23:38:12.453 INFO:tasks.workunit.client.0.smithi081.stdout:removed './225/37' 2023-10-25T23:38:12.454 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './225' 2023-10-25T23:38:12.454 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/21' 2023-10-25T23:38:12.454 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/27' 2023-10-25T23:38:12.454 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/31' 2023-10-25T23:38:12.454 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/36' 2023-10-25T23:38:12.455 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/20' 2023-10-25T23:38:12.455 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/39' 2023-10-25T23:38:12.455 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/34' 2023-10-25T23:38:12.455 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/38' 2023-10-25T23:38:12.455 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/28' 2023-10-25T23:38:12.455 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/24' 2023-10-25T23:38:12.991 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/29' 2023-10-25T23:38:12.992 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/32' 2023-10-25T23:38:12.992 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/22' 2023-10-25T23:38:12.992 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/25' 2023-10-25T23:38:12.992 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/30' 2023-10-25T23:38:12.992 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/33' 2023-10-25T23:38:12.993 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/23' 2023-10-25T23:38:12.993 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/35' 2023-10-25T23:38:12.993 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/26' 2023-10-25T23:38:12.993 INFO:tasks.workunit.client.0.smithi081.stdout:removed './226/37' 2023-10-25T23:38:12.993 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './226' 2023-10-25T23:38:12.994 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/21' 2023-10-25T23:38:12.994 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/27' 2023-10-25T23:38:12.994 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/31' 2023-10-25T23:38:12.994 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/36' 2023-10-25T23:38:12.994 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/20' 2023-10-25T23:38:12.995 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/39' 2023-10-25T23:38:12.995 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/34' 2023-10-25T23:38:12.995 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/38' 2023-10-25T23:38:12.995 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/28' 2023-10-25T23:38:12.995 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/24' 2023-10-25T23:38:12.995 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/29' 2023-10-25T23:38:12.996 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/32' 2023-10-25T23:38:12.996 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/22' 2023-10-25T23:38:12.996 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/25' 2023-10-25T23:38:12.996 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/30' 2023-10-25T23:38:12.996 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/33' 2023-10-25T23:38:12.997 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/23' 2023-10-25T23:38:12.997 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/35' 2023-10-25T23:38:12.997 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/26' 2023-10-25T23:38:12.997 INFO:tasks.workunit.client.0.smithi081.stdout:removed './227/37' 2023-10-25T23:38:12.997 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './227' 2023-10-25T23:38:12.997 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/21' 2023-10-25T23:38:12.998 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/27' 2023-10-25T23:38:12.998 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/31' 2023-10-25T23:38:12.999 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/36' 2023-10-25T23:38:13.000 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/20' 2023-10-25T23:38:13.001 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/39' 2023-10-25T23:38:13.002 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/34' 2023-10-25T23:38:13.002 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/38' 2023-10-25T23:38:13.002 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/28' 2023-10-25T23:38:13.002 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/24' 2023-10-25T23:38:13.002 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/29' 2023-10-25T23:38:13.003 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/32' 2023-10-25T23:38:13.003 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/22' 2023-10-25T23:38:13.003 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/25' 2023-10-25T23:38:13.003 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/30' 2023-10-25T23:38:13.003 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/33' 2023-10-25T23:38:13.004 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/23' 2023-10-25T23:38:13.004 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/35' 2023-10-25T23:38:13.004 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/26' 2023-10-25T23:38:13.004 INFO:tasks.workunit.client.0.smithi081.stdout:removed './228/37' 2023-10-25T23:38:13.004 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './228' 2023-10-25T23:38:13.005 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/21' 2023-10-25T23:38:13.005 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/27' 2023-10-25T23:38:13.005 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/31' 2023-10-25T23:38:13.005 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/36' 2023-10-25T23:38:13.005 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/20' 2023-10-25T23:38:13.005 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/39' 2023-10-25T23:38:13.006 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/34' 2023-10-25T23:38:13.006 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/38' 2023-10-25T23:38:13.006 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/28' 2023-10-25T23:38:13.006 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/24' 2023-10-25T23:38:13.007 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/29' 2023-10-25T23:38:13.007 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/32' 2023-10-25T23:38:13.007 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/22' 2023-10-25T23:38:13.007 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/25' 2023-10-25T23:38:13.007 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/30' 2023-10-25T23:38:13.007 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/33' 2023-10-25T23:38:13.008 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/23' 2023-10-25T23:38:13.008 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/35' 2023-10-25T23:38:13.008 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/26' 2023-10-25T23:38:13.008 INFO:tasks.workunit.client.0.smithi081.stdout:removed './229/37' 2023-10-25T23:38:13.008 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './229' 2023-10-25T23:38:13.009 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/21' 2023-10-25T23:38:13.009 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/27' 2023-10-25T23:38:13.010 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/31' 2023-10-25T23:38:13.010 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/36' 2023-10-25T23:38:13.010 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/20' 2023-10-25T23:38:13.010 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/39' 2023-10-25T23:38:13.011 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/34' 2023-10-25T23:38:13.011 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/38' 2023-10-25T23:38:13.011 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/28' 2023-10-25T23:38:13.011 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/24' 2023-10-25T23:38:13.012 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/29' 2023-10-25T23:38:13.012 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/32' 2023-10-25T23:38:13.012 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/22' 2023-10-25T23:38:13.012 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/25' 2023-10-25T23:38:13.012 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/30' 2023-10-25T23:38:13.013 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/33' 2023-10-25T23:38:13.013 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/23' 2023-10-25T23:38:13.013 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/35' 2023-10-25T23:38:13.013 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/26' 2023-10-25T23:38:13.014 INFO:tasks.workunit.client.0.smithi081.stdout:removed './230/37' 2023-10-25T23:38:13.014 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './230' 2023-10-25T23:38:13.014 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/21' 2023-10-25T23:38:13.014 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/27' 2023-10-25T23:38:13.014 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/31' 2023-10-25T23:38:13.015 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/36' 2023-10-25T23:38:13.015 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/20' 2023-10-25T23:38:13.015 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/39' 2023-10-25T23:38:13.015 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/34' 2023-10-25T23:38:13.015 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/38' 2023-10-25T23:38:13.015 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/28' 2023-10-25T23:38:13.016 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/24' 2023-10-25T23:38:13.016 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/29' 2023-10-25T23:38:13.016 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/32' 2023-10-25T23:38:13.016 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/22' 2023-10-25T23:38:13.016 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/25' 2023-10-25T23:38:13.017 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/30' 2023-10-25T23:38:13.017 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/33' 2023-10-25T23:38:13.017 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/23' 2023-10-25T23:38:13.017 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/35' 2023-10-25T23:38:13.017 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/26' 2023-10-25T23:38:13.017 INFO:tasks.workunit.client.0.smithi081.stdout:removed './231/37' 2023-10-25T23:38:13.018 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './231' 2023-10-25T23:38:13.018 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/21' 2023-10-25T23:38:13.018 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/27' 2023-10-25T23:38:13.018 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/31' 2023-10-25T23:38:13.018 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/36' 2023-10-25T23:38:13.019 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/20' 2023-10-25T23:38:13.019 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/39' 2023-10-25T23:38:13.019 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/34' 2023-10-25T23:38:13.019 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/38' 2023-10-25T23:38:13.019 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/28' 2023-10-25T23:38:13.020 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/24' 2023-10-25T23:38:13.020 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/29' 2023-10-25T23:38:13.020 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/32' 2023-10-25T23:38:13.020 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/22' 2023-10-25T23:38:13.020 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/25' 2023-10-25T23:38:13.021 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/30' 2023-10-25T23:38:13.021 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/33' 2023-10-25T23:38:13.021 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/23' 2023-10-25T23:38:13.021 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/35' 2023-10-25T23:38:13.021 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/26' 2023-10-25T23:38:13.021 INFO:tasks.workunit.client.0.smithi081.stdout:removed './232/37' 2023-10-25T23:38:13.022 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './232' 2023-10-25T23:38:13.022 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/21' 2023-10-25T23:38:13.022 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/27' 2023-10-25T23:38:13.022 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/31' 2023-10-25T23:38:13.022 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/36' 2023-10-25T23:38:13.023 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/20' 2023-10-25T23:38:13.023 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/39' 2023-10-25T23:38:13.023 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/34' 2023-10-25T23:38:13.023 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/38' 2023-10-25T23:38:13.023 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/28' 2023-10-25T23:38:13.023 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/24' 2023-10-25T23:38:13.024 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/29' 2023-10-25T23:38:13.024 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/32' 2023-10-25T23:38:13.024 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/22' 2023-10-25T23:38:13.024 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/25' 2023-10-25T23:38:13.024 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/30' 2023-10-25T23:38:13.025 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/33' 2023-10-25T23:38:13.025 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/23' 2023-10-25T23:38:13.025 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/35' 2023-10-25T23:38:13.025 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/26' 2023-10-25T23:38:13.025 INFO:tasks.workunit.client.0.smithi081.stdout:removed './233/37' 2023-10-25T23:38:13.026 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './233' 2023-10-25T23:38:13.026 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/21' 2023-10-25T23:38:13.026 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/27' 2023-10-25T23:38:13.026 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/31' 2023-10-25T23:38:13.026 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/36' 2023-10-25T23:38:13.027 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/20' 2023-10-25T23:38:13.027 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/39' 2023-10-25T23:38:13.027 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/34' 2023-10-25T23:38:13.027 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/38' 2023-10-25T23:38:13.028 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/28' 2023-10-25T23:38:13.028 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/24' 2023-10-25T23:38:13.028 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/29' 2023-10-25T23:38:13.028 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/32' 2023-10-25T23:38:13.028 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/22' 2023-10-25T23:38:13.028 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/25' 2023-10-25T23:38:13.029 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/30' 2023-10-25T23:38:13.029 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/33' 2023-10-25T23:38:13.029 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/23' 2023-10-25T23:38:13.029 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/35' 2023-10-25T23:38:13.029 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/26' 2023-10-25T23:38:13.030 INFO:tasks.workunit.client.0.smithi081.stdout:removed './234/37' 2023-10-25T23:38:13.030 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './234' 2023-10-25T23:38:13.030 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/21' 2023-10-25T23:38:13.030 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/27' 2023-10-25T23:38:13.030 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/31' 2023-10-25T23:38:13.030 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/36' 2023-10-25T23:38:13.031 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/20' 2023-10-25T23:38:13.031 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/39' 2023-10-25T23:38:13.031 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/34' 2023-10-25T23:38:13.031 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/38' 2023-10-25T23:38:13.031 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/28' 2023-10-25T23:38:13.032 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/24' 2023-10-25T23:38:13.032 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/29' 2023-10-25T23:38:13.032 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/32' 2023-10-25T23:38:13.032 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/22' 2023-10-25T23:38:13.032 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/25' 2023-10-25T23:38:13.033 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/30' 2023-10-25T23:38:13.033 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/33' 2023-10-25T23:38:13.033 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/23' 2023-10-25T23:38:13.033 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/35' 2023-10-25T23:38:13.033 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/26' 2023-10-25T23:38:13.034 INFO:tasks.workunit.client.0.smithi081.stdout:removed './235/37' 2023-10-25T23:38:13.034 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './235' 2023-10-25T23:38:13.034 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/21' 2023-10-25T23:38:13.034 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/27' 2023-10-25T23:38:13.034 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/31' 2023-10-25T23:38:13.034 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/36' 2023-10-25T23:38:13.035 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/20' 2023-10-25T23:38:13.035 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/39' 2023-10-25T23:38:13.035 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/34' 2023-10-25T23:38:13.035 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/38' 2023-10-25T23:38:13.035 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/28' 2023-10-25T23:38:13.036 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/24' 2023-10-25T23:38:13.036 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/29' 2023-10-25T23:38:13.036 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/32' 2023-10-25T23:38:13.379 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/22' 2023-10-25T23:38:13.379 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/25' 2023-10-25T23:38:13.380 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/30' 2023-10-25T23:38:13.380 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/33' 2023-10-25T23:38:13.380 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/23' 2023-10-25T23:38:13.380 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/35' 2023-10-25T23:38:13.380 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/26' 2023-10-25T23:38:13.381 INFO:tasks.workunit.client.0.smithi081.stdout:removed './236/37' 2023-10-25T23:38:13.381 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './236' 2023-10-25T23:38:13.381 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/21' 2023-10-25T23:38:13.381 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/27' 2023-10-25T23:38:13.381 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/31' 2023-10-25T23:38:13.382 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/36' 2023-10-25T23:38:13.382 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/20' 2023-10-25T23:38:13.382 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/39' 2023-10-25T23:38:13.382 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/34' 2023-10-25T23:38:13.382 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/38' 2023-10-25T23:38:13.383 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/28' 2023-10-25T23:38:13.383 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/24' 2023-10-25T23:38:13.383 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/29' 2023-10-25T23:38:13.383 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/32' 2023-10-25T23:38:13.383 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/22' 2023-10-25T23:38:13.384 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/25' 2023-10-25T23:38:13.384 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/30' 2023-10-25T23:38:13.384 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/33' 2023-10-25T23:38:13.384 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/23' 2023-10-25T23:38:13.384 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/35' 2023-10-25T23:38:13.385 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/26' 2023-10-25T23:38:13.385 INFO:tasks.workunit.client.0.smithi081.stdout:removed './237/37' 2023-10-25T23:38:13.385 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './237' 2023-10-25T23:38:13.385 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/21' 2023-10-25T23:38:13.385 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/27' 2023-10-25T23:38:13.386 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/31' 2023-10-25T23:38:13.386 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/36' 2023-10-25T23:38:13.386 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/20' 2023-10-25T23:38:13.386 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/39' 2023-10-25T23:38:13.386 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/34' 2023-10-25T23:38:13.387 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/38' 2023-10-25T23:38:13.387 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/28' 2023-10-25T23:38:13.387 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/24' 2023-10-25T23:38:13.387 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/29' 2023-10-25T23:38:13.387 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/32' 2023-10-25T23:38:13.387 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/22' 2023-10-25T23:38:13.388 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/25' 2023-10-25T23:38:13.388 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/30' 2023-10-25T23:38:13.388 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/33' 2023-10-25T23:38:13.388 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/23' 2023-10-25T23:38:13.388 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/35' 2023-10-25T23:38:13.389 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/26' 2023-10-25T23:38:13.389 INFO:tasks.workunit.client.0.smithi081.stdout:removed './238/37' 2023-10-25T23:38:13.389 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './238' 2023-10-25T23:38:13.389 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/21' 2023-10-25T23:38:13.389 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/27' 2023-10-25T23:38:13.389 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/31' 2023-10-25T23:38:13.390 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/36' 2023-10-25T23:38:13.390 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/20' 2023-10-25T23:38:13.390 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/39' 2023-10-25T23:38:13.390 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/34' 2023-10-25T23:38:13.390 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/38' 2023-10-25T23:38:13.391 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/28' 2023-10-25T23:38:13.391 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/24' 2023-10-25T23:38:13.391 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/29' 2023-10-25T23:38:13.391 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/32' 2023-10-25T23:38:13.391 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/22' 2023-10-25T23:38:13.392 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/25' 2023-10-25T23:38:13.392 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/30' 2023-10-25T23:38:13.392 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/33' 2023-10-25T23:38:13.392 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/23' 2023-10-25T23:38:13.392 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/35' 2023-10-25T23:38:13.393 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/26' 2023-10-25T23:38:13.393 INFO:tasks.workunit.client.0.smithi081.stdout:removed './239/37' 2023-10-25T23:38:13.393 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './239' 2023-10-25T23:38:13.393 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/21' 2023-10-25T23:38:13.393 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/27' 2023-10-25T23:38:13.393 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/31' 2023-10-25T23:38:13.394 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/36' 2023-10-25T23:38:13.394 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/20' 2023-10-25T23:38:13.394 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/39' 2023-10-25T23:38:13.394 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/34' 2023-10-25T23:38:13.394 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/38' 2023-10-25T23:38:13.395 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/28' 2023-10-25T23:38:13.395 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/24' 2023-10-25T23:38:13.395 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/29' 2023-10-25T23:38:13.395 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/32' 2023-10-25T23:38:13.395 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/22' 2023-10-25T23:38:13.396 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/25' 2023-10-25T23:38:13.396 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/30' 2023-10-25T23:38:13.396 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/33' 2023-10-25T23:38:13.396 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/23' 2023-10-25T23:38:13.396 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/35' 2023-10-25T23:38:13.396 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/26' 2023-10-25T23:38:13.397 INFO:tasks.workunit.client.0.smithi081.stdout:removed './240/37' 2023-10-25T23:38:13.397 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './240' 2023-10-25T23:38:13.397 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/21' 2023-10-25T23:38:13.397 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/27' 2023-10-25T23:38:13.397 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/31' 2023-10-25T23:38:13.398 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/36' 2023-10-25T23:38:13.398 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/20' 2023-10-25T23:38:13.398 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/39' 2023-10-25T23:38:13.398 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/34' 2023-10-25T23:38:13.398 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/38' 2023-10-25T23:38:13.399 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/28' 2023-10-25T23:38:13.399 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/24' 2023-10-25T23:38:13.399 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/29' 2023-10-25T23:38:13.399 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/32' 2023-10-25T23:38:13.399 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/22' 2023-10-25T23:38:13.399 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/25' 2023-10-25T23:38:13.400 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/30' 2023-10-25T23:38:13.400 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/33' 2023-10-25T23:38:13.400 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/23' 2023-10-25T23:38:13.400 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/35' 2023-10-25T23:38:13.400 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/26' 2023-10-25T23:38:13.401 INFO:tasks.workunit.client.0.smithi081.stdout:removed './241/37' 2023-10-25T23:38:13.401 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './241' 2023-10-25T23:38:13.401 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/21' 2023-10-25T23:38:13.401 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/27' 2023-10-25T23:38:13.401 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/31' 2023-10-25T23:38:13.402 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/36' 2023-10-25T23:38:13.402 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/20' 2023-10-25T23:38:13.402 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/39' 2023-10-25T23:38:13.402 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/34' 2023-10-25T23:38:13.402 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/38' 2023-10-25T23:38:13.402 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/28' 2023-10-25T23:38:13.403 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/24' 2023-10-25T23:38:13.403 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/29' 2023-10-25T23:38:13.403 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/32' 2023-10-25T23:38:13.403 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/22' 2023-10-25T23:38:13.403 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/25' 2023-10-25T23:38:13.404 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/30' 2023-10-25T23:38:13.404 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/33' 2023-10-25T23:38:13.404 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/23' 2023-10-25T23:38:13.404 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/35' 2023-10-25T23:38:13.404 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/26' 2023-10-25T23:38:13.405 INFO:tasks.workunit.client.0.smithi081.stdout:removed './242/37' 2023-10-25T23:38:13.405 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './242' 2023-10-25T23:38:13.405 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/21' 2023-10-25T23:38:13.405 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/27' 2023-10-25T23:38:13.405 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/31' 2023-10-25T23:38:13.406 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/36' 2023-10-25T23:38:13.406 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/20' 2023-10-25T23:38:13.406 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/39' 2023-10-25T23:38:13.406 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/34' 2023-10-25T23:38:13.406 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/38' 2023-10-25T23:38:13.407 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/28' 2023-10-25T23:38:13.407 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/24' 2023-10-25T23:38:13.407 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/29' 2023-10-25T23:38:13.407 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/32' 2023-10-25T23:38:13.407 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/22' 2023-10-25T23:38:13.408 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/25' 2023-10-25T23:38:13.408 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/30' 2023-10-25T23:38:13.408 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/33' 2023-10-25T23:38:13.408 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/23' 2023-10-25T23:38:13.408 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/35' 2023-10-25T23:38:13.409 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/26' 2023-10-25T23:38:13.409 INFO:tasks.workunit.client.0.smithi081.stdout:removed './243/37' 2023-10-25T23:38:13.409 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './243' 2023-10-25T23:38:13.409 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/21' 2023-10-25T23:38:13.409 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/27' 2023-10-25T23:38:13.410 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/31' 2023-10-25T23:38:13.410 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/36' 2023-10-25T23:38:13.410 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/20' 2023-10-25T23:38:13.410 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/39' 2023-10-25T23:38:13.410 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/34' 2023-10-25T23:38:13.411 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/38' 2023-10-25T23:38:13.413 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/28' 2023-10-25T23:38:13.413 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/24' 2023-10-25T23:38:13.413 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/29' 2023-10-25T23:38:13.414 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/32' 2023-10-25T23:38:13.414 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/22' 2023-10-25T23:38:13.414 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/25' 2023-10-25T23:38:13.414 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/30' 2023-10-25T23:38:13.415 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/33' 2023-10-25T23:38:13.415 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/23' 2023-10-25T23:38:13.415 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/35' 2023-10-25T23:38:13.415 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/26' 2023-10-25T23:38:13.415 INFO:tasks.workunit.client.0.smithi081.stdout:removed './244/37' 2023-10-25T23:38:13.416 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './244' 2023-10-25T23:38:13.416 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/21' 2023-10-25T23:38:13.416 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/27' 2023-10-25T23:38:13.416 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/31' 2023-10-25T23:38:13.416 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/36' 2023-10-25T23:38:13.417 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/20' 2023-10-25T23:38:13.417 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/39' 2023-10-25T23:38:13.418 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/34' 2023-10-25T23:38:13.418 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/38' 2023-10-25T23:38:13.418 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/28' 2023-10-25T23:38:13.418 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/24' 2023-10-25T23:38:13.419 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/29' 2023-10-25T23:38:13.419 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/32' 2023-10-25T23:38:13.419 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/22' 2023-10-25T23:38:13.419 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/25' 2023-10-25T23:38:13.419 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/30' 2023-10-25T23:38:13.420 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/33' 2023-10-25T23:38:13.420 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/23' 2023-10-25T23:38:13.420 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/35' 2023-10-25T23:38:13.420 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/26' 2023-10-25T23:38:13.420 INFO:tasks.workunit.client.0.smithi081.stdout:removed './245/37' 2023-10-25T23:38:13.421 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './245' 2023-10-25T23:38:13.421 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/21' 2023-10-25T23:38:13.421 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/27' 2023-10-25T23:38:13.421 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/31' 2023-10-25T23:38:13.421 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/36' 2023-10-25T23:38:13.422 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/20' 2023-10-25T23:38:13.422 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/39' 2023-10-25T23:38:13.422 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/34' 2023-10-25T23:38:13.422 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/38' 2023-10-25T23:38:13.422 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/28' 2023-10-25T23:38:13.423 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/24' 2023-10-25T23:38:13.423 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/29' 2023-10-25T23:38:13.423 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/32' 2023-10-25T23:38:13.423 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/22' 2023-10-25T23:38:13.881 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/25' 2023-10-25T23:38:13.881 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/30' 2023-10-25T23:38:13.882 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/33' 2023-10-25T23:38:13.882 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/23' 2023-10-25T23:38:13.882 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/35' 2023-10-25T23:38:13.882 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/26' 2023-10-25T23:38:13.883 INFO:tasks.workunit.client.0.smithi081.stdout:removed './246/37' 2023-10-25T23:38:13.883 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './246' 2023-10-25T23:38:13.883 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/21' 2023-10-25T23:38:13.883 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/27' 2023-10-25T23:38:13.883 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/31' 2023-10-25T23:38:13.884 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/36' 2023-10-25T23:38:13.884 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/20' 2023-10-25T23:38:13.884 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/39' 2023-10-25T23:38:13.884 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/34' 2023-10-25T23:38:13.884 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/38' 2023-10-25T23:38:13.884 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/28' 2023-10-25T23:38:13.885 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/24' 2023-10-25T23:38:13.885 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/29' 2023-10-25T23:38:13.885 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/32' 2023-10-25T23:38:13.885 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/22' 2023-10-25T23:38:13.885 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/25' 2023-10-25T23:38:13.886 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/30' 2023-10-25T23:38:13.886 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/33' 2023-10-25T23:38:13.886 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/23' 2023-10-25T23:38:13.886 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/35' 2023-10-25T23:38:13.886 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/26' 2023-10-25T23:38:13.886 INFO:tasks.workunit.client.0.smithi081.stdout:removed './247/37' 2023-10-25T23:38:13.887 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './247' 2023-10-25T23:38:13.887 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/21' 2023-10-25T23:38:13.887 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/27' 2023-10-25T23:38:13.887 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/31' 2023-10-25T23:38:13.888 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/36' 2023-10-25T23:38:13.888 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/20' 2023-10-25T23:38:13.888 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/39' 2023-10-25T23:38:13.888 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/34' 2023-10-25T23:38:13.888 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/38' 2023-10-25T23:38:13.889 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/28' 2023-10-25T23:38:13.889 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/24' 2023-10-25T23:38:13.889 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/29' 2023-10-25T23:38:13.889 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/32' 2023-10-25T23:38:13.890 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/22' 2023-10-25T23:38:13.890 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/25' 2023-10-25T23:38:13.890 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/30' 2023-10-25T23:38:13.890 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/33' 2023-10-25T23:38:13.890 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/23' 2023-10-25T23:38:13.891 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/35' 2023-10-25T23:38:13.891 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/26' 2023-10-25T23:38:13.891 INFO:tasks.workunit.client.0.smithi081.stdout:removed './248/37' 2023-10-25T23:38:13.891 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './248' 2023-10-25T23:38:13.891 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/21' 2023-10-25T23:38:13.891 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/27' 2023-10-25T23:38:13.892 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/31' 2023-10-25T23:38:13.892 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/36' 2023-10-25T23:38:13.892 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/20' 2023-10-25T23:38:13.892 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/39' 2023-10-25T23:38:13.892 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/34' 2023-10-25T23:38:13.893 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/38' 2023-10-25T23:38:13.893 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/28' 2023-10-25T23:38:13.893 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/24' 2023-10-25T23:38:13.893 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/29' 2023-10-25T23:38:13.893 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/32' 2023-10-25T23:38:13.894 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/22' 2023-10-25T23:38:13.894 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/25' 2023-10-25T23:38:13.894 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/30' 2023-10-25T23:38:13.894 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/33' 2023-10-25T23:38:13.894 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/23' 2023-10-25T23:38:13.895 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/35' 2023-10-25T23:38:13.895 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/26' 2023-10-25T23:38:13.895 INFO:tasks.workunit.client.0.smithi081.stdout:removed './249/37' 2023-10-25T23:38:13.895 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './249' 2023-10-25T23:38:13.895 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/21' 2023-10-25T23:38:13.896 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/27' 2023-10-25T23:38:13.896 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/31' 2023-10-25T23:38:13.896 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/36' 2023-10-25T23:38:13.896 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/20' 2023-10-25T23:38:13.897 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/39' 2023-10-25T23:38:13.897 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/34' 2023-10-25T23:38:13.897 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/38' 2023-10-25T23:38:13.897 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/28' 2023-10-25T23:38:13.897 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/24' 2023-10-25T23:38:13.898 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/29' 2023-10-25T23:38:13.898 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/32' 2023-10-25T23:38:13.899 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/22' 2023-10-25T23:38:13.899 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/25' 2023-10-25T23:38:13.899 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/30' 2023-10-25T23:38:13.899 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/33' 2023-10-25T23:38:13.899 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/23' 2023-10-25T23:38:13.900 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/35' 2023-10-25T23:38:13.900 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/26' 2023-10-25T23:38:13.900 INFO:tasks.workunit.client.0.smithi081.stdout:removed './250/37' 2023-10-25T23:38:13.900 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './250' 2023-10-25T23:38:13.900 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/21' 2023-10-25T23:38:13.900 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/27' 2023-10-25T23:38:13.901 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/31' 2023-10-25T23:38:13.901 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/36' 2023-10-25T23:38:13.901 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/20' 2023-10-25T23:38:13.901 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/39' 2023-10-25T23:38:13.901 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/34' 2023-10-25T23:38:13.902 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/38' 2023-10-25T23:38:13.902 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/28' 2023-10-25T23:38:13.902 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/24' 2023-10-25T23:38:13.902 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/29' 2023-10-25T23:38:13.903 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/32' 2023-10-25T23:38:13.903 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/22' 2023-10-25T23:38:13.903 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/25' 2023-10-25T23:38:13.903 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/30' 2023-10-25T23:38:13.903 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/33' 2023-10-25T23:38:13.904 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/23' 2023-10-25T23:38:13.904 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/35' 2023-10-25T23:38:13.904 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/26' 2023-10-25T23:38:13.904 INFO:tasks.workunit.client.0.smithi081.stdout:removed './251/37' 2023-10-25T23:38:13.904 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './251' 2023-10-25T23:38:13.905 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/21' 2023-10-25T23:38:13.905 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/27' 2023-10-25T23:38:13.905 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/31' 2023-10-25T23:38:13.905 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/36' 2023-10-25T23:38:13.905 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/20' 2023-10-25T23:38:13.905 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/39' 2023-10-25T23:38:13.906 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/34' 2023-10-25T23:38:13.906 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/38' 2023-10-25T23:38:13.906 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/28' 2023-10-25T23:38:13.906 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/24' 2023-10-25T23:38:13.906 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/29' 2023-10-25T23:38:13.907 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/32' 2023-10-25T23:38:13.907 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/22' 2023-10-25T23:38:13.907 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/25' 2023-10-25T23:38:13.907 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/30' 2023-10-25T23:38:13.907 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/33' 2023-10-25T23:38:13.908 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/23' 2023-10-25T23:38:13.908 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/35' 2023-10-25T23:38:13.908 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/26' 2023-10-25T23:38:13.908 INFO:tasks.workunit.client.0.smithi081.stdout:removed './252/37' 2023-10-25T23:38:13.909 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './252' 2023-10-25T23:38:13.909 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/21' 2023-10-25T23:38:13.909 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/27' 2023-10-25T23:38:13.909 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/31' 2023-10-25T23:38:13.910 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/36' 2023-10-25T23:38:13.910 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/20' 2023-10-25T23:38:13.910 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/39' 2023-10-25T23:38:13.910 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/34' 2023-10-25T23:38:13.911 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/38' 2023-10-25T23:38:13.911 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/28' 2023-10-25T23:38:13.911 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/24' 2023-10-25T23:38:13.911 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/29' 2023-10-25T23:38:13.911 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/32' 2023-10-25T23:38:13.911 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/22' 2023-10-25T23:38:13.912 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/25' 2023-10-25T23:38:13.912 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/30' 2023-10-25T23:38:13.912 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/33' 2023-10-25T23:38:13.912 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/23' 2023-10-25T23:38:13.912 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/35' 2023-10-25T23:38:13.913 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/26' 2023-10-25T23:38:13.913 INFO:tasks.workunit.client.0.smithi081.stdout:removed './253/37' 2023-10-25T23:38:13.913 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './253' 2023-10-25T23:38:13.913 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/21' 2023-10-25T23:38:13.913 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/27' 2023-10-25T23:38:13.914 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/31' 2023-10-25T23:38:13.914 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/36' 2023-10-25T23:38:13.914 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/20' 2023-10-25T23:38:13.914 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/39' 2023-10-25T23:38:13.914 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/34' 2023-10-25T23:38:13.915 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/38' 2023-10-25T23:38:13.915 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/28' 2023-10-25T23:38:13.915 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/24' 2023-10-25T23:38:13.915 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/29' 2023-10-25T23:38:13.915 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/32' 2023-10-25T23:38:13.916 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/22' 2023-10-25T23:38:13.916 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/25' 2023-10-25T23:38:13.916 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/30' 2023-10-25T23:38:13.916 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/33' 2023-10-25T23:38:13.916 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/23' 2023-10-25T23:38:13.916 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/35' 2023-10-25T23:38:13.917 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/26' 2023-10-25T23:38:13.917 INFO:tasks.workunit.client.0.smithi081.stdout:removed './254/37' 2023-10-25T23:38:13.917 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './254' 2023-10-25T23:38:13.917 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/21' 2023-10-25T23:38:13.918 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/27' 2023-10-25T23:38:13.918 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/31' 2023-10-25T23:38:13.918 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/36' 2023-10-25T23:38:13.918 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/20' 2023-10-25T23:38:13.919 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/39' 2023-10-25T23:38:13.919 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/34' 2023-10-25T23:38:13.919 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/38' 2023-10-25T23:38:13.919 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/28' 2023-10-25T23:38:13.919 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/24' 2023-10-25T23:38:13.920 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/29' 2023-10-25T23:38:13.920 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/32' 2023-10-25T23:38:13.920 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/22' 2023-10-25T23:38:13.920 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/25' 2023-10-25T23:38:13.920 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/30' 2023-10-25T23:38:13.920 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/33' 2023-10-25T23:38:13.921 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/23' 2023-10-25T23:38:13.921 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/35' 2023-10-25T23:38:13.921 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/26' 2023-10-25T23:38:13.921 INFO:tasks.workunit.client.0.smithi081.stdout:removed './255/37' 2023-10-25T23:38:13.921 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './255' 2023-10-25T23:38:13.922 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/21' 2023-10-25T23:38:13.922 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/27' 2023-10-25T23:38:13.922 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/31' 2023-10-25T23:38:13.922 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/36' 2023-10-25T23:38:13.922 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/20' 2023-10-25T23:38:13.922 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/39' 2023-10-25T23:38:13.923 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/34' 2023-10-25T23:38:13.923 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/38' 2023-10-25T23:38:13.923 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/28' 2023-10-25T23:38:13.923 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/24' 2023-10-25T23:38:13.923 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/29' 2023-10-25T23:38:13.924 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/32' 2023-10-25T23:38:13.924 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/22' 2023-10-25T23:38:13.924 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/25' 2023-10-25T23:38:13.924 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/30' 2023-10-25T23:38:14.264 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/33' 2023-10-25T23:38:14.265 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/23' 2023-10-25T23:38:14.265 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/35' 2023-10-25T23:38:14.265 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/26' 2023-10-25T23:38:14.265 INFO:tasks.workunit.client.0.smithi081.stdout:removed './256/37' 2023-10-25T23:38:14.265 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './256' 2023-10-25T23:38:14.266 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/21' 2023-10-25T23:38:14.266 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/27' 2023-10-25T23:38:14.266 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/31' 2023-10-25T23:38:14.266 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/36' 2023-10-25T23:38:14.267 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/20' 2023-10-25T23:38:14.267 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/39' 2023-10-25T23:38:14.267 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/34' 2023-10-25T23:38:14.267 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/38' 2023-10-25T23:38:14.267 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/28' 2023-10-25T23:38:14.268 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/24' 2023-10-25T23:38:14.268 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/29' 2023-10-25T23:38:14.268 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/32' 2023-10-25T23:38:14.268 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/22' 2023-10-25T23:38:14.268 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/25' 2023-10-25T23:38:14.269 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/30' 2023-10-25T23:38:14.269 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/33' 2023-10-25T23:38:14.269 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/23' 2023-10-25T23:38:14.269 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/35' 2023-10-25T23:38:14.269 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/26' 2023-10-25T23:38:14.269 INFO:tasks.workunit.client.0.smithi081.stdout:removed './257/37' 2023-10-25T23:38:14.270 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './257' 2023-10-25T23:38:14.270 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/21' 2023-10-25T23:38:14.270 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/27' 2023-10-25T23:38:14.270 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/31' 2023-10-25T23:38:14.270 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/36' 2023-10-25T23:38:14.271 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/20' 2023-10-25T23:38:14.271 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/39' 2023-10-25T23:38:14.271 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/34' 2023-10-25T23:38:14.271 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/38' 2023-10-25T23:38:14.271 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/28' 2023-10-25T23:38:14.272 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/24' 2023-10-25T23:38:14.272 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/29' 2023-10-25T23:38:14.272 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/32' 2023-10-25T23:38:14.272 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/22' 2023-10-25T23:38:14.272 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/25' 2023-10-25T23:38:14.272 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/30' 2023-10-25T23:38:14.273 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/33' 2023-10-25T23:38:14.273 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/23' 2023-10-25T23:38:14.273 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/35' 2023-10-25T23:38:14.273 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/26' 2023-10-25T23:38:14.273 INFO:tasks.workunit.client.0.smithi081.stdout:removed './258/37' 2023-10-25T23:38:14.274 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './258' 2023-10-25T23:38:14.274 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/21' 2023-10-25T23:38:14.274 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/27' 2023-10-25T23:38:14.274 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/31' 2023-10-25T23:38:14.274 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/36' 2023-10-25T23:38:14.275 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/20' 2023-10-25T23:38:14.275 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/39' 2023-10-25T23:38:14.275 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/34' 2023-10-25T23:38:14.275 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/38' 2023-10-25T23:38:14.275 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/28' 2023-10-25T23:38:14.275 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/24' 2023-10-25T23:38:14.276 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/29' 2023-10-25T23:38:14.276 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/32' 2023-10-25T23:38:14.276 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/22' 2023-10-25T23:38:14.276 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/25' 2023-10-25T23:38:14.276 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/30' 2023-10-25T23:38:14.277 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/33' 2023-10-25T23:38:14.277 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/23' 2023-10-25T23:38:14.277 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/35' 2023-10-25T23:38:14.277 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/26' 2023-10-25T23:38:14.277 INFO:tasks.workunit.client.0.smithi081.stdout:removed './259/37' 2023-10-25T23:38:14.278 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './259' 2023-10-25T23:38:14.278 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/21' 2023-10-25T23:38:14.278 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/27' 2023-10-25T23:38:14.278 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/31' 2023-10-25T23:38:14.278 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/36' 2023-10-25T23:38:14.278 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/20' 2023-10-25T23:38:14.279 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/39' 2023-10-25T23:38:14.279 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/34' 2023-10-25T23:38:14.279 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/38' 2023-10-25T23:38:14.279 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/28' 2023-10-25T23:38:14.279 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/24' 2023-10-25T23:38:14.280 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/29' 2023-10-25T23:38:14.280 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/32' 2023-10-25T23:38:14.280 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/22' 2023-10-25T23:38:14.280 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/25' 2023-10-25T23:38:14.280 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/30' 2023-10-25T23:38:14.281 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/33' 2023-10-25T23:38:14.281 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/23' 2023-10-25T23:38:14.281 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/35' 2023-10-25T23:38:14.281 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/26' 2023-10-25T23:38:14.281 INFO:tasks.workunit.client.0.smithi081.stdout:removed './260/37' 2023-10-25T23:38:14.281 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './260' 2023-10-25T23:38:14.282 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/21' 2023-10-25T23:38:14.282 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/27' 2023-10-25T23:38:14.282 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/31' 2023-10-25T23:38:14.282 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/36' 2023-10-25T23:38:14.282 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/20' 2023-10-25T23:38:14.283 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/39' 2023-10-25T23:38:14.283 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/34' 2023-10-25T23:38:14.283 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/38' 2023-10-25T23:38:14.283 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/28' 2023-10-25T23:38:14.283 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/24' 2023-10-25T23:38:14.284 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/29' 2023-10-25T23:38:14.284 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/32' 2023-10-25T23:38:14.284 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/22' 2023-10-25T23:38:14.284 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/25' 2023-10-25T23:38:14.284 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/30' 2023-10-25T23:38:14.285 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/33' 2023-10-25T23:38:14.285 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/23' 2023-10-25T23:38:14.285 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/35' 2023-10-25T23:38:14.285 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/26' 2023-10-25T23:38:14.285 INFO:tasks.workunit.client.0.smithi081.stdout:removed './261/37' 2023-10-25T23:38:14.286 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './261' 2023-10-25T23:38:14.286 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/21' 2023-10-25T23:38:14.286 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/27' 2023-10-25T23:38:14.286 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/31' 2023-10-25T23:38:14.286 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/36' 2023-10-25T23:38:14.287 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/20' 2023-10-25T23:38:14.287 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/39' 2023-10-25T23:38:14.287 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/34' 2023-10-25T23:38:14.287 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/38' 2023-10-25T23:38:14.287 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/28' 2023-10-25T23:38:14.287 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/24' 2023-10-25T23:38:14.288 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/29' 2023-10-25T23:38:14.288 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/32' 2023-10-25T23:38:14.288 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/22' 2023-10-25T23:38:14.288 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/25' 2023-10-25T23:38:14.288 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/30' 2023-10-25T23:38:14.289 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/33' 2023-10-25T23:38:14.289 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/23' 2023-10-25T23:38:14.289 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/35' 2023-10-25T23:38:14.289 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/26' 2023-10-25T23:38:14.289 INFO:tasks.workunit.client.0.smithi081.stdout:removed './262/37' 2023-10-25T23:38:14.290 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './262' 2023-10-25T23:38:14.290 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/21' 2023-10-25T23:38:14.290 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/27' 2023-10-25T23:38:14.290 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/31' 2023-10-25T23:38:14.290 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/36' 2023-10-25T23:38:14.290 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/20' 2023-10-25T23:38:14.291 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/39' 2023-10-25T23:38:14.291 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/34' 2023-10-25T23:38:14.291 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/38' 2023-10-25T23:38:14.291 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/28' 2023-10-25T23:38:14.291 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/24' 2023-10-25T23:38:14.292 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/29' 2023-10-25T23:38:14.292 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/32' 2023-10-25T23:38:14.292 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/22' 2023-10-25T23:38:14.292 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/25' 2023-10-25T23:38:14.292 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/30' 2023-10-25T23:38:14.293 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/33' 2023-10-25T23:38:14.293 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/23' 2023-10-25T23:38:14.293 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/35' 2023-10-25T23:38:14.293 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/26' 2023-10-25T23:38:14.293 INFO:tasks.workunit.client.0.smithi081.stdout:removed './263/37' 2023-10-25T23:38:14.293 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './263' 2023-10-25T23:38:14.294 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/21' 2023-10-25T23:38:14.294 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/27' 2023-10-25T23:38:14.294 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/31' 2023-10-25T23:38:14.294 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/36' 2023-10-25T23:38:14.294 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/20' 2023-10-25T23:38:14.295 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/39' 2023-10-25T23:38:14.295 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/34' 2023-10-25T23:38:14.295 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/38' 2023-10-25T23:38:14.295 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/28' 2023-10-25T23:38:14.295 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/24' 2023-10-25T23:38:14.296 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/29' 2023-10-25T23:38:14.296 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/32' 2023-10-25T23:38:14.296 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/22' 2023-10-25T23:38:14.296 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/25' 2023-10-25T23:38:14.296 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/30' 2023-10-25T23:38:14.296 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/33' 2023-10-25T23:38:14.297 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/23' 2023-10-25T23:38:14.297 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/35' 2023-10-25T23:38:14.297 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/26' 2023-10-25T23:38:14.297 INFO:tasks.workunit.client.0.smithi081.stdout:removed './264/37' 2023-10-25T23:38:14.297 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './264' 2023-10-25T23:38:14.298 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/21' 2023-10-25T23:38:14.298 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/27' 2023-10-25T23:38:14.298 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/31' 2023-10-25T23:38:14.298 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/36' 2023-10-25T23:38:14.298 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/20' 2023-10-25T23:38:14.298 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/39' 2023-10-25T23:38:14.299 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/34' 2023-10-25T23:38:14.299 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/38' 2023-10-25T23:38:14.299 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/28' 2023-10-25T23:38:14.299 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/24' 2023-10-25T23:38:14.299 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/29' 2023-10-25T23:38:14.300 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/32' 2023-10-25T23:38:14.300 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/22' 2023-10-25T23:38:14.300 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/25' 2023-10-25T23:38:14.300 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/30' 2023-10-25T23:38:14.300 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/33' 2023-10-25T23:38:14.301 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/23' 2023-10-25T23:38:14.301 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/35' 2023-10-25T23:38:14.301 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/26' 2023-10-25T23:38:14.301 INFO:tasks.workunit.client.0.smithi081.stdout:removed './265/37' 2023-10-25T23:38:14.301 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './265' 2023-10-25T23:38:14.301 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/21' 2023-10-25T23:38:14.302 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/27' 2023-10-25T23:38:14.302 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/31' 2023-10-25T23:38:14.302 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/36' 2023-10-25T23:38:14.302 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/20' 2023-10-25T23:38:14.302 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/39' 2023-10-25T23:38:14.303 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/34' 2023-10-25T23:38:14.303 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/38' 2023-10-25T23:38:14.303 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/28' 2023-10-25T23:38:14.303 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/24' 2023-10-25T23:38:14.303 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/29' 2023-10-25T23:38:14.303 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/32' 2023-10-25T23:38:14.304 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/22' 2023-10-25T23:38:14.304 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/25' 2023-10-25T23:38:14.304 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/30' 2023-10-25T23:38:14.304 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/33' 2023-10-25T23:38:14.304 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/23' 2023-10-25T23:38:14.770 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/35' 2023-10-25T23:38:14.771 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/26' 2023-10-25T23:38:14.771 INFO:tasks.workunit.client.0.smithi081.stdout:removed './266/37' 2023-10-25T23:38:14.771 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './266' 2023-10-25T23:38:14.771 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/21' 2023-10-25T23:38:14.772 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/27' 2023-10-25T23:38:14.772 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/31' 2023-10-25T23:38:14.772 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/36' 2023-10-25T23:38:14.772 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/20' 2023-10-25T23:38:14.772 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/39' 2023-10-25T23:38:14.773 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/34' 2023-10-25T23:38:14.773 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/38' 2023-10-25T23:38:14.773 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/28' 2023-10-25T23:38:14.773 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/24' 2023-10-25T23:38:14.773 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/29' 2023-10-25T23:38:14.773 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/32' 2023-10-25T23:38:14.774 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/22' 2023-10-25T23:38:14.774 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/25' 2023-10-25T23:38:14.774 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/30' 2023-10-25T23:38:14.774 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/33' 2023-10-25T23:38:14.774 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/23' 2023-10-25T23:38:14.775 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/35' 2023-10-25T23:38:14.775 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/26' 2023-10-25T23:38:14.775 INFO:tasks.workunit.client.0.smithi081.stdout:removed './267/37' 2023-10-25T23:38:14.775 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './267' 2023-10-25T23:38:14.775 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/21' 2023-10-25T23:38:14.776 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/27' 2023-10-25T23:38:14.776 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/31' 2023-10-25T23:38:14.776 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/36' 2023-10-25T23:38:14.776 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/20' 2023-10-25T23:38:14.776 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/39' 2023-10-25T23:38:14.776 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/34' 2023-10-25T23:38:14.777 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/38' 2023-10-25T23:38:14.777 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/28' 2023-10-25T23:38:14.777 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/24' 2023-10-25T23:38:14.777 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/29' 2023-10-25T23:38:14.777 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/32' 2023-10-25T23:38:14.778 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/22' 2023-10-25T23:38:14.778 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/25' 2023-10-25T23:38:14.778 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/30' 2023-10-25T23:38:14.778 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/33' 2023-10-25T23:38:14.778 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/23' 2023-10-25T23:38:14.778 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/35' 2023-10-25T23:38:14.779 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/26' 2023-10-25T23:38:14.779 INFO:tasks.workunit.client.0.smithi081.stdout:removed './268/37' 2023-10-25T23:38:14.779 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './268' 2023-10-25T23:38:14.779 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/21' 2023-10-25T23:38:14.779 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/27' 2023-10-25T23:38:14.780 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/31' 2023-10-25T23:38:14.780 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/36' 2023-10-25T23:38:14.780 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/20' 2023-10-25T23:38:14.781 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/39' 2023-10-25T23:38:14.781 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/34' 2023-10-25T23:38:14.781 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/38' 2023-10-25T23:38:14.781 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/28' 2023-10-25T23:38:14.781 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/24' 2023-10-25T23:38:14.782 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/29' 2023-10-25T23:38:14.782 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/32' 2023-10-25T23:38:14.782 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/22' 2023-10-25T23:38:14.782 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/25' 2023-10-25T23:38:14.782 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/30' 2023-10-25T23:38:14.783 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/33' 2023-10-25T23:38:14.783 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/23' 2023-10-25T23:38:14.783 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/35' 2023-10-25T23:38:14.783 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/26' 2023-10-25T23:38:14.783 INFO:tasks.workunit.client.0.smithi081.stdout:removed './269/37' 2023-10-25T23:38:14.783 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './269' 2023-10-25T23:38:14.784 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/21' 2023-10-25T23:38:14.784 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/27' 2023-10-25T23:38:14.784 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/31' 2023-10-25T23:38:14.784 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/36' 2023-10-25T23:38:14.784 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/20' 2023-10-25T23:38:14.785 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/39' 2023-10-25T23:38:14.785 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/34' 2023-10-25T23:38:14.785 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/38' 2023-10-25T23:38:14.785 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/28' 2023-10-25T23:38:14.785 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/24' 2023-10-25T23:38:14.785 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/29' 2023-10-25T23:38:14.786 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/32' 2023-10-25T23:38:14.786 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/22' 2023-10-25T23:38:14.786 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/25' 2023-10-25T23:38:14.786 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/30' 2023-10-25T23:38:14.786 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/33' 2023-10-25T23:38:14.787 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/23' 2023-10-25T23:38:14.787 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/35' 2023-10-25T23:38:14.787 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/26' 2023-10-25T23:38:14.787 INFO:tasks.workunit.client.0.smithi081.stdout:removed './270/37' 2023-10-25T23:38:14.787 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './270' 2023-10-25T23:38:14.787 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/21' 2023-10-25T23:38:14.788 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/27' 2023-10-25T23:38:14.788 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/31' 2023-10-25T23:38:14.788 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/36' 2023-10-25T23:38:14.788 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/20' 2023-10-25T23:38:14.788 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/39' 2023-10-25T23:38:14.789 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/34' 2023-10-25T23:38:14.789 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/38' 2023-10-25T23:38:14.789 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/28' 2023-10-25T23:38:14.789 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/24' 2023-10-25T23:38:14.789 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/29' 2023-10-25T23:38:14.789 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/32' 2023-10-25T23:38:14.790 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/22' 2023-10-25T23:38:14.790 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/25' 2023-10-25T23:38:14.790 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/30' 2023-10-25T23:38:14.790 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/33' 2023-10-25T23:38:14.790 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/23' 2023-10-25T23:38:14.791 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/35' 2023-10-25T23:38:14.791 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/26' 2023-10-25T23:38:14.791 INFO:tasks.workunit.client.0.smithi081.stdout:removed './271/37' 2023-10-25T23:38:14.791 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './271' 2023-10-25T23:38:14.792 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/21' 2023-10-25T23:38:14.792 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/27' 2023-10-25T23:38:14.792 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/31' 2023-10-25T23:38:14.792 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/36' 2023-10-25T23:38:14.792 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/20' 2023-10-25T23:38:14.793 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/39' 2023-10-25T23:38:14.793 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/34' 2023-10-25T23:38:14.793 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/38' 2023-10-25T23:38:14.793 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/28' 2023-10-25T23:38:14.793 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/24' 2023-10-25T23:38:14.793 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/29' 2023-10-25T23:38:14.794 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/32' 2023-10-25T23:38:14.794 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/22' 2023-10-25T23:38:14.794 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/25' 2023-10-25T23:38:14.794 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/30' 2023-10-25T23:38:14.794 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/33' 2023-10-25T23:38:14.795 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/23' 2023-10-25T23:38:14.795 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/35' 2023-10-25T23:38:14.795 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/26' 2023-10-25T23:38:14.795 INFO:tasks.workunit.client.0.smithi081.stdout:removed './272/37' 2023-10-25T23:38:14.795 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './272' 2023-10-25T23:38:14.796 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/21' 2023-10-25T23:38:14.796 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/27' 2023-10-25T23:38:14.796 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/31' 2023-10-25T23:38:14.796 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/36' 2023-10-25T23:38:14.796 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/20' 2023-10-25T23:38:14.796 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/39' 2023-10-25T23:38:14.797 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/34' 2023-10-25T23:38:14.797 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/38' 2023-10-25T23:38:14.797 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/28' 2023-10-25T23:38:14.797 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/24' 2023-10-25T23:38:14.797 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/29' 2023-10-25T23:38:14.798 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/32' 2023-10-25T23:38:14.798 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/22' 2023-10-25T23:38:14.798 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/25' 2023-10-25T23:38:14.798 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/30' 2023-10-25T23:38:14.798 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/33' 2023-10-25T23:38:14.798 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/23' 2023-10-25T23:38:14.799 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/35' 2023-10-25T23:38:14.799 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/26' 2023-10-25T23:38:14.799 INFO:tasks.workunit.client.0.smithi081.stdout:removed './273/37' 2023-10-25T23:38:14.799 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './273' 2023-10-25T23:38:14.799 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/21' 2023-10-25T23:38:14.800 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/27' 2023-10-25T23:38:14.800 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/31' 2023-10-25T23:38:14.800 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/36' 2023-10-25T23:38:14.800 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/20' 2023-10-25T23:38:14.801 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/39' 2023-10-25T23:38:14.801 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/34' 2023-10-25T23:38:14.801 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/38' 2023-10-25T23:38:14.801 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/28' 2023-10-25T23:38:14.802 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/24' 2023-10-25T23:38:14.802 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/29' 2023-10-25T23:38:14.802 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/32' 2023-10-25T23:38:14.802 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/22' 2023-10-25T23:38:14.802 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/25' 2023-10-25T23:38:14.803 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/30' 2023-10-25T23:38:14.803 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/33' 2023-10-25T23:38:14.803 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/23' 2023-10-25T23:38:14.803 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/35' 2023-10-25T23:38:14.803 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/26' 2023-10-25T23:38:14.804 INFO:tasks.workunit.client.0.smithi081.stdout:removed './274/37' 2023-10-25T23:38:14.804 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './274' 2023-10-25T23:38:14.804 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/21' 2023-10-25T23:38:14.804 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/27' 2023-10-25T23:38:14.804 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/31' 2023-10-25T23:38:14.804 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/36' 2023-10-25T23:38:14.805 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/20' 2023-10-25T23:38:14.805 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/39' 2023-10-25T23:38:14.805 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/34' 2023-10-25T23:38:14.805 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/38' 2023-10-25T23:38:14.805 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/28' 2023-10-25T23:38:14.806 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/24' 2023-10-25T23:38:14.806 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/29' 2023-10-25T23:38:14.806 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/32' 2023-10-25T23:38:14.806 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/22' 2023-10-25T23:38:14.806 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/25' 2023-10-25T23:38:14.807 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/30' 2023-10-25T23:38:14.807 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/33' 2023-10-25T23:38:14.807 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/23' 2023-10-25T23:38:14.807 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/35' 2023-10-25T23:38:14.807 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/26' 2023-10-25T23:38:14.807 INFO:tasks.workunit.client.0.smithi081.stdout:removed './275/37' 2023-10-25T23:38:14.808 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './275' 2023-10-25T23:38:14.808 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/21' 2023-10-25T23:38:14.808 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/27' 2023-10-25T23:38:14.808 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/31' 2023-10-25T23:38:14.808 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/36' 2023-10-25T23:38:14.808 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/20' 2023-10-25T23:38:14.809 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/39' 2023-10-25T23:38:14.809 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/34' 2023-10-25T23:38:14.809 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/38' 2023-10-25T23:38:14.809 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/28' 2023-10-25T23:38:14.809 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/24' 2023-10-25T23:38:14.810 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/29' 2023-10-25T23:38:14.810 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/32' 2023-10-25T23:38:14.810 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/22' 2023-10-25T23:38:14.810 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/25' 2023-10-25T23:38:14.810 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/30' 2023-10-25T23:38:14.811 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/33' 2023-10-25T23:38:14.811 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/23' 2023-10-25T23:38:14.811 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/35' 2023-10-25T23:38:14.811 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/26' 2023-10-25T23:38:15.165 INFO:tasks.workunit.client.0.smithi081.stdout:removed './276/37' 2023-10-25T23:38:15.165 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './276' 2023-10-25T23:38:15.166 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/21' 2023-10-25T23:38:15.166 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/27' 2023-10-25T23:38:15.166 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/31' 2023-10-25T23:38:15.166 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/36' 2023-10-25T23:38:15.166 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/20' 2023-10-25T23:38:15.167 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/39' 2023-10-25T23:38:15.167 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/34' 2023-10-25T23:38:15.167 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/38' 2023-10-25T23:38:15.167 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/28' 2023-10-25T23:38:15.167 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/24' 2023-10-25T23:38:15.168 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/29' 2023-10-25T23:38:15.168 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/32' 2023-10-25T23:38:15.168 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/22' 2023-10-25T23:38:15.168 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/25' 2023-10-25T23:38:15.168 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/30' 2023-10-25T23:38:15.169 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/33' 2023-10-25T23:38:15.169 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/23' 2023-10-25T23:38:15.169 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/35' 2023-10-25T23:38:15.169 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/26' 2023-10-25T23:38:15.169 INFO:tasks.workunit.client.0.smithi081.stdout:removed './277/37' 2023-10-25T23:38:15.169 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './277' 2023-10-25T23:38:15.170 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/21' 2023-10-25T23:38:15.170 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/27' 2023-10-25T23:38:15.170 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/31' 2023-10-25T23:38:15.170 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/36' 2023-10-25T23:38:15.171 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/20' 2023-10-25T23:38:15.171 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/39' 2023-10-25T23:38:15.171 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/34' 2023-10-25T23:38:15.171 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/38' 2023-10-25T23:38:15.171 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/28' 2023-10-25T23:38:15.171 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/24' 2023-10-25T23:38:15.172 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/29' 2023-10-25T23:38:15.172 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/32' 2023-10-25T23:38:15.172 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/22' 2023-10-25T23:38:15.172 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/25' 2023-10-25T23:38:15.172 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/30' 2023-10-25T23:38:15.173 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/33' 2023-10-25T23:38:15.173 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/23' 2023-10-25T23:38:15.173 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/35' 2023-10-25T23:38:15.173 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/26' 2023-10-25T23:38:15.173 INFO:tasks.workunit.client.0.smithi081.stdout:removed './278/37' 2023-10-25T23:38:15.174 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './278' 2023-10-25T23:38:15.174 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/21' 2023-10-25T23:38:15.174 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/27' 2023-10-25T23:38:15.174 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/31' 2023-10-25T23:38:15.174 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/36' 2023-10-25T23:38:15.175 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/20' 2023-10-25T23:38:15.175 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/39' 2023-10-25T23:38:15.175 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/34' 2023-10-25T23:38:15.175 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/38' 2023-10-25T23:38:15.175 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/28' 2023-10-25T23:38:15.175 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/24' 2023-10-25T23:38:15.176 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/29' 2023-10-25T23:38:15.176 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/32' 2023-10-25T23:38:15.176 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/22' 2023-10-25T23:38:15.176 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/25' 2023-10-25T23:38:15.176 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/30' 2023-10-25T23:38:15.177 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/33' 2023-10-25T23:38:15.177 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/23' 2023-10-25T23:38:15.177 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/35' 2023-10-25T23:38:15.177 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/26' 2023-10-25T23:38:15.177 INFO:tasks.workunit.client.0.smithi081.stdout:removed './279/37' 2023-10-25T23:38:15.177 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './279' 2023-10-25T23:38:15.178 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/21' 2023-10-25T23:38:15.178 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/27' 2023-10-25T23:38:15.178 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/31' 2023-10-25T23:38:15.178 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/36' 2023-10-25T23:38:15.178 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/20' 2023-10-25T23:38:15.179 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/39' 2023-10-25T23:38:15.179 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/34' 2023-10-25T23:38:15.179 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/38' 2023-10-25T23:38:15.179 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/28' 2023-10-25T23:38:15.179 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/24' 2023-10-25T23:38:15.179 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/29' 2023-10-25T23:38:15.180 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/32' 2023-10-25T23:38:15.180 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/22' 2023-10-25T23:38:15.180 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/25' 2023-10-25T23:38:15.180 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/30' 2023-10-25T23:38:15.181 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/33' 2023-10-25T23:38:15.181 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/23' 2023-10-25T23:38:15.181 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/35' 2023-10-25T23:38:15.181 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/26' 2023-10-25T23:38:15.181 INFO:tasks.workunit.client.0.smithi081.stdout:removed './280/37' 2023-10-25T23:38:15.182 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './280' 2023-10-25T23:38:15.182 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/21' 2023-10-25T23:38:15.182 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/27' 2023-10-25T23:38:15.182 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/31' 2023-10-25T23:38:15.182 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/36' 2023-10-25T23:38:15.182 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/20' 2023-10-25T23:38:15.183 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/39' 2023-10-25T23:38:15.183 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/34' 2023-10-25T23:38:15.183 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/38' 2023-10-25T23:38:15.183 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/28' 2023-10-25T23:38:15.183 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/24' 2023-10-25T23:38:15.184 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/29' 2023-10-25T23:38:15.184 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/32' 2023-10-25T23:38:15.184 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/22' 2023-10-25T23:38:15.184 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/25' 2023-10-25T23:38:15.184 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/30' 2023-10-25T23:38:15.184 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/33' 2023-10-25T23:38:15.185 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/23' 2023-10-25T23:38:15.185 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/35' 2023-10-25T23:38:15.185 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/26' 2023-10-25T23:38:15.185 INFO:tasks.workunit.client.0.smithi081.stdout:removed './281/37' 2023-10-25T23:38:15.185 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './281' 2023-10-25T23:38:15.186 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/21' 2023-10-25T23:38:15.186 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/27' 2023-10-25T23:38:15.186 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/31' 2023-10-25T23:38:15.186 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/36' 2023-10-25T23:38:15.186 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/20' 2023-10-25T23:38:15.186 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/39' 2023-10-25T23:38:15.187 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/34' 2023-10-25T23:38:15.187 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/38' 2023-10-25T23:38:15.187 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/28' 2023-10-25T23:38:15.187 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/24' 2023-10-25T23:38:15.187 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/29' 2023-10-25T23:38:15.188 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/32' 2023-10-25T23:38:15.188 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/22' 2023-10-25T23:38:15.188 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/25' 2023-10-25T23:38:15.188 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/30' 2023-10-25T23:38:15.188 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/33' 2023-10-25T23:38:15.188 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/23' 2023-10-25T23:38:15.189 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/35' 2023-10-25T23:38:15.189 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/26' 2023-10-25T23:38:15.189 INFO:tasks.workunit.client.0.smithi081.stdout:removed './282/37' 2023-10-25T23:38:15.189 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './282' 2023-10-25T23:38:15.189 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/21' 2023-10-25T23:38:15.190 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/27' 2023-10-25T23:38:15.190 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/31' 2023-10-25T23:38:15.190 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/36' 2023-10-25T23:38:15.190 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/20' 2023-10-25T23:38:15.190 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/39' 2023-10-25T23:38:15.191 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/34' 2023-10-25T23:38:15.191 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/38' 2023-10-25T23:38:15.191 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/28' 2023-10-25T23:38:15.191 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/24' 2023-10-25T23:38:15.191 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/29' 2023-10-25T23:38:15.191 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/32' 2023-10-25T23:38:15.192 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/22' 2023-10-25T23:38:15.192 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/25' 2023-10-25T23:38:15.192 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/30' 2023-10-25T23:38:15.192 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/33' 2023-10-25T23:38:15.192 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/23' 2023-10-25T23:38:15.193 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/35' 2023-10-25T23:38:15.193 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/26' 2023-10-25T23:38:15.193 INFO:tasks.workunit.client.0.smithi081.stdout:removed './283/37' 2023-10-25T23:38:15.193 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './283' 2023-10-25T23:38:15.193 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/21' 2023-10-25T23:38:15.193 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/27' 2023-10-25T23:38:15.194 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/31' 2023-10-25T23:38:15.194 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/36' 2023-10-25T23:38:15.194 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/20' 2023-10-25T23:38:15.194 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/39' 2023-10-25T23:38:15.194 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/34' 2023-10-25T23:38:15.195 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/38' 2023-10-25T23:38:15.195 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/28' 2023-10-25T23:38:15.195 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/24' 2023-10-25T23:38:15.195 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/29' 2023-10-25T23:38:15.195 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/32' 2023-10-25T23:38:15.196 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/22' 2023-10-25T23:38:15.196 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/25' 2023-10-25T23:38:15.196 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/30' 2023-10-25T23:38:15.196 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/33' 2023-10-25T23:38:15.196 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/23' 2023-10-25T23:38:15.196 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/35' 2023-10-25T23:38:15.197 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/26' 2023-10-25T23:38:15.197 INFO:tasks.workunit.client.0.smithi081.stdout:removed './284/37' 2023-10-25T23:38:15.197 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './284' 2023-10-25T23:38:15.197 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/21' 2023-10-25T23:38:15.197 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/27' 2023-10-25T23:38:15.198 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/31' 2023-10-25T23:38:15.198 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/36' 2023-10-25T23:38:15.198 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/20' 2023-10-25T23:38:15.198 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/39' 2023-10-25T23:38:15.198 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/34' 2023-10-25T23:38:15.199 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/38' 2023-10-25T23:38:15.199 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/28' 2023-10-25T23:38:15.199 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/24' 2023-10-25T23:38:15.199 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/29' 2023-10-25T23:38:15.199 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/32' 2023-10-25T23:38:15.199 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/22' 2023-10-25T23:38:15.200 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/25' 2023-10-25T23:38:15.200 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/30' 2023-10-25T23:38:15.200 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/33' 2023-10-25T23:38:15.200 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/23' 2023-10-25T23:38:15.200 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/35' 2023-10-25T23:38:15.201 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/26' 2023-10-25T23:38:15.201 INFO:tasks.workunit.client.0.smithi081.stdout:removed './285/37' 2023-10-25T23:38:15.201 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './285' 2023-10-25T23:38:15.201 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/21' 2023-10-25T23:38:15.201 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/27' 2023-10-25T23:38:15.201 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/31' 2023-10-25T23:38:15.202 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/36' 2023-10-25T23:38:15.202 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/20' 2023-10-25T23:38:15.202 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/39' 2023-10-25T23:38:15.202 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/34' 2023-10-25T23:38:15.202 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/38' 2023-10-25T23:38:15.202 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/28' 2023-10-25T23:38:15.203 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/24' 2023-10-25T23:38:15.203 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/29' 2023-10-25T23:38:15.203 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/32' 2023-10-25T23:38:15.203 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/22' 2023-10-25T23:38:15.203 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/25' 2023-10-25T23:38:15.204 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/30' 2023-10-25T23:38:15.204 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/33' 2023-10-25T23:38:15.204 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/23' 2023-10-25T23:38:15.204 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/35' 2023-10-25T23:38:15.204 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/26' 2023-10-25T23:38:15.204 INFO:tasks.workunit.client.0.smithi081.stdout:removed './286/37' 2023-10-25T23:38:15.205 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './286' 2023-10-25T23:38:15.589 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/21' 2023-10-25T23:38:15.589 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/27' 2023-10-25T23:38:15.590 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/31' 2023-10-25T23:38:15.590 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/36' 2023-10-25T23:38:15.590 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/20' 2023-10-25T23:38:15.590 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/39' 2023-10-25T23:38:15.590 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/34' 2023-10-25T23:38:15.591 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/38' 2023-10-25T23:38:15.591 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/28' 2023-10-25T23:38:15.591 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/24' 2023-10-25T23:38:15.591 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/29' 2023-10-25T23:38:15.591 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/32' 2023-10-25T23:38:15.592 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/22' 2023-10-25T23:38:15.592 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/25' 2023-10-25T23:38:15.592 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/30' 2023-10-25T23:38:15.592 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/33' 2023-10-25T23:38:15.592 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/23' 2023-10-25T23:38:15.593 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/35' 2023-10-25T23:38:15.593 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/26' 2023-10-25T23:38:15.593 INFO:tasks.workunit.client.0.smithi081.stdout:removed './287/37' 2023-10-25T23:38:15.593 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './287' 2023-10-25T23:38:15.593 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/21' 2023-10-25T23:38:15.593 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/27' 2023-10-25T23:38:15.594 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/31' 2023-10-25T23:38:15.594 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/36' 2023-10-25T23:38:15.594 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/20' 2023-10-25T23:38:15.594 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/39' 2023-10-25T23:38:15.594 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/34' 2023-10-25T23:38:15.595 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/38' 2023-10-25T23:38:15.595 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/28' 2023-10-25T23:38:15.595 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/24' 2023-10-25T23:38:15.595 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/29' 2023-10-25T23:38:15.595 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/32' 2023-10-25T23:38:15.596 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/22' 2023-10-25T23:38:15.596 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/25' 2023-10-25T23:38:15.596 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/30' 2023-10-25T23:38:15.596 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/33' 2023-10-25T23:38:15.596 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/23' 2023-10-25T23:38:15.597 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/35' 2023-10-25T23:38:15.597 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/26' 2023-10-25T23:38:15.597 INFO:tasks.workunit.client.0.smithi081.stdout:removed './288/37' 2023-10-25T23:38:15.597 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './288' 2023-10-25T23:38:15.597 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/21' 2023-10-25T23:38:15.597 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/27' 2023-10-25T23:38:15.598 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/31' 2023-10-25T23:38:15.598 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/36' 2023-10-25T23:38:15.598 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/20' 2023-10-25T23:38:15.598 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/39' 2023-10-25T23:38:15.598 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/34' 2023-10-25T23:38:15.598 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/38' 2023-10-25T23:38:15.599 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/28' 2023-10-25T23:38:15.599 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/24' 2023-10-25T23:38:15.599 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/29' 2023-10-25T23:38:15.599 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/32' 2023-10-25T23:38:15.599 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/22' 2023-10-25T23:38:15.599 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/25' 2023-10-25T23:38:15.600 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/30' 2023-10-25T23:38:15.600 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/33' 2023-10-25T23:38:15.600 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/23' 2023-10-25T23:38:15.600 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/35' 2023-10-25T23:38:15.600 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/26' 2023-10-25T23:38:15.601 INFO:tasks.workunit.client.0.smithi081.stdout:removed './289/37' 2023-10-25T23:38:15.601 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './289' 2023-10-25T23:38:15.601 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/21' 2023-10-25T23:38:15.601 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/27' 2023-10-25T23:38:15.601 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/31' 2023-10-25T23:38:15.601 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/36' 2023-10-25T23:38:15.602 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/20' 2023-10-25T23:38:15.602 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/39' 2023-10-25T23:38:15.602 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/34' 2023-10-25T23:38:15.602 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/38' 2023-10-25T23:38:15.603 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/28' 2023-10-25T23:38:15.603 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/24' 2023-10-25T23:38:15.603 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/29' 2023-10-25T23:38:15.603 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/32' 2023-10-25T23:38:15.603 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/22' 2023-10-25T23:38:15.604 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/25' 2023-10-25T23:38:15.604 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/30' 2023-10-25T23:38:15.604 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/33' 2023-10-25T23:38:15.604 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/23' 2023-10-25T23:38:15.604 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/35' 2023-10-25T23:38:15.605 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/26' 2023-10-25T23:38:15.605 INFO:tasks.workunit.client.0.smithi081.stdout:removed './290/37' 2023-10-25T23:38:15.605 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './290' 2023-10-25T23:38:15.605 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/21' 2023-10-25T23:38:15.605 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/27' 2023-10-25T23:38:15.605 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/31' 2023-10-25T23:38:15.606 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/36' 2023-10-25T23:38:15.606 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/20' 2023-10-25T23:38:15.606 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/39' 2023-10-25T23:38:15.606 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/34' 2023-10-25T23:38:15.606 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/38' 2023-10-25T23:38:15.607 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/28' 2023-10-25T23:38:15.607 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/24' 2023-10-25T23:38:15.607 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/29' 2023-10-25T23:38:15.607 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/32' 2023-10-25T23:38:15.607 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/22' 2023-10-25T23:38:15.607 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/25' 2023-10-25T23:38:15.608 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/30' 2023-10-25T23:38:15.608 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/33' 2023-10-25T23:38:15.608 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/23' 2023-10-25T23:38:15.608 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/35' 2023-10-25T23:38:15.608 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/26' 2023-10-25T23:38:15.609 INFO:tasks.workunit.client.0.smithi081.stdout:removed './291/37' 2023-10-25T23:38:15.609 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './291' 2023-10-25T23:38:15.609 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/21' 2023-10-25T23:38:15.609 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/27' 2023-10-25T23:38:15.609 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/31' 2023-10-25T23:38:15.609 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/36' 2023-10-25T23:38:15.610 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/20' 2023-10-25T23:38:15.610 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/39' 2023-10-25T23:38:15.610 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/34' 2023-10-25T23:38:15.610 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/38' 2023-10-25T23:38:15.610 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/28' 2023-10-25T23:38:15.611 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/24' 2023-10-25T23:38:15.611 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/29' 2023-10-25T23:38:15.611 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/32' 2023-10-25T23:38:15.611 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/22' 2023-10-25T23:38:15.611 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/25' 2023-10-25T23:38:15.612 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/30' 2023-10-25T23:38:15.612 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/33' 2023-10-25T23:38:15.612 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/23' 2023-10-25T23:38:15.612 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/35' 2023-10-25T23:38:15.612 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/26' 2023-10-25T23:38:15.612 INFO:tasks.workunit.client.0.smithi081.stdout:removed './292/37' 2023-10-25T23:38:15.613 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './292' 2023-10-25T23:38:15.613 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/21' 2023-10-25T23:38:15.613 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/27' 2023-10-25T23:38:15.613 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/31' 2023-10-25T23:38:15.613 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/36' 2023-10-25T23:38:15.614 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/20' 2023-10-25T23:38:15.614 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/39' 2023-10-25T23:38:15.615 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/34' 2023-10-25T23:38:15.615 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/38' 2023-10-25T23:38:15.615 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/28' 2023-10-25T23:38:15.615 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/24' 2023-10-25T23:38:15.615 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/29' 2023-10-25T23:38:15.616 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/32' 2023-10-25T23:38:15.616 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/22' 2023-10-25T23:38:15.616 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/25' 2023-10-25T23:38:15.616 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/30' 2023-10-25T23:38:15.616 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/33' 2023-10-25T23:38:15.617 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/23' 2023-10-25T23:38:15.617 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/35' 2023-10-25T23:38:15.617 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/26' 2023-10-25T23:38:15.617 INFO:tasks.workunit.client.0.smithi081.stdout:removed './293/37' 2023-10-25T23:38:15.617 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './293' 2023-10-25T23:38:15.618 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/21' 2023-10-25T23:38:15.618 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/27' 2023-10-25T23:38:15.618 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/31' 2023-10-25T23:38:15.618 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/36' 2023-10-25T23:38:15.618 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/20' 2023-10-25T23:38:15.619 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/39' 2023-10-25T23:38:15.619 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/34' 2023-10-25T23:38:15.619 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/38' 2023-10-25T23:38:15.619 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/28' 2023-10-25T23:38:15.619 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/24' 2023-10-25T23:38:15.620 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/29' 2023-10-25T23:38:15.620 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/32' 2023-10-25T23:38:15.620 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/22' 2023-10-25T23:38:15.620 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/25' 2023-10-25T23:38:15.620 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/30' 2023-10-25T23:38:15.621 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/33' 2023-10-25T23:38:15.621 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/23' 2023-10-25T23:38:15.621 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/35' 2023-10-25T23:38:15.621 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/26' 2023-10-25T23:38:15.621 INFO:tasks.workunit.client.0.smithi081.stdout:removed './294/37' 2023-10-25T23:38:15.621 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './294' 2023-10-25T23:38:15.622 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/21' 2023-10-25T23:38:15.622 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/27' 2023-10-25T23:38:15.622 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/31' 2023-10-25T23:38:15.622 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/36' 2023-10-25T23:38:15.622 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/20' 2023-10-25T23:38:15.623 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/39' 2023-10-25T23:38:15.623 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/34' 2023-10-25T23:38:15.623 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/38' 2023-10-25T23:38:15.623 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/28' 2023-10-25T23:38:15.623 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/24' 2023-10-25T23:38:15.624 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/29' 2023-10-25T23:38:15.624 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/32' 2023-10-25T23:38:15.624 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/22' 2023-10-25T23:38:15.624 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/25' 2023-10-25T23:38:15.624 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/30' 2023-10-25T23:38:15.624 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/33' 2023-10-25T23:38:15.625 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/23' 2023-10-25T23:38:15.625 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/35' 2023-10-25T23:38:15.625 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/26' 2023-10-25T23:38:15.625 INFO:tasks.workunit.client.0.smithi081.stdout:removed './295/37' 2023-10-25T23:38:15.625 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './295' 2023-10-25T23:38:15.626 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/21' 2023-10-25T23:38:15.626 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/27' 2023-10-25T23:38:15.626 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/31' 2023-10-25T23:38:15.626 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/36' 2023-10-25T23:38:15.626 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/20' 2023-10-25T23:38:15.626 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/39' 2023-10-25T23:38:15.627 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/34' 2023-10-25T23:38:15.627 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/38' 2023-10-25T23:38:15.627 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/28' 2023-10-25T23:38:15.627 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/24' 2023-10-25T23:38:15.627 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/29' 2023-10-25T23:38:15.628 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/32' 2023-10-25T23:38:15.628 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/22' 2023-10-25T23:38:15.628 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/25' 2023-10-25T23:38:15.628 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/30' 2023-10-25T23:38:15.628 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/33' 2023-10-25T23:38:15.629 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/23' 2023-10-25T23:38:15.629 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/35' 2023-10-25T23:38:15.629 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/26' 2023-10-25T23:38:15.629 INFO:tasks.workunit.client.0.smithi081.stdout:removed './296/37' 2023-10-25T23:38:15.629 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './296' 2023-10-25T23:38:15.629 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/21' 2023-10-25T23:38:15.630 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/27' 2023-10-25T23:38:15.990 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/31' 2023-10-25T23:38:15.991 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/36' 2023-10-25T23:38:15.991 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/20' 2023-10-25T23:38:15.991 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/39' 2023-10-25T23:38:15.991 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/34' 2023-10-25T23:38:15.992 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/38' 2023-10-25T23:38:15.992 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/28' 2023-10-25T23:38:15.992 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/24' 2023-10-25T23:38:15.992 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/29' 2023-10-25T23:38:15.992 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/32' 2023-10-25T23:38:15.993 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/22' 2023-10-25T23:38:15.993 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/25' 2023-10-25T23:38:15.993 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/30' 2023-10-25T23:38:15.993 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/33' 2023-10-25T23:38:15.993 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/23' 2023-10-25T23:38:15.993 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/35' 2023-10-25T23:38:15.994 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/26' 2023-10-25T23:38:15.994 INFO:tasks.workunit.client.0.smithi081.stdout:removed './297/37' 2023-10-25T23:38:15.994 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './297' 2023-10-25T23:38:15.994 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/21' 2023-10-25T23:38:15.994 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/27' 2023-10-25T23:38:15.995 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/31' 2023-10-25T23:38:15.995 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/36' 2023-10-25T23:38:15.995 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/20' 2023-10-25T23:38:15.995 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/39' 2023-10-25T23:38:15.995 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/34' 2023-10-25T23:38:15.996 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/38' 2023-10-25T23:38:15.996 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/28' 2023-10-25T23:38:15.996 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/24' 2023-10-25T23:38:15.996 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/29' 2023-10-25T23:38:15.996 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/32' 2023-10-25T23:38:15.997 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/22' 2023-10-25T23:38:15.997 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/25' 2023-10-25T23:38:15.997 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/30' 2023-10-25T23:38:15.997 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/33' 2023-10-25T23:38:15.997 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/23' 2023-10-25T23:38:15.998 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/35' 2023-10-25T23:38:15.998 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/26' 2023-10-25T23:38:15.998 INFO:tasks.workunit.client.0.smithi081.stdout:removed './298/37' 2023-10-25T23:38:15.998 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './298' 2023-10-25T23:38:15.998 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/21' 2023-10-25T23:38:15.999 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/27' 2023-10-25T23:38:15.999 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/31' 2023-10-25T23:38:15.999 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/36' 2023-10-25T23:38:15.999 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/20' 2023-10-25T23:38:15.999 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/39' 2023-10-25T23:38:15.999 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/34' 2023-10-25T23:38:16.000 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/38' 2023-10-25T23:38:16.000 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/28' 2023-10-25T23:38:16.000 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/24' 2023-10-25T23:38:16.000 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/29' 2023-10-25T23:38:16.000 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/32' 2023-10-25T23:38:16.001 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/22' 2023-10-25T23:38:16.001 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/25' 2023-10-25T23:38:16.001 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/30' 2023-10-25T23:38:16.001 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/33' 2023-10-25T23:38:16.001 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/23' 2023-10-25T23:38:16.002 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/35' 2023-10-25T23:38:16.002 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/26' 2023-10-25T23:38:16.002 INFO:tasks.workunit.client.0.smithi081.stdout:removed './299/37' 2023-10-25T23:38:16.002 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './299' 2023-10-25T23:38:16.002 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/166/19' 2023-10-25T23:38:16.002 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/166/15' 2023-10-25T23:38:16.003 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/166/20' 2023-10-25T23:38:16.003 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/166/12' 2023-10-25T23:38:16.003 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/166/10' 2023-10-25T23:38:16.003 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/166/11' 2023-10-25T23:38:16.003 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/166/16' 2023-10-25T23:38:16.004 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/166/14' 2023-10-25T23:38:16.004 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/166/18' 2023-10-25T23:38:16.004 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/166/13' 2023-10-25T23:38:16.004 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/166/17' 2023-10-25T23:38:16.004 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/166' 2023-10-25T23:38:16.004 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/147/19' 2023-10-25T23:38:16.005 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/147/15' 2023-10-25T23:38:16.005 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/147/20' 2023-10-25T23:38:16.005 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/147/12' 2023-10-25T23:38:16.005 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/147/10' 2023-10-25T23:38:16.005 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/147/11' 2023-10-25T23:38:16.006 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/147/16' 2023-10-25T23:38:16.006 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/147/14' 2023-10-25T23:38:16.006 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/147/18' 2023-10-25T23:38:16.006 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/147/13' 2023-10-25T23:38:16.006 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/147/17' 2023-10-25T23:38:16.007 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/147' 2023-10-25T23:38:16.007 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/151/19' 2023-10-25T23:38:16.007 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/151/15' 2023-10-25T23:38:16.007 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/151/20' 2023-10-25T23:38:16.007 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/151/12' 2023-10-25T23:38:16.007 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/151/10' 2023-10-25T23:38:16.008 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/151/11' 2023-10-25T23:38:16.008 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/151/16' 2023-10-25T23:38:16.008 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/151/14' 2023-10-25T23:38:16.008 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/151/18' 2023-10-25T23:38:16.008 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/151/13' 2023-10-25T23:38:16.009 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/151/17' 2023-10-25T23:38:16.009 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/151' 2023-10-25T23:38:16.009 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/170/19' 2023-10-25T23:38:16.009 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/170/15' 2023-10-25T23:38:16.009 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/170/20' 2023-10-25T23:38:16.009 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/170/12' 2023-10-25T23:38:16.010 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/170/10' 2023-10-25T23:38:16.010 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/170/11' 2023-10-25T23:38:16.010 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/170/16' 2023-10-25T23:38:16.010 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/170/14' 2023-10-25T23:38:16.010 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/170/18' 2023-10-25T23:38:16.011 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/170/13' 2023-10-25T23:38:16.011 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/170/17' 2023-10-25T23:38:16.011 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/170' 2023-10-25T23:38:16.011 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/167/19' 2023-10-25T23:38:16.011 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/167/15' 2023-10-25T23:38:16.011 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/167/20' 2023-10-25T23:38:16.012 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/167/12' 2023-10-25T23:38:16.012 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/167/10' 2023-10-25T23:38:16.012 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/167/11' 2023-10-25T23:38:16.012 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/167/16' 2023-10-25T23:38:16.012 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/167/14' 2023-10-25T23:38:16.013 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/167/18' 2023-10-25T23:38:16.013 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/167/13' 2023-10-25T23:38:16.013 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/167/17' 2023-10-25T23:38:16.013 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/167' 2023-10-25T23:38:16.013 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/140/19' 2023-10-25T23:38:16.013 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/140/15' 2023-10-25T23:38:16.014 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/140/20' 2023-10-25T23:38:16.014 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/140/12' 2023-10-25T23:38:16.014 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/140/10' 2023-10-25T23:38:16.014 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/140/11' 2023-10-25T23:38:16.014 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/140/16' 2023-10-25T23:38:16.014 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/140/14' 2023-10-25T23:38:16.015 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/140/18' 2023-10-25T23:38:16.015 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/140/13' 2023-10-25T23:38:16.015 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/140/17' 2023-10-25T23:38:16.015 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/140' 2023-10-25T23:38:16.015 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/142/19' 2023-10-25T23:38:16.016 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/142/15' 2023-10-25T23:38:16.016 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/142/20' 2023-10-25T23:38:16.016 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/142/12' 2023-10-25T23:38:16.016 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/142/10' 2023-10-25T23:38:16.253 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/142/11' 2023-10-25T23:38:16.253 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/142/16' 2023-10-25T23:38:16.253 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/142/14' 2023-10-25T23:38:16.254 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/142/18' 2023-10-25T23:38:16.254 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/142/13' 2023-10-25T23:38:16.254 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/142/17' 2023-10-25T23:38:16.254 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/142' 2023-10-25T23:38:16.254 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/150/19' 2023-10-25T23:38:16.255 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/150/15' 2023-10-25T23:38:16.255 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/150/20' 2023-10-25T23:38:16.255 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/150/12' 2023-10-25T23:38:16.255 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/150/10' 2023-10-25T23:38:16.255 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/150/11' 2023-10-25T23:38:16.256 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/150/16' 2023-10-25T23:38:16.256 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/150/14' 2023-10-25T23:38:16.256 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/150/18' 2023-10-25T23:38:16.256 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/150/13' 2023-10-25T23:38:16.256 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/150/17' 2023-10-25T23:38:16.257 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/150' 2023-10-25T23:38:16.257 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/105/19' 2023-10-25T23:38:16.257 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/105/15' 2023-10-25T23:38:16.257 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/105/20' 2023-10-25T23:38:16.257 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/105/12' 2023-10-25T23:38:16.257 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/105/10' 2023-10-25T23:38:16.258 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/105/11' 2023-10-25T23:38:16.258 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/105/16' 2023-10-25T23:38:16.258 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/105/14' 2023-10-25T23:38:16.258 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/105/18' 2023-10-25T23:38:16.258 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/105/13' 2023-10-25T23:38:16.259 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/105/17' 2023-10-25T23:38:16.259 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/105' 2023-10-25T23:38:16.259 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/149/19' 2023-10-25T23:38:16.259 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/149/15' 2023-10-25T23:38:16.259 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/149/20' 2023-10-25T23:38:16.260 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/149/12' 2023-10-25T23:38:16.260 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/149/10' 2023-10-25T23:38:16.260 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/149/11' 2023-10-25T23:38:16.260 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/149/16' 2023-10-25T23:38:16.260 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/149/14' 2023-10-25T23:38:16.260 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/149/18' 2023-10-25T23:38:16.261 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/149/13' 2023-10-25T23:38:16.261 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/149/17' 2023-10-25T23:38:16.261 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/149' 2023-10-25T23:38:16.261 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/109/19' 2023-10-25T23:38:16.261 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/109/15' 2023-10-25T23:38:16.262 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/109/20' 2023-10-25T23:38:16.262 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/109/12' 2023-10-25T23:38:16.262 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/109/10' 2023-10-25T23:38:16.262 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/109/11' 2023-10-25T23:38:16.262 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/109/16' 2023-10-25T23:38:16.263 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/109/14' 2023-10-25T23:38:16.263 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/109/18' 2023-10-25T23:38:16.263 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/109/13' 2023-10-25T23:38:16.263 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/109/17' 2023-10-25T23:38:16.263 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/109' 2023-10-25T23:38:16.263 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/158/19' 2023-10-25T23:38:16.264 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/158/15' 2023-10-25T23:38:16.264 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/158/20' 2023-10-25T23:38:16.264 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/158/12' 2023-10-25T23:38:16.264 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/158/10' 2023-10-25T23:38:16.264 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/158/11' 2023-10-25T23:38:16.265 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/158/16' 2023-10-25T23:38:16.265 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/158/14' 2023-10-25T23:38:16.265 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/158/18' 2023-10-25T23:38:16.265 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/158/13' 2023-10-25T23:38:16.265 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/158/17' 2023-10-25T23:38:16.265 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/158' 2023-10-25T23:38:16.266 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/106/19' 2023-10-25T23:38:16.266 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/106/15' 2023-10-25T23:38:16.266 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/106/20' 2023-10-25T23:38:16.266 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/106/12' 2023-10-25T23:38:16.266 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/106/10' 2023-10-25T23:38:16.267 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/106/11' 2023-10-25T23:38:16.267 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/106/16' 2023-10-25T23:38:16.267 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/106/14' 2023-10-25T23:38:16.267 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/106/18' 2023-10-25T23:38:16.267 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/106/13' 2023-10-25T23:38:16.268 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/106/17' 2023-10-25T23:38:16.268 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/106' 2023-10-25T23:38:16.268 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/189/19' 2023-10-25T23:38:16.268 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/189/15' 2023-10-25T23:38:16.268 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/189/20' 2023-10-25T23:38:16.268 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/189/12' 2023-10-25T23:38:16.269 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/189/10' 2023-10-25T23:38:16.269 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/189/11' 2023-10-25T23:38:16.269 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/189/16' 2023-10-25T23:38:16.269 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/189/14' 2023-10-25T23:38:16.269 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/189/18' 2023-10-25T23:38:16.270 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/189/13' 2023-10-25T23:38:16.270 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/189/17' 2023-10-25T23:38:16.270 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/189' 2023-10-25T23:38:16.270 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/133/19' 2023-10-25T23:38:16.270 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/133/15' 2023-10-25T23:38:16.271 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/133/20' 2023-10-25T23:38:16.271 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/133/12' 2023-10-25T23:38:16.271 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/133/10' 2023-10-25T23:38:16.271 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/133/11' 2023-10-25T23:38:16.271 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/133/16' 2023-10-25T23:38:16.271 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/133/14' 2023-10-25T23:38:16.272 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/133/18' 2023-10-25T23:38:16.272 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/133/13' 2023-10-25T23:38:16.272 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/133/17' 2023-10-25T23:38:16.272 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/133' 2023-10-25T23:38:16.272 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/173/19' 2023-10-25T23:38:16.273 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/173/15' 2023-10-25T23:38:16.273 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/173/20' 2023-10-25T23:38:16.273 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/173/12' 2023-10-25T23:38:16.273 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/173/10' 2023-10-25T23:38:16.273 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/173/11' 2023-10-25T23:38:16.501 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/173/16' 2023-10-25T23:38:16.501 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/173/14' 2023-10-25T23:38:16.501 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/173/18' 2023-10-25T23:38:16.501 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/173/13' 2023-10-25T23:38:16.502 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/173/17' 2023-10-25T23:38:16.502 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/173' 2023-10-25T23:38:16.502 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/174/19' 2023-10-25T23:38:16.502 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/174/15' 2023-10-25T23:38:16.503 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/174/20' 2023-10-25T23:38:16.503 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/174/12' 2023-10-25T23:38:16.503 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/174/10' 2023-10-25T23:38:16.503 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/174/11' 2023-10-25T23:38:16.503 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/174/16' 2023-10-25T23:38:16.504 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/174/14' 2023-10-25T23:38:16.504 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/174/18' 2023-10-25T23:38:16.504 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/174/13' 2023-10-25T23:38:16.504 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/174/17' 2023-10-25T23:38:16.504 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/174' 2023-10-25T23:38:16.504 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/155/19' 2023-10-25T23:38:16.505 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/155/15' 2023-10-25T23:38:16.505 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/155/20' 2023-10-25T23:38:16.505 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/155/12' 2023-10-25T23:38:16.505 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/155/10' 2023-10-25T23:38:16.505 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/155/11' 2023-10-25T23:38:16.506 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/155/16' 2023-10-25T23:38:16.506 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/155/14' 2023-10-25T23:38:16.506 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/155/18' 2023-10-25T23:38:16.507 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/155/13' 2023-10-25T23:38:16.507 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/155/17' 2023-10-25T23:38:16.507 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/155' 2023-10-25T23:38:16.507 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/114/19' 2023-10-25T23:38:16.507 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/114/15' 2023-10-25T23:38:16.508 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/114/20' 2023-10-25T23:38:16.508 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/114/12' 2023-10-25T23:38:16.508 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/114/10' 2023-10-25T23:38:16.508 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/114/11' 2023-10-25T23:38:16.508 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/114/16' 2023-10-25T23:38:16.509 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/114/14' 2023-10-25T23:38:16.509 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/114/18' 2023-10-25T23:38:16.509 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/114/13' 2023-10-25T23:38:16.509 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/114/17' 2023-10-25T23:38:16.509 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/114' 2023-10-25T23:38:16.510 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/159/19' 2023-10-25T23:38:16.510 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/159/15' 2023-10-25T23:38:16.510 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/159/20' 2023-10-25T23:38:16.510 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/159/12' 2023-10-25T23:38:16.511 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/159/10' 2023-10-25T23:38:16.511 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/159/11' 2023-10-25T23:38:16.511 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/159/16' 2023-10-25T23:38:16.511 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/159/14' 2023-10-25T23:38:16.511 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/159/18' 2023-10-25T23:38:16.512 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/159/13' 2023-10-25T23:38:16.512 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/159/17' 2023-10-25T23:38:16.512 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/159' 2023-10-25T23:38:16.512 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/187/19' 2023-10-25T23:38:16.512 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/187/15' 2023-10-25T23:38:16.513 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/187/20' 2023-10-25T23:38:16.513 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/187/12' 2023-10-25T23:38:16.513 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/187/10' 2023-10-25T23:38:16.513 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/187/11' 2023-10-25T23:38:16.513 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/187/16' 2023-10-25T23:38:16.514 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/187/14' 2023-10-25T23:38:16.514 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/187/18' 2023-10-25T23:38:16.514 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/187/13' 2023-10-25T23:38:16.514 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/187/17' 2023-10-25T23:38:16.514 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/187' 2023-10-25T23:38:16.515 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/185/19' 2023-10-25T23:38:16.515 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/185/15' 2023-10-25T23:38:16.515 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/185/20' 2023-10-25T23:38:16.515 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/185/12' 2023-10-25T23:38:16.515 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/185/10' 2023-10-25T23:38:16.515 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/185/11' 2023-10-25T23:38:16.516 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/185/16' 2023-10-25T23:38:16.516 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/185/14' 2023-10-25T23:38:16.516 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/185/18' 2023-10-25T23:38:16.516 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/185/13' 2023-10-25T23:38:16.516 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/185/17' 2023-10-25T23:38:16.517 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/185' 2023-10-25T23:38:16.517 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/120/19' 2023-10-25T23:38:16.517 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/120/15' 2023-10-25T23:38:16.517 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/120/20' 2023-10-25T23:38:16.517 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/120/12' 2023-10-25T23:38:16.518 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/120/10' 2023-10-25T23:38:16.518 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/120/11' 2023-10-25T23:38:16.518 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/120/16' 2023-10-25T23:38:16.518 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/120/14' 2023-10-25T23:38:16.518 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/120/18' 2023-10-25T23:38:16.519 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/120/13' 2023-10-25T23:38:16.519 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/120/17' 2023-10-25T23:38:16.519 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/120' 2023-10-25T23:38:16.519 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/110/19' 2023-10-25T23:38:16.520 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/110/15' 2023-10-25T23:38:16.520 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/110/20' 2023-10-25T23:38:16.520 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/110/12' 2023-10-25T23:38:16.520 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/110/10' 2023-10-25T23:38:16.520 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/110/11' 2023-10-25T23:38:16.521 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/110/16' 2023-10-25T23:38:16.521 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/110/14' 2023-10-25T23:38:16.521 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/110/18' 2023-10-25T23:38:16.521 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/110/13' 2023-10-25T23:38:16.521 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/110/17' 2023-10-25T23:38:16.522 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/110' 2023-10-25T23:38:16.522 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/137/19' 2023-10-25T23:38:16.522 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/137/15' 2023-10-25T23:38:16.522 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/137/20' 2023-10-25T23:38:16.522 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/137/12' 2023-10-25T23:38:16.523 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/137/10' 2023-10-25T23:38:16.523 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/137/11' 2023-10-25T23:38:16.523 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/137/16' 2023-10-25T23:38:16.951 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/137/14' 2023-10-25T23:38:16.952 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/137/18' 2023-10-25T23:38:16.952 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/137/13' 2023-10-25T23:38:16.952 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/137/17' 2023-10-25T23:38:16.952 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/137' 2023-10-25T23:38:16.952 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/198/19' 2023-10-25T23:38:16.953 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/198/15' 2023-10-25T23:38:16.953 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/198/20' 2023-10-25T23:38:16.953 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/198/12' 2023-10-25T23:38:16.953 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/198/10' 2023-10-25T23:38:16.953 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/198/11' 2023-10-25T23:38:16.954 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/198/16' 2023-10-25T23:38:16.954 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/198/14' 2023-10-25T23:38:16.954 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/198/18' 2023-10-25T23:38:16.954 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/198/13' 2023-10-25T23:38:16.954 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/198/17' 2023-10-25T23:38:16.955 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/198' 2023-10-25T23:38:16.955 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/136/19' 2023-10-25T23:38:16.955 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/136/15' 2023-10-25T23:38:16.956 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/136/20' 2023-10-25T23:38:16.956 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/136/12' 2023-10-25T23:38:16.957 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/136/10' 2023-10-25T23:38:16.957 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/136/11' 2023-10-25T23:38:16.958 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/136/16' 2023-10-25T23:38:16.958 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/136/14' 2023-10-25T23:38:16.958 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/136/18' 2023-10-25T23:38:16.959 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/136/13' 2023-10-25T23:38:16.959 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/136/17' 2023-10-25T23:38:16.959 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/136' 2023-10-25T23:38:16.960 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/125/19' 2023-10-25T23:38:16.960 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/125/15' 2023-10-25T23:38:16.960 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/125/20' 2023-10-25T23:38:16.960 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/125/12' 2023-10-25T23:38:16.960 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/125/10' 2023-10-25T23:38:16.961 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/125/11' 2023-10-25T23:38:16.961 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/125/16' 2023-10-25T23:38:16.961 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/125/14' 2023-10-25T23:38:16.961 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/125/18' 2023-10-25T23:38:16.961 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/125/13' 2023-10-25T23:38:16.962 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/125/17' 2023-10-25T23:38:16.962 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/125' 2023-10-25T23:38:16.962 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/194/19' 2023-10-25T23:38:16.962 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/194/15' 2023-10-25T23:38:16.962 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/194/20' 2023-10-25T23:38:16.963 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/194/12' 2023-10-25T23:38:16.963 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/194/10' 2023-10-25T23:38:16.963 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/194/11' 2023-10-25T23:38:16.963 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/194/16' 2023-10-25T23:38:16.963 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/194/14' 2023-10-25T23:38:16.964 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/194/18' 2023-10-25T23:38:16.964 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/194/13' 2023-10-25T23:38:16.964 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/194/17' 2023-10-25T23:38:16.965 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/194' 2023-10-25T23:38:16.965 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/119/19' 2023-10-25T23:38:16.965 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/119/15' 2023-10-25T23:38:16.966 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/119/20' 2023-10-25T23:38:16.966 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/119/12' 2023-10-25T23:38:16.966 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/119/10' 2023-10-25T23:38:16.967 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/119/11' 2023-10-25T23:38:16.967 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/119/16' 2023-10-25T23:38:16.967 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/119/14' 2023-10-25T23:38:16.968 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/119/18' 2023-10-25T23:38:16.968 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/119/13' 2023-10-25T23:38:16.968 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/119/17' 2023-10-25T23:38:16.969 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/119' 2023-10-25T23:38:16.969 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/157/19' 2023-10-25T23:38:16.970 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/157/15' 2023-10-25T23:38:16.970 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/157/20' 2023-10-25T23:38:16.970 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/157/12' 2023-10-25T23:38:16.971 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/157/10' 2023-10-25T23:38:16.971 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/157/11' 2023-10-25T23:38:16.971 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/157/16' 2023-10-25T23:38:16.972 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/157/14' 2023-10-25T23:38:16.972 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/157/18' 2023-10-25T23:38:16.972 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/157/13' 2023-10-25T23:38:16.972 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/157/17' 2023-10-25T23:38:16.972 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/157' 2023-10-25T23:38:16.973 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/172/19' 2023-10-25T23:38:16.973 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/172/15' 2023-10-25T23:38:16.973 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/172/20' 2023-10-25T23:38:16.973 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/172/12' 2023-10-25T23:38:16.973 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/172/10' 2023-10-25T23:38:16.973 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/172/11' 2023-10-25T23:38:16.974 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/172/16' 2023-10-25T23:38:16.974 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/172/14' 2023-10-25T23:38:16.974 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/172/18' 2023-10-25T23:38:16.974 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/172/13' 2023-10-25T23:38:16.974 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/172/17' 2023-10-25T23:38:16.975 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/172' 2023-10-25T23:38:16.975 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/186/19' 2023-10-25T23:38:16.975 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/186/15' 2023-10-25T23:38:16.975 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/186/20' 2023-10-25T23:38:16.975 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/186/12' 2023-10-25T23:38:16.976 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/186/10' 2023-10-25T23:38:16.976 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/186/11' 2023-10-25T23:38:16.976 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/186/16' 2023-10-25T23:38:16.976 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/186/14' 2023-10-25T23:38:16.977 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/186/18' 2023-10-25T23:38:16.977 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/186/13' 2023-10-25T23:38:16.977 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/186/17' 2023-10-25T23:38:16.977 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/186' 2023-10-25T23:38:16.978 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/190/19' 2023-10-25T23:38:16.978 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/190/15' 2023-10-25T23:38:16.978 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/190/20' 2023-10-25T23:38:16.979 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/190/12' 2023-10-25T23:38:16.979 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/190/10' 2023-10-25T23:38:16.979 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/190/11' 2023-10-25T23:38:16.980 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/190/16' 2023-10-25T23:38:16.980 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/190/14' 2023-10-25T23:38:17.193 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/190/18' 2023-10-25T23:38:17.194 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/190/13' 2023-10-25T23:38:17.194 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/190/17' 2023-10-25T23:38:17.194 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/190' 2023-10-25T23:38:17.194 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/104/19' 2023-10-25T23:38:17.195 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/104/15' 2023-10-25T23:38:17.195 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/104/20' 2023-10-25T23:38:17.195 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/104/12' 2023-10-25T23:38:17.195 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/104/10' 2023-10-25T23:38:17.195 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/104/11' 2023-10-25T23:38:17.196 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/104/16' 2023-10-25T23:38:17.196 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/104/14' 2023-10-25T23:38:17.196 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/104/18' 2023-10-25T23:38:17.196 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/104/13' 2023-10-25T23:38:17.196 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/104/17' 2023-10-25T23:38:17.197 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/104' 2023-10-25T23:38:17.197 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/164/19' 2023-10-25T23:38:17.197 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/164/15' 2023-10-25T23:38:17.197 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/164/20' 2023-10-25T23:38:17.197 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/164/12' 2023-10-25T23:38:17.197 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/164/10' 2023-10-25T23:38:17.198 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/164/11' 2023-10-25T23:38:17.198 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/164/16' 2023-10-25T23:38:17.198 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/164/14' 2023-10-25T23:38:17.198 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/164/18' 2023-10-25T23:38:17.198 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/164/13' 2023-10-25T23:38:17.199 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/164/17' 2023-10-25T23:38:17.199 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/164' 2023-10-25T23:38:17.199 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/112/19' 2023-10-25T23:38:17.199 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/112/15' 2023-10-25T23:38:17.199 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/112/20' 2023-10-25T23:38:17.200 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/112/12' 2023-10-25T23:38:17.200 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/112/10' 2023-10-25T23:38:17.200 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/112/11' 2023-10-25T23:38:17.201 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/112/16' 2023-10-25T23:38:17.201 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/112/14' 2023-10-25T23:38:17.201 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/112/18' 2023-10-25T23:38:17.201 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/112/13' 2023-10-25T23:38:17.201 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/112/17' 2023-10-25T23:38:17.202 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/112' 2023-10-25T23:38:17.202 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/100/19' 2023-10-25T23:38:17.202 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/100/15' 2023-10-25T23:38:17.202 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/100/20' 2023-10-25T23:38:17.203 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/100/12' 2023-10-25T23:38:17.203 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/100/10' 2023-10-25T23:38:17.203 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/100/11' 2023-10-25T23:38:17.203 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/100/16' 2023-10-25T23:38:17.203 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/100/14' 2023-10-25T23:38:17.203 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/100/18' 2023-10-25T23:38:17.204 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/100/13' 2023-10-25T23:38:17.204 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/100/17' 2023-10-25T23:38:17.204 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/100' 2023-10-25T23:38:17.204 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/134/19' 2023-10-25T23:38:17.204 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/134/15' 2023-10-25T23:38:17.205 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/134/20' 2023-10-25T23:38:17.205 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/134/12' 2023-10-25T23:38:17.205 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/134/10' 2023-10-25T23:38:17.205 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/134/11' 2023-10-25T23:38:17.205 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/134/16' 2023-10-25T23:38:17.206 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/134/14' 2023-10-25T23:38:17.206 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/134/18' 2023-10-25T23:38:17.206 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/134/13' 2023-10-25T23:38:17.206 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/134/17' 2023-10-25T23:38:17.206 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/134' 2023-10-25T23:38:17.207 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/115/19' 2023-10-25T23:38:17.207 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/115/15' 2023-10-25T23:38:17.207 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/115/20' 2023-10-25T23:38:17.207 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/115/12' 2023-10-25T23:38:17.207 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/115/10' 2023-10-25T23:38:17.208 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/115/11' 2023-10-25T23:38:17.208 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/115/16' 2023-10-25T23:38:17.208 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/115/14' 2023-10-25T23:38:17.208 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/115/18' 2023-10-25T23:38:17.208 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/115/13' 2023-10-25T23:38:17.209 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/115/17' 2023-10-25T23:38:17.209 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/115' 2023-10-25T23:38:17.209 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/116/19' 2023-10-25T23:38:17.209 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/116/15' 2023-10-25T23:38:17.209 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/116/20' 2023-10-25T23:38:17.210 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/116/12' 2023-10-25T23:38:17.210 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/116/10' 2023-10-25T23:38:17.210 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/116/11' 2023-10-25T23:38:17.210 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/116/16' 2023-10-25T23:38:17.210 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/116/14' 2023-10-25T23:38:17.211 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/116/18' 2023-10-25T23:38:17.211 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/116/13' 2023-10-25T23:38:17.211 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/116/17' 2023-10-25T23:38:17.211 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/116' 2023-10-25T23:38:17.211 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/195/19' 2023-10-25T23:38:17.212 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/195/15' 2023-10-25T23:38:17.212 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/195/20' 2023-10-25T23:38:17.212 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/195/12' 2023-10-25T23:38:17.212 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/195/10' 2023-10-25T23:38:17.212 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/195/11' 2023-10-25T23:38:17.212 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/195/16' 2023-10-25T23:38:17.213 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/195/14' 2023-10-25T23:38:17.213 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/195/18' 2023-10-25T23:38:17.213 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/195/13' 2023-10-25T23:38:17.213 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/195/17' 2023-10-25T23:38:17.213 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/195' 2023-10-25T23:38:17.214 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/138/19' 2023-10-25T23:38:17.214 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/138/15' 2023-10-25T23:38:17.214 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/138/20' 2023-10-25T23:38:17.214 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/138/12' 2023-10-25T23:38:17.215 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/138/10' 2023-10-25T23:38:17.215 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/138/11' 2023-10-25T23:38:17.215 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/138/16' 2023-10-25T23:38:17.216 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/138/14' 2023-10-25T23:38:17.216 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/138/18' 2023-10-25T23:38:17.428 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/138/13' 2023-10-25T23:38:17.429 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/138/17' 2023-10-25T23:38:17.429 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/138' 2023-10-25T23:38:17.429 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/135/19' 2023-10-25T23:38:17.429 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/135/15' 2023-10-25T23:38:17.429 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/135/20' 2023-10-25T23:38:17.430 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/135/12' 2023-10-25T23:38:17.430 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/135/10' 2023-10-25T23:38:17.430 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/135/11' 2023-10-25T23:38:17.430 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/135/16' 2023-10-25T23:38:17.430 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/135/14' 2023-10-25T23:38:17.431 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/135/18' 2023-10-25T23:38:17.431 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/135/13' 2023-10-25T23:38:17.431 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/135/17' 2023-10-25T23:38:17.431 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/135' 2023-10-25T23:38:17.431 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/117/19' 2023-10-25T23:38:17.432 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/117/15' 2023-10-25T23:38:17.432 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/117/20' 2023-10-25T23:38:17.432 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/117/12' 2023-10-25T23:38:17.432 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/117/10' 2023-10-25T23:38:17.432 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/117/11' 2023-10-25T23:38:17.433 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/117/16' 2023-10-25T23:38:17.433 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/117/14' 2023-10-25T23:38:17.433 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/117/18' 2023-10-25T23:38:17.433 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/117/13' 2023-10-25T23:38:17.433 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/117/17' 2023-10-25T23:38:17.433 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/117' 2023-10-25T23:38:17.434 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/143/19' 2023-10-25T23:38:17.434 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/143/15' 2023-10-25T23:38:17.434 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/143/20' 2023-10-25T23:38:17.434 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/143/12' 2023-10-25T23:38:17.434 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/143/10' 2023-10-25T23:38:17.435 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/143/11' 2023-10-25T23:38:17.435 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/143/16' 2023-10-25T23:38:17.435 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/143/14' 2023-10-25T23:38:17.435 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/143/18' 2023-10-25T23:38:17.435 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/143/13' 2023-10-25T23:38:17.436 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/143/17' 2023-10-25T23:38:17.436 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/143' 2023-10-25T23:38:17.436 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/180/19' 2023-10-25T23:38:17.436 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/180/15' 2023-10-25T23:38:17.436 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/180/20' 2023-10-25T23:38:17.436 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/180/12' 2023-10-25T23:38:17.437 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/180/10' 2023-10-25T23:38:17.437 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/180/11' 2023-10-25T23:38:17.437 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/180/16' 2023-10-25T23:38:17.437 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/180/14' 2023-10-25T23:38:17.437 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/180/18' 2023-10-25T23:38:17.438 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/180/13' 2023-10-25T23:38:17.438 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/180/17' 2023-10-25T23:38:17.438 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/180' 2023-10-25T23:38:17.438 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/126/19' 2023-10-25T23:38:17.438 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/126/15' 2023-10-25T23:38:17.438 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/126/20' 2023-10-25T23:38:17.439 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/126/12' 2023-10-25T23:38:17.439 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/126/10' 2023-10-25T23:38:17.439 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/126/11' 2023-10-25T23:38:17.439 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/126/16' 2023-10-25T23:38:17.439 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/126/14' 2023-10-25T23:38:17.440 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/126/18' 2023-10-25T23:38:17.440 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/126/13' 2023-10-25T23:38:17.440 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/126/17' 2023-10-25T23:38:17.440 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/126' 2023-10-25T23:38:17.440 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/161/19' 2023-10-25T23:38:17.440 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/161/15' 2023-10-25T23:38:17.441 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/161/20' 2023-10-25T23:38:17.441 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/161/12' 2023-10-25T23:38:17.441 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/161/10' 2023-10-25T23:38:17.441 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/161/11' 2023-10-25T23:38:17.441 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/161/16' 2023-10-25T23:38:17.442 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/161/14' 2023-10-25T23:38:17.442 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/161/18' 2023-10-25T23:38:17.442 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/161/13' 2023-10-25T23:38:17.442 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/161/17' 2023-10-25T23:38:17.442 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/161' 2023-10-25T23:38:17.442 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/176/19' 2023-10-25T23:38:17.443 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/176/15' 2023-10-25T23:38:17.443 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/176/20' 2023-10-25T23:38:17.443 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/176/12' 2023-10-25T23:38:17.443 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/176/10' 2023-10-25T23:38:17.443 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/176/11' 2023-10-25T23:38:17.444 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/176/16' 2023-10-25T23:38:17.444 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/176/14' 2023-10-25T23:38:17.444 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/176/18' 2023-10-25T23:38:17.444 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/176/13' 2023-10-25T23:38:17.444 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/176/17' 2023-10-25T23:38:17.444 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/176' 2023-10-25T23:38:17.445 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/111/19' 2023-10-25T23:38:17.445 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/111/15' 2023-10-25T23:38:17.445 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/111/20' 2023-10-25T23:38:17.446 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/111/12' 2023-10-25T23:38:17.447 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/111/10' 2023-10-25T23:38:17.447 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/111/11' 2023-10-25T23:38:17.447 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/111/16' 2023-10-25T23:38:17.447 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/111/14' 2023-10-25T23:38:17.448 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/111/18' 2023-10-25T23:38:17.448 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/111/13' 2023-10-25T23:38:17.448 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/111/17' 2023-10-25T23:38:17.448 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/111' 2023-10-25T23:38:17.448 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/191/19' 2023-10-25T23:38:17.449 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/191/15' 2023-10-25T23:38:17.449 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/191/20' 2023-10-25T23:38:17.449 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/191/12' 2023-10-25T23:38:17.449 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/191/10' 2023-10-25T23:38:17.450 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/191/11' 2023-10-25T23:38:17.451 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/191/16' 2023-10-25T23:38:17.451 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/191/14' 2023-10-25T23:38:17.451 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/191/18' 2023-10-25T23:38:17.451 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/191/13' 2023-10-25T23:38:17.708 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/191/17' 2023-10-25T23:38:17.708 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/191' 2023-10-25T23:38:17.709 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/184/19' 2023-10-25T23:38:17.709 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/184/15' 2023-10-25T23:38:17.709 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/184/20' 2023-10-25T23:38:17.709 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/184/12' 2023-10-25T23:38:17.709 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/184/10' 2023-10-25T23:38:17.710 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/184/11' 2023-10-25T23:38:17.710 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/184/16' 2023-10-25T23:38:17.710 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/184/14' 2023-10-25T23:38:17.710 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/184/18' 2023-10-25T23:38:17.710 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/184/13' 2023-10-25T23:38:17.711 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/184/17' 2023-10-25T23:38:17.711 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/184' 2023-10-25T23:38:17.711 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/192/19' 2023-10-25T23:38:17.711 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/192/15' 2023-10-25T23:38:17.711 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/192/20' 2023-10-25T23:38:17.711 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/192/12' 2023-10-25T23:38:17.712 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/192/10' 2023-10-25T23:38:17.712 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/192/11' 2023-10-25T23:38:17.712 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/192/16' 2023-10-25T23:38:17.712 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/192/14' 2023-10-25T23:38:17.712 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/192/18' 2023-10-25T23:38:17.713 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/192/13' 2023-10-25T23:38:17.713 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/192/17' 2023-10-25T23:38:17.713 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/192' 2023-10-25T23:38:17.713 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/103/19' 2023-10-25T23:38:17.713 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/103/15' 2023-10-25T23:38:17.713 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/103/20' 2023-10-25T23:38:17.714 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/103/12' 2023-10-25T23:38:17.714 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/103/10' 2023-10-25T23:38:17.714 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/103/11' 2023-10-25T23:38:17.718 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/103/16' 2023-10-25T23:38:17.718 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/103/14' 2023-10-25T23:38:17.718 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/103/18' 2023-10-25T23:38:17.718 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/103/13' 2023-10-25T23:38:17.719 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/103/17' 2023-10-25T23:38:17.719 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/103' 2023-10-25T23:38:17.719 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/128/19' 2023-10-25T23:38:17.719 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/128/15' 2023-10-25T23:38:17.719 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/128/20' 2023-10-25T23:38:17.720 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/128/12' 2023-10-25T23:38:17.720 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/128/10' 2023-10-25T23:38:17.720 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/128/11' 2023-10-25T23:38:17.720 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/128/16' 2023-10-25T23:38:17.720 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/128/14' 2023-10-25T23:38:17.720 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/128/18' 2023-10-25T23:38:17.721 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/128/13' 2023-10-25T23:38:17.721 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/128/17' 2023-10-25T23:38:17.721 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/128' 2023-10-25T23:38:17.721 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/144/19' 2023-10-25T23:38:17.721 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/144/15' 2023-10-25T23:38:17.722 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/144/20' 2023-10-25T23:38:17.722 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/144/12' 2023-10-25T23:38:17.722 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/144/10' 2023-10-25T23:38:17.722 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/144/11' 2023-10-25T23:38:17.723 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/144/16' 2023-10-25T23:38:17.723 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/144/14' 2023-10-25T23:38:17.723 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/144/18' 2023-10-25T23:38:17.724 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/144/13' 2023-10-25T23:38:17.724 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/144/17' 2023-10-25T23:38:17.725 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/144' 2023-10-25T23:38:17.725 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/146/19' 2023-10-25T23:38:17.725 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/146/15' 2023-10-25T23:38:17.725 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/146/20' 2023-10-25T23:38:17.725 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/146/12' 2023-10-25T23:38:17.726 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/146/10' 2023-10-25T23:38:17.726 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/146/11' 2023-10-25T23:38:17.726 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/146/16' 2023-10-25T23:38:17.726 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/146/14' 2023-10-25T23:38:17.726 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/146/18' 2023-10-25T23:38:17.727 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/146/13' 2023-10-25T23:38:17.727 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/146/17' 2023-10-25T23:38:17.727 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/146' 2023-10-25T23:38:17.727 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/141/19' 2023-10-25T23:38:17.727 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/141/15' 2023-10-25T23:38:17.728 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/141/20' 2023-10-25T23:38:17.728 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/141/12' 2023-10-25T23:38:17.728 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/141/10' 2023-10-25T23:38:17.728 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/141/11' 2023-10-25T23:38:17.728 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/141/16' 2023-10-25T23:38:17.729 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/141/14' 2023-10-25T23:38:17.729 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/141/18' 2023-10-25T23:38:17.729 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/141/13' 2023-10-25T23:38:17.729 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/141/17' 2023-10-25T23:38:17.729 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/141' 2023-10-25T23:38:17.729 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/182/19' 2023-10-25T23:38:17.730 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/182/15' 2023-10-25T23:38:17.730 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/182/20' 2023-10-25T23:38:17.730 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/182/12' 2023-10-25T23:38:17.730 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/182/10' 2023-10-25T23:38:17.730 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/182/11' 2023-10-25T23:38:17.731 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/182/16' 2023-10-25T23:38:17.731 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/182/14' 2023-10-25T23:38:17.731 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/182/18' 2023-10-25T23:38:17.731 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/182/13' 2023-10-25T23:38:17.731 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/182/17' 2023-10-25T23:38:17.732 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/182' 2023-10-25T23:38:17.732 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/107/19' 2023-10-25T23:38:17.732 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/107/15' 2023-10-25T23:38:17.732 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/107/20' 2023-10-25T23:38:17.732 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/107/12' 2023-10-25T23:38:17.733 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/107/10' 2023-10-25T23:38:17.733 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/107/11' 2023-10-25T23:38:17.733 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/107/16' 2023-10-25T23:38:17.733 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/107/14' 2023-10-25T23:38:17.733 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/107/18' 2023-10-25T23:38:17.734 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/107/13' 2023-10-25T23:38:17.734 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/107/17' 2023-10-25T23:38:17.929 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/107' 2023-10-25T23:38:17.929 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/178/19' 2023-10-25T23:38:17.930 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/178/15' 2023-10-25T23:38:17.930 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/178/20' 2023-10-25T23:38:17.930 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/178/12' 2023-10-25T23:38:17.930 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/178/10' 2023-10-25T23:38:17.930 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/178/11' 2023-10-25T23:38:17.931 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/178/16' 2023-10-25T23:38:17.931 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/178/14' 2023-10-25T23:38:17.931 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/178/18' 2023-10-25T23:38:17.931 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/178/13' 2023-10-25T23:38:17.931 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/178/17' 2023-10-25T23:38:17.932 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/178' 2023-10-25T23:38:17.932 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/156/19' 2023-10-25T23:38:17.932 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/156/15' 2023-10-25T23:38:17.932 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/156/20' 2023-10-25T23:38:17.932 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/156/12' 2023-10-25T23:38:17.933 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/156/10' 2023-10-25T23:38:17.933 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/156/11' 2023-10-25T23:38:17.933 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/156/16' 2023-10-25T23:38:17.933 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/156/14' 2023-10-25T23:38:17.933 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/156/18' 2023-10-25T23:38:17.933 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/156/13' 2023-10-25T23:38:17.934 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/156/17' 2023-10-25T23:38:17.934 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/156' 2023-10-25T23:38:17.934 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/131/19' 2023-10-25T23:38:17.934 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/131/15' 2023-10-25T23:38:17.934 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/131/20' 2023-10-25T23:38:17.935 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/131/12' 2023-10-25T23:38:17.935 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/131/10' 2023-10-25T23:38:17.935 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/131/11' 2023-10-25T23:38:17.935 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/131/16' 2023-10-25T23:38:17.935 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/131/14' 2023-10-25T23:38:17.936 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/131/18' 2023-10-25T23:38:17.936 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/131/13' 2023-10-25T23:38:17.936 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/131/17' 2023-10-25T23:38:17.936 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/131' 2023-10-25T23:38:17.936 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/123/19' 2023-10-25T23:38:17.936 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/123/15' 2023-10-25T23:38:17.937 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/123/20' 2023-10-25T23:38:17.937 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/123/12' 2023-10-25T23:38:17.937 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/123/10' 2023-10-25T23:38:17.937 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/123/11' 2023-10-25T23:38:17.938 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/123/16' 2023-10-25T23:38:17.938 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/123/14' 2023-10-25T23:38:17.938 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/123/18' 2023-10-25T23:38:17.939 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/123/13' 2023-10-25T23:38:17.939 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/123/17' 2023-10-25T23:38:17.939 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/123' 2023-10-25T23:38:17.939 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/160/19' 2023-10-25T23:38:17.939 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/160/15' 2023-10-25T23:38:17.940 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/160/20' 2023-10-25T23:38:17.940 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/160/12' 2023-10-25T23:38:17.940 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/160/10' 2023-10-25T23:38:17.940 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/160/11' 2023-10-25T23:38:17.940 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/160/16' 2023-10-25T23:38:17.941 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/160/14' 2023-10-25T23:38:17.941 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/160/18' 2023-10-25T23:38:17.941 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/160/13' 2023-10-25T23:38:17.941 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/160/17' 2023-10-25T23:38:17.941 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/160' 2023-10-25T23:38:17.941 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/165/19' 2023-10-25T23:38:17.942 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/165/15' 2023-10-25T23:38:17.942 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/165/20' 2023-10-25T23:38:17.942 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/165/12' 2023-10-25T23:38:17.942 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/165/10' 2023-10-25T23:38:17.943 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/165/11' 2023-10-25T23:38:17.943 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/165/16' 2023-10-25T23:38:17.943 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/165/14' 2023-10-25T23:38:17.943 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/165/18' 2023-10-25T23:38:17.943 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/165/13' 2023-10-25T23:38:17.943 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/165/17' 2023-10-25T23:38:17.944 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/165' 2023-10-25T23:38:17.944 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/101/19' 2023-10-25T23:38:17.944 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/101/15' 2023-10-25T23:38:17.944 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/101/20' 2023-10-25T23:38:17.944 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/101/12' 2023-10-25T23:38:17.945 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/101/10' 2023-10-25T23:38:17.945 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/101/11' 2023-10-25T23:38:17.945 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/101/16' 2023-10-25T23:38:17.945 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/101/14' 2023-10-25T23:38:17.945 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/101/18' 2023-10-25T23:38:17.946 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/101/13' 2023-10-25T23:38:17.946 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/101/17' 2023-10-25T23:38:17.946 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/101' 2023-10-25T23:38:17.946 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/148/19' 2023-10-25T23:38:17.946 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/148/15' 2023-10-25T23:38:17.947 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/148/20' 2023-10-25T23:38:17.947 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/148/12' 2023-10-25T23:38:17.947 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/148/10' 2023-10-25T23:38:17.947 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/148/11' 2023-10-25T23:38:17.947 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/148/16' 2023-10-25T23:38:17.948 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/148/14' 2023-10-25T23:38:17.948 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/148/18' 2023-10-25T23:38:17.948 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/148/13' 2023-10-25T23:38:17.948 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/148/17' 2023-10-25T23:38:17.948 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/148' 2023-10-25T23:38:17.948 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/168/19' 2023-10-25T23:38:17.949 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/168/15' 2023-10-25T23:38:17.949 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/168/20' 2023-10-25T23:38:17.949 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/168/12' 2023-10-25T23:38:17.949 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/168/10' 2023-10-25T23:38:17.949 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/168/11' 2023-10-25T23:38:17.950 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/168/16' 2023-10-25T23:38:17.950 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/168/14' 2023-10-25T23:38:17.950 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/168/18' 2023-10-25T23:38:17.950 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/168/13' 2023-10-25T23:38:17.950 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/168/17' 2023-10-25T23:38:17.951 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/168' 2023-10-25T23:38:18.142 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/179/19' 2023-10-25T23:38:18.143 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/179/15' 2023-10-25T23:38:18.143 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/179/20' 2023-10-25T23:38:18.143 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/179/12' 2023-10-25T23:38:18.143 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/179/10' 2023-10-25T23:38:18.144 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/179/11' 2023-10-25T23:38:18.144 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/179/16' 2023-10-25T23:38:18.144 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/179/14' 2023-10-25T23:38:18.144 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/179/18' 2023-10-25T23:38:18.144 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/179/13' 2023-10-25T23:38:18.144 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/179/17' 2023-10-25T23:38:18.145 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/179' 2023-10-25T23:38:18.145 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/132/19' 2023-10-25T23:38:18.145 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/132/15' 2023-10-25T23:38:18.145 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/132/20' 2023-10-25T23:38:18.145 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/132/12' 2023-10-25T23:38:18.146 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/132/10' 2023-10-25T23:38:18.146 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/132/11' 2023-10-25T23:38:18.146 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/132/16' 2023-10-25T23:38:18.146 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/132/14' 2023-10-25T23:38:18.146 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/132/18' 2023-10-25T23:38:18.147 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/132/13' 2023-10-25T23:38:18.147 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/132/17' 2023-10-25T23:38:18.147 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/132' 2023-10-25T23:38:18.147 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/199/19' 2023-10-25T23:38:18.147 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/199/15' 2023-10-25T23:38:18.147 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/199/20' 2023-10-25T23:38:18.148 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/199/12' 2023-10-25T23:38:18.148 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/199/10' 2023-10-25T23:38:18.148 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/199/11' 2023-10-25T23:38:18.148 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/199/16' 2023-10-25T23:38:18.148 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/199/14' 2023-10-25T23:38:18.148 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/199/18' 2023-10-25T23:38:18.149 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/199/13' 2023-10-25T23:38:18.149 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/199/17' 2023-10-25T23:38:18.149 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/199' 2023-10-25T23:38:18.149 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/163/19' 2023-10-25T23:38:18.149 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/163/15' 2023-10-25T23:38:18.150 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/163/20' 2023-10-25T23:38:18.150 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/163/12' 2023-10-25T23:38:18.150 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/163/10' 2023-10-25T23:38:18.150 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/163/11' 2023-10-25T23:38:18.150 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/163/16' 2023-10-25T23:38:18.150 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/163/14' 2023-10-25T23:38:18.151 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/163/18' 2023-10-25T23:38:18.151 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/163/13' 2023-10-25T23:38:18.151 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/163/17' 2023-10-25T23:38:18.151 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/163' 2023-10-25T23:38:18.151 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/153/19' 2023-10-25T23:38:18.152 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/153/15' 2023-10-25T23:38:18.152 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/153/20' 2023-10-25T23:38:18.152 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/153/12' 2023-10-25T23:38:18.152 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/153/10' 2023-10-25T23:38:18.152 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/153/11' 2023-10-25T23:38:18.152 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/153/16' 2023-10-25T23:38:18.153 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/153/14' 2023-10-25T23:38:18.153 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/153/18' 2023-10-25T23:38:18.153 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/153/13' 2023-10-25T23:38:18.153 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/153/17' 2023-10-25T23:38:18.153 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/153' 2023-10-25T23:38:18.153 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/122/19' 2023-10-25T23:38:18.154 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/122/15' 2023-10-25T23:38:18.154 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/122/20' 2023-10-25T23:38:18.154 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/122/12' 2023-10-25T23:38:18.154 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/122/10' 2023-10-25T23:38:18.154 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/122/11' 2023-10-25T23:38:18.155 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/122/16' 2023-10-25T23:38:18.155 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/122/14' 2023-10-25T23:38:18.155 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/122/18' 2023-10-25T23:38:18.155 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/122/13' 2023-10-25T23:38:18.155 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/122/17' 2023-10-25T23:38:18.156 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/122' 2023-10-25T23:38:18.156 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/162/19' 2023-10-25T23:38:18.156 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/162/15' 2023-10-25T23:38:18.156 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/162/20' 2023-10-25T23:38:18.156 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/162/12' 2023-10-25T23:38:18.156 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/162/10' 2023-10-25T23:38:18.157 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/162/11' 2023-10-25T23:38:18.157 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/162/16' 2023-10-25T23:38:18.157 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/162/14' 2023-10-25T23:38:18.157 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/162/18' 2023-10-25T23:38:18.157 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/162/13' 2023-10-25T23:38:18.157 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/162/17' 2023-10-25T23:38:18.158 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/162' 2023-10-25T23:38:18.158 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/197/19' 2023-10-25T23:38:18.158 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/197/15' 2023-10-25T23:38:18.158 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/197/20' 2023-10-25T23:38:18.158 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/197/12' 2023-10-25T23:38:18.159 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/197/10' 2023-10-25T23:38:18.159 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/197/11' 2023-10-25T23:38:18.159 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/197/16' 2023-10-25T23:38:18.159 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/197/14' 2023-10-25T23:38:18.159 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/197/18' 2023-10-25T23:38:18.159 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/197/13' 2023-10-25T23:38:18.160 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/197/17' 2023-10-25T23:38:18.160 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/197' 2023-10-25T23:38:18.160 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/113/19' 2023-10-25T23:38:18.160 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/113/15' 2023-10-25T23:38:18.160 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/113/20' 2023-10-25T23:38:18.161 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/113/12' 2023-10-25T23:38:18.161 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/113/10' 2023-10-25T23:38:18.161 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/113/11' 2023-10-25T23:38:18.161 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/113/16' 2023-10-25T23:38:18.161 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/113/14' 2023-10-25T23:38:18.161 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/113/18' 2023-10-25T23:38:18.162 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/113/13' 2023-10-25T23:38:18.162 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/113/17' 2023-10-25T23:38:18.162 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/113' 2023-10-25T23:38:18.162 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/152/19' 2023-10-25T23:38:18.354 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/152/15' 2023-10-25T23:38:18.354 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/152/20' 2023-10-25T23:38:18.354 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/152/12' 2023-10-25T23:38:18.354 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/152/10' 2023-10-25T23:38:18.355 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/152/11' 2023-10-25T23:38:18.355 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/152/16' 2023-10-25T23:38:18.355 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/152/14' 2023-10-25T23:38:18.355 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/152/18' 2023-10-25T23:38:18.356 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/152/13' 2023-10-25T23:38:18.356 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/152/17' 2023-10-25T23:38:18.356 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/152' 2023-10-25T23:38:18.356 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/121/19' 2023-10-25T23:38:18.356 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/121/15' 2023-10-25T23:38:18.356 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/121/20' 2023-10-25T23:38:18.357 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/121/12' 2023-10-25T23:38:18.357 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/121/10' 2023-10-25T23:38:18.357 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/121/11' 2023-10-25T23:38:18.357 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/121/16' 2023-10-25T23:38:18.357 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/121/14' 2023-10-25T23:38:18.358 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/121/18' 2023-10-25T23:38:18.358 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/121/13' 2023-10-25T23:38:18.358 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/121/17' 2023-10-25T23:38:18.358 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/121' 2023-10-25T23:38:18.358 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/118/19' 2023-10-25T23:38:18.359 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/118/15' 2023-10-25T23:38:18.359 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/118/20' 2023-10-25T23:38:18.359 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/118/12' 2023-10-25T23:38:18.359 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/118/10' 2023-10-25T23:38:18.359 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/118/11' 2023-10-25T23:38:18.360 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/118/16' 2023-10-25T23:38:18.360 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/118/14' 2023-10-25T23:38:18.360 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/118/18' 2023-10-25T23:38:18.360 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/118/13' 2023-10-25T23:38:18.360 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/118/17' 2023-10-25T23:38:18.361 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/118' 2023-10-25T23:38:18.361 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/196/19' 2023-10-25T23:38:18.361 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/196/15' 2023-10-25T23:38:18.361 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/196/20' 2023-10-25T23:38:18.361 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/196/12' 2023-10-25T23:38:18.362 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/196/10' 2023-10-25T23:38:18.362 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/196/11' 2023-10-25T23:38:18.362 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/196/16' 2023-10-25T23:38:18.362 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/196/14' 2023-10-25T23:38:18.362 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/196/18' 2023-10-25T23:38:18.363 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/196/13' 2023-10-25T23:38:18.363 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/196/17' 2023-10-25T23:38:18.363 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/196' 2023-10-25T23:38:18.363 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/124/19' 2023-10-25T23:38:18.363 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/124/15' 2023-10-25T23:38:18.363 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/124/20' 2023-10-25T23:38:18.364 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/124/12' 2023-10-25T23:38:18.364 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/124/10' 2023-10-25T23:38:18.364 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/124/11' 2023-10-25T23:38:18.364 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/124/16' 2023-10-25T23:38:18.364 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/124/14' 2023-10-25T23:38:18.365 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/124/18' 2023-10-25T23:38:18.365 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/124/13' 2023-10-25T23:38:18.365 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/124/17' 2023-10-25T23:38:18.365 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/124' 2023-10-25T23:38:18.365 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/188/19' 2023-10-25T23:38:18.366 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/188/15' 2023-10-25T23:38:18.366 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/188/20' 2023-10-25T23:38:18.366 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/188/12' 2023-10-25T23:38:18.366 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/188/10' 2023-10-25T23:38:18.366 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/188/11' 2023-10-25T23:38:18.366 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/188/16' 2023-10-25T23:38:18.367 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/188/14' 2023-10-25T23:38:18.367 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/188/18' 2023-10-25T23:38:18.367 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/188/13' 2023-10-25T23:38:18.367 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/188/17' 2023-10-25T23:38:18.367 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/188' 2023-10-25T23:38:18.368 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/145/19' 2023-10-25T23:38:18.368 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/145/15' 2023-10-25T23:38:18.368 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/145/20' 2023-10-25T23:38:18.368 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/145/12' 2023-10-25T23:38:18.368 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/145/10' 2023-10-25T23:38:18.369 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/145/11' 2023-10-25T23:38:18.369 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/145/16' 2023-10-25T23:38:18.369 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/145/14' 2023-10-25T23:38:18.369 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/145/18' 2023-10-25T23:38:18.369 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/145/13' 2023-10-25T23:38:18.369 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/145/17' 2023-10-25T23:38:18.370 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/145' 2023-10-25T23:38:18.370 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/130/19' 2023-10-25T23:38:18.370 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/130/15' 2023-10-25T23:38:18.370 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/130/20' 2023-10-25T23:38:18.370 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/130/12' 2023-10-25T23:38:18.371 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/130/10' 2023-10-25T23:38:18.371 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/130/11' 2023-10-25T23:38:18.371 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/130/16' 2023-10-25T23:38:18.371 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/130/14' 2023-10-25T23:38:18.371 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/130/18' 2023-10-25T23:38:18.371 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/130/13' 2023-10-25T23:38:18.372 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/130/17' 2023-10-25T23:38:18.372 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/130' 2023-10-25T23:38:18.372 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/193/19' 2023-10-25T23:38:18.372 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/193/15' 2023-10-25T23:38:18.372 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/193/20' 2023-10-25T23:38:18.373 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/193/12' 2023-10-25T23:38:18.373 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/193/10' 2023-10-25T23:38:18.373 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/193/11' 2023-10-25T23:38:18.373 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/193/16' 2023-10-25T23:38:18.373 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/193/14' 2023-10-25T23:38:18.373 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/193/18' 2023-10-25T23:38:18.374 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/193/13' 2023-10-25T23:38:18.374 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/193/17' 2023-10-25T23:38:18.374 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/193' 2023-10-25T23:38:18.374 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/175/19' 2023-10-25T23:38:18.374 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/175/15' 2023-10-25T23:38:18.560 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/175/20' 2023-10-25T23:38:18.560 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/175/12' 2023-10-25T23:38:18.561 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/175/10' 2023-10-25T23:38:18.561 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/175/11' 2023-10-25T23:38:18.561 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/175/16' 2023-10-25T23:38:18.561 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/175/14' 2023-10-25T23:38:18.561 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/175/18' 2023-10-25T23:38:18.562 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/175/13' 2023-10-25T23:38:18.562 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/175/17' 2023-10-25T23:38:18.562 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/175' 2023-10-25T23:38:18.562 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/181/19' 2023-10-25T23:38:18.562 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/181/15' 2023-10-25T23:38:18.563 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/181/20' 2023-10-25T23:38:18.563 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/181/12' 2023-10-25T23:38:18.563 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/181/10' 2023-10-25T23:38:18.563 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/181/11' 2023-10-25T23:38:18.563 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/181/16' 2023-10-25T23:38:18.564 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/181/14' 2023-10-25T23:38:18.564 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/181/18' 2023-10-25T23:38:18.564 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/181/13' 2023-10-25T23:38:18.564 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/181/17' 2023-10-25T23:38:18.564 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/181' 2023-10-25T23:38:18.564 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/127/19' 2023-10-25T23:38:18.565 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/127/15' 2023-10-25T23:38:18.565 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/127/20' 2023-10-25T23:38:18.565 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/127/12' 2023-10-25T23:38:18.565 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/127/10' 2023-10-25T23:38:18.565 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/127/11' 2023-10-25T23:38:18.566 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/127/16' 2023-10-25T23:38:18.566 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/127/14' 2023-10-25T23:38:18.566 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/127/18' 2023-10-25T23:38:18.566 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/127/13' 2023-10-25T23:38:18.566 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/127/17' 2023-10-25T23:38:18.566 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/127' 2023-10-25T23:38:18.567 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/108/19' 2023-10-25T23:38:18.567 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/108/15' 2023-10-25T23:38:18.567 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/108/20' 2023-10-25T23:38:18.567 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/108/12' 2023-10-25T23:38:18.567 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/108/10' 2023-10-25T23:38:18.568 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/108/11' 2023-10-25T23:38:18.568 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/108/16' 2023-10-25T23:38:18.569 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/108/14' 2023-10-25T23:38:18.569 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/108/18' 2023-10-25T23:38:18.569 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/108/13' 2023-10-25T23:38:18.569 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/108/17' 2023-10-25T23:38:18.569 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/108' 2023-10-25T23:38:18.569 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/183/19' 2023-10-25T23:38:18.570 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/183/15' 2023-10-25T23:38:18.570 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/183/20' 2023-10-25T23:38:18.570 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/183/12' 2023-10-25T23:38:18.570 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/183/10' 2023-10-25T23:38:18.570 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/183/11' 2023-10-25T23:38:18.571 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/183/16' 2023-10-25T23:38:18.571 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/183/14' 2023-10-25T23:38:18.571 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/183/18' 2023-10-25T23:38:18.571 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/183/13' 2023-10-25T23:38:18.571 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/183/17' 2023-10-25T23:38:18.571 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/183' 2023-10-25T23:38:18.572 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/177/19' 2023-10-25T23:38:18.572 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/177/15' 2023-10-25T23:38:18.572 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/177/20' 2023-10-25T23:38:18.572 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/177/12' 2023-10-25T23:38:18.572 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/177/10' 2023-10-25T23:38:18.573 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/177/11' 2023-10-25T23:38:18.573 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/177/16' 2023-10-25T23:38:18.573 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/177/14' 2023-10-25T23:38:18.573 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/177/18' 2023-10-25T23:38:18.573 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/177/13' 2023-10-25T23:38:18.573 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/177/17' 2023-10-25T23:38:18.574 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/177' 2023-10-25T23:38:18.574 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/169/19' 2023-10-25T23:38:18.574 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/169/15' 2023-10-25T23:38:18.574 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/169/20' 2023-10-25T23:38:18.574 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/169/12' 2023-10-25T23:38:18.575 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/169/10' 2023-10-25T23:38:18.575 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/169/11' 2023-10-25T23:38:18.575 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/169/16' 2023-10-25T23:38:18.575 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/169/14' 2023-10-25T23:38:18.575 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/169/18' 2023-10-25T23:38:18.575 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/169/13' 2023-10-25T23:38:18.576 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/169/17' 2023-10-25T23:38:18.576 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/169' 2023-10-25T23:38:18.576 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/154/19' 2023-10-25T23:38:18.576 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/154/15' 2023-10-25T23:38:18.576 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/154/20' 2023-10-25T23:38:18.577 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/154/12' 2023-10-25T23:38:18.577 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/154/10' 2023-10-25T23:38:18.577 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/154/11' 2023-10-25T23:38:18.577 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/154/16' 2023-10-25T23:38:18.577 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/154/14' 2023-10-25T23:38:18.577 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/154/18' 2023-10-25T23:38:18.578 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/154/13' 2023-10-25T23:38:18.578 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/154/17' 2023-10-25T23:38:18.578 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/154' 2023-10-25T23:38:18.578 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/171/19' 2023-10-25T23:38:18.578 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/171/15' 2023-10-25T23:38:18.579 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/171/20' 2023-10-25T23:38:18.579 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/171/12' 2023-10-25T23:38:18.579 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/171/10' 2023-10-25T23:38:18.579 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/171/11' 2023-10-25T23:38:18.579 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/171/16' 2023-10-25T23:38:18.579 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/171/14' 2023-10-25T23:38:18.580 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/171/18' 2023-10-25T23:38:18.580 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/171/13' 2023-10-25T23:38:18.580 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/171/17' 2023-10-25T23:38:18.580 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/171' 2023-10-25T23:38:18.580 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/139/19' 2023-10-25T23:38:18.581 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/139/15' 2023-10-25T23:38:18.581 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/139/20' 2023-10-25T23:38:18.633 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/139/12' 2023-10-25T23:38:18.634 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/139/10' 2023-10-25T23:38:18.634 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/139/11' 2023-10-25T23:38:18.634 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/139/16' 2023-10-25T23:38:18.634 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/139/14' 2023-10-25T23:38:18.634 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/139/18' 2023-10-25T23:38:18.635 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/139/13' 2023-10-25T23:38:18.635 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/139/17' 2023-10-25T23:38:18.635 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/139' 2023-10-25T23:38:18.635 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/102/19' 2023-10-25T23:38:18.635 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/102/15' 2023-10-25T23:38:18.636 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/102/20' 2023-10-25T23:38:18.636 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/102/12' 2023-10-25T23:38:18.636 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/102/10' 2023-10-25T23:38:18.636 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/102/11' 2023-10-25T23:38:18.636 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/102/16' 2023-10-25T23:38:18.637 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/102/14' 2023-10-25T23:38:18.637 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/102/18' 2023-10-25T23:38:18.637 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/102/13' 2023-10-25T23:38:18.637 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/102/17' 2023-10-25T23:38:18.637 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/102' 2023-10-25T23:38:18.638 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/129/19' 2023-10-25T23:38:18.638 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/129/15' 2023-10-25T23:38:18.638 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/129/20' 2023-10-25T23:38:18.638 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/129/12' 2023-10-25T23:38:18.638 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/129/10' 2023-10-25T23:38:18.639 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/129/11' 2023-10-25T23:38:18.639 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/129/16' 2023-10-25T23:38:18.639 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/129/14' 2023-10-25T23:38:18.639 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/129/18' 2023-10-25T23:38:18.639 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/129/13' 2023-10-25T23:38:18.639 INFO:tasks.workunit.client.0.smithi081.stdout:removed './copyofsnap1/test1/129/17' 2023-10-25T23:38:18.640 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1/129' 2023-10-25T23:38:18.640 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1/test1' 2023-10-25T23:38:18.640 INFO:tasks.workunit.client.0.smithi081.stdout:removed directory './copyofsnap1' 2023-10-25T23:38:18.640 INFO:tasks.workunit.client.0.smithi081.stdout:OK 2023-10-25T23:38:18.641 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-25T23:38:18.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-25T23:38:18.674 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-authwb.sh... 2023-10-25T23:38:18.674 DEBUG:teuthology.orchestra.run.smithi081:workunit test fs/snaps/snaptest-authwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-authwb.sh 2023-10-25T23:38:18.736 INFO:tasks.workunit.client.0.smithi081.stderr:+ set -e 2023-10-25T23:38:18.736 INFO:tasks.workunit.client.0.smithi081.stderr:+ touch foo 2023-10-25T23:38:18.737 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod +x foo 2023-10-25T23:38:18.738 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/s 2023-10-25T23:38:18.765 INFO:tasks.workunit.client.0.smithi081.stderr:+ find .snap/s/foo -executable 2023-10-25T23:38:18.766 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep foo 2023-10-25T23:38:18.767 INFO:tasks.workunit.client.0.smithi081.stdout:.snap/s/foo 2023-10-25T23:38:18.767 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/s 2023-10-25T23:38:18.774 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm foo 2023-10-25T23:38:18.776 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo OK 2023-10-25T23:38:18.777 INFO:tasks.workunit.client.0.smithi081.stdout:OK 2023-10-25T23:38:18.779 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-25T23:38:18.780 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-25T23:38:18.851 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-capwb.sh... 2023-10-25T23:38:18.851 DEBUG:teuthology.orchestra.run.smithi081:workunit test fs/snaps/snaptest-capwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-capwb.sh 2023-10-25T23:38:18.913 INFO:tasks.workunit.client.0.smithi081.stderr:+ set -e 2023-10-25T23:38:18.913 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir foo 2023-10-25T23:38:18.914 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo x 2023-10-25T23:38:18.915 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:21.347 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir foo/.snap/ss 2023-10-25T23:38:21.372 INFO:tasks.workunit.client.0.smithi081.stderr:+ ln foo/x foo/xx 2023-10-25T23:38:21.454 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat foo/.snap/ss/x 2023-10-25T23:38:21.459 INFO:tasks.workunit.client.0.smithi081.stdout:x 2023-10-25T23:38:21.459 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir foo/.snap/ss 2023-10-25T23:38:21.464 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo a 2023-10-25T23:38:21.465 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo b 2023-10-25T23:38:21.466 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir foo/.snap/s 2023-10-25T23:38:21.490 INFO:tasks.workunit.client.0.smithi081.stderr:++ cat foo/.snap/s/a 2023-10-25T23:38:21.501 INFO:tasks.workunit.client.0.smithi081.stderr:+ r=a 2023-10-25T23:38:21.502 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' -z a ']' 2023-10-25T23:38:21.502 INFO:tasks.workunit.client.0.smithi081.stderr:+ ln foo/b foo/b2 2023-10-25T23:38:21.503 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat foo/.snap/s/b 2023-10-25T23:38:21.512 INFO:tasks.workunit.client.0.smithi081.stdout:b 2023-10-25T23:38:21.512 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo 'this used to hang:' 2023-10-25T23:38:21.512 INFO:tasks.workunit.client.0.smithi081.stdout:this used to hang: 2023-10-25T23:38:21.513 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo more 2023-10-25T23:38:21.513 INFO:tasks.workunit.client.0.smithi081.stdout:oh, it didn't hang! good job. 2023-10-25T23:38:21.514 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo 'oh, it didn'\''t hang! good job.' 2023-10-25T23:38:21.514 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat foo/b 2023-10-25T23:38:21.515 INFO:tasks.workunit.client.0.smithi081.stdout:b 2023-10-25T23:38:21.515 INFO:tasks.workunit.client.0.smithi081.stdout:more 2023-10-25T23:38:21.515 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir foo/.snap/s 2023-10-25T23:38:21.517 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm -r foo 2023-10-25T23:38:21.534 INFO:tasks.workunit.client.0.smithi081.stdout:OK 2023-10-25T23:38:21.535 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo OK 2023-10-25T23:38:21.536 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-25T23:38:21.536 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-25T23:38:21.612 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-dir-rename.sh... 2023-10-25T23:38:21.612 DEBUG:teuthology.orchestra.run.smithi081:workunit test fs/snaps/snaptest-dir-rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-dir-rename.sh 2023-10-25T23:38:21.687 INFO:tasks.workunit.client.0.smithi081.stderr:+ set -e 2023-10-25T23:38:21.687 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:21.689 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/bar 2023-10-25T23:38:21.792 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/foo 2023-10-25T23:38:21.821 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/foo 2023-10-25T23:38:21.824 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:21.828 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/bar/a 2023-10-25T23:38:21.831 INFO:tasks.workunit.client.0.smithi081.stdout: File: .snap/bar/a 2023-10-25T23:38:21.832 INFO:tasks.workunit.client.0.smithi081.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-10-25T23:38:21.832 INFO:tasks.workunit.client.0.smithi081.stdout:Device: 100001h/1048577d Inode: 1099511633797 Links: 2 2023-10-25T23:38:21.832 INFO:tasks.workunit.client.0.smithi081.stdout:Access: (0775/drwxrwxr-x) Uid: ( 1000/ ubuntu) Gid: ( 1265/ ubuntu) 2023-10-25T23:38:21.832 INFO:tasks.workunit.client.0.smithi081.stdout:Context: unconfined_u:object_r:cephfs_t:s0 2023-10-25T23:38:21.832 INFO:tasks.workunit.client.0.smithi081.stdout:Access: 2023-10-25 23:38:21.686767565 +0000 2023-10-25T23:38:21.833 INFO:tasks.workunit.client.0.smithi081.stdout:Modify: 2023-10-25 23:38:21.686767565 +0000 2023-10-25T23:38:21.833 INFO:tasks.workunit.client.0.smithi081.stdout:Change: 2023-10-25 23:38:21.686767565 +0000 2023-10-25T23:38:21.833 INFO:tasks.workunit.client.0.smithi081.stdout: Birth: 2023-10-25 23:38:21.686767565 +0000 2023-10-25T23:38:21.833 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/bar 2023-10-25T23:38:21.841 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo OK 2023-10-25T23:38:21.842 INFO:tasks.workunit.client.0.smithi081.stdout:OK 2023-10-25T23:38:21.842 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-25T23:38:21.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-25T23:38:21.912 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-double-null.sh... 2023-10-25T23:38:21.913 DEBUG:teuthology.orchestra.run.smithi081:workunit test fs/snaps/snaptest-double-null.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-double-null.sh 2023-10-25T23:38:21.974 INFO:tasks.workunit.client.0.smithi081.stderr:+ set -e 2023-10-25T23:38:21.974 INFO:tasks.workunit.client.0.smithi081.stderr:++ seq 1 20 2023-10-25T23:38:21.975 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:21.975 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:21.976 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:21.976 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:22.002 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:22.026 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:22.027 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:22.307 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:22.371 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:22.371 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:22.371 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:22.371 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:22.372 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:22.372 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:22.372 INFO:tasks.workunit.client.0.smithi081.stdout: 113613 ? 00:00:00 ps 2023-10-25T23:38:22.372 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:22.380 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:22.382 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:22.389 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:22.389 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:22.391 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:22.391 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:22.417 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:22.448 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:22.449 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:22.523 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:22.573 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:22.573 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:22.574 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:22.574 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:22.574 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:22.574 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:22.574 INFO:tasks.workunit.client.0.smithi081.stdout: 113623 ? 00:00:00 ps 2023-10-25T23:38:22.575 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:22.584 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:22.585 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:22.591 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:22.592 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:22.593 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:22.593 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:22.618 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:22.647 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:22.647 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:22.706 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:22.755 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:22.756 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:22.756 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:22.756 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:22.756 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:22.756 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:22.757 INFO:tasks.workunit.client.0.smithi081.stdout: 113633 ? 00:00:00 ps 2023-10-25T23:38:22.757 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:22.765 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:22.767 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:22.773 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:22.773 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:22.774 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:22.774 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:22.793 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:22.811 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:22.812 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:22.917 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:22.967 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:22.967 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:22.967 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:22.967 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:22.968 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:22.968 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:22.968 INFO:tasks.workunit.client.0.smithi081.stdout: 113644 ? 00:00:00 ps 2023-10-25T23:38:22.968 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:22.977 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:22.980 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:22.987 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:22.987 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:22.989 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:22.989 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:23.008 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:23.033 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:23.034 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:23.108 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:23.158 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:23.159 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:23.159 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:23.159 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:23.159 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:23.159 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:23.160 INFO:tasks.workunit.client.0.smithi081.stdout: 113654 ? 00:00:00 ps 2023-10-25T23:38:23.160 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:23.179 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:23.181 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:23.187 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:23.188 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:23.189 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:23.190 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:23.207 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:23.224 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:23.225 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:23.333 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:23.386 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:23.386 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:23.386 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:23.387 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:23.387 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:23.387 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:23.387 INFO:tasks.workunit.client.0.smithi081.stdout: 113664 ? 00:00:00 ps 2023-10-25T23:38:23.388 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:23.400 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:23.402 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:23.407 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:23.408 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:23.409 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:23.409 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:23.427 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:23.445 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:23.445 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:23.532 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:23.582 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:23.582 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:23.582 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:23.583 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:23.583 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:23.583 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:23.583 INFO:tasks.workunit.client.0.smithi081.stdout: 113675 ? 00:00:00 ps 2023-10-25T23:38:23.584 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:23.592 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:23.594 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:23.600 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:23.600 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:23.601 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:23.602 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:23.620 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:23.649 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:23.650 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:23.726 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:23.776 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:23.776 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:23.776 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:23.777 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:23.777 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:23.777 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:23.777 INFO:tasks.workunit.client.0.smithi081.stdout: 113685 ? 00:00:00 ps 2023-10-25T23:38:23.778 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:23.787 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:23.788 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:23.794 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:23.794 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:23.796 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:23.796 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:23.826 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:23.862 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:23.863 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:23.974 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:24.025 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:24.025 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:24.026 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:24.026 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:24.026 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:24.026 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:24.026 INFO:tasks.workunit.client.0.smithi081.stdout: 113695 ? 00:00:00 ps 2023-10-25T23:38:24.027 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:24.037 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:24.040 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:24.046 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:24.046 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:24.048 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:24.049 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:24.074 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:24.099 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:24.100 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:24.178 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:24.228 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:24.228 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:24.228 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:24.228 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:24.229 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:24.229 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:24.229 INFO:tasks.workunit.client.0.smithi081.stdout: 113705 ? 00:00:00 ps 2023-10-25T23:38:24.230 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:24.239 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:24.241 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:24.246 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:24.247 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:24.248 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:24.249 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:24.274 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:24.312 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:24.314 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:24.482 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:24.532 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:24.533 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:24.533 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:24.533 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:24.533 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:24.533 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:24.534 INFO:tasks.workunit.client.0.smithi081.stdout: 113715 ? 00:00:00 ps 2023-10-25T23:38:24.534 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:24.544 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:24.546 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:24.551 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:24.551 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:24.553 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:24.553 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:24.580 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:24.612 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:24.615 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:24.695 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:24.745 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:24.746 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:24.746 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:24.746 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:24.746 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:24.747 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:24.747 INFO:tasks.workunit.client.0.smithi081.stdout: 113725 ? 00:00:00 ps 2023-10-25T23:38:24.747 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:24.757 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:24.759 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:24.764 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:24.764 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:24.766 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:24.766 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:24.793 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:24.827 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:24.829 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:24.885 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:24.935 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:24.935 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:24.935 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:24.936 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:24.936 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:24.936 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:24.936 INFO:tasks.workunit.client.0.smithi081.stdout: 113735 ? 00:00:00 ps 2023-10-25T23:38:24.937 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:24.946 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:24.948 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:24.953 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:24.953 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:24.955 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:24.955 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:24.974 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:25.003 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:25.003 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:25.087 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:25.142 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:25.142 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:25.142 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:25.143 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:25.143 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:25.143 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:25.143 INFO:tasks.workunit.client.0.smithi081.stdout: 113745 ? 00:00:00 ps 2023-10-25T23:38:25.144 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:25.171 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:25.173 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:25.182 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:25.182 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:25.184 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:25.184 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:25.220 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:25.242 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:25.244 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:25.418 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:25.468 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:25.468 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:25.469 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:25.469 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:25.469 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:25.469 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:25.470 INFO:tasks.workunit.client.0.smithi081.stdout: 113755 ? 00:00:00 ps 2023-10-25T23:38:25.470 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:25.481 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:25.481 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:25.485 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:25.486 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:25.487 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:25.488 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:25.505 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:25.535 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:25.535 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:25.603 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:25.652 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:25.652 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:25.653 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:25.653 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:25.653 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:25.653 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:25.653 INFO:tasks.workunit.client.0.smithi081.stdout: 113765 ? 00:00:00 ps 2023-10-25T23:38:25.654 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:25.663 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:25.665 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:25.670 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:25.671 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:25.672 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:25.673 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:25.691 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:25.707 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:25.708 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:25.753 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:25.802 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:25.803 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:25.803 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:25.803 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:25.803 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:25.804 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:25.804 INFO:tasks.workunit.client.0.smithi081.stdout: 113775 ? 00:00:00 ps 2023-10-25T23:38:25.804 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:25.813 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:25.814 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:25.820 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:25.820 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:25.822 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:25.822 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:25.840 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:25.856 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:25.857 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:25.928 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:25.978 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:25.978 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:25.978 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:25.979 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:25.979 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:25.979 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:25.979 INFO:tasks.workunit.client.0.smithi081.stdout: 113785 ? 00:00:00 ps 2023-10-25T23:38:25.980 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:25.989 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:25.991 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:25.996 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:25.997 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:25.999 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:25.999 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:26.019 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:26.035 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:26.036 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:26.111 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:26.172 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:26.172 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:26.173 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:26.173 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:26.173 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:26.173 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:26.173 INFO:tasks.workunit.client.0.smithi081.stdout: 113795 ? 00:00:00 ps 2023-10-25T23:38:26.174 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:26.206 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:26.208 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:26.219 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 20` 2023-10-25T23:38:26.220 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a 2023-10-25T23:38:26.223 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/one 2023-10-25T23:38:26.223 INFO:tasks.workunit.client.0.smithi081.stderr:+ cat 2023-10-25T23:38:26.244 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir a/.snap/two 2023-10-25T23:38:26.264 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a/foo 2023-10-25T23:38:26.265 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:38:26.396 INFO:tasks.workunit.client.0.smithi081.stderr:+ ps 2023-10-25T23:38:26.448 INFO:tasks.workunit.client.0.smithi081.stdout: PID TTY TIME CMD 2023-10-25T23:38:26.449 INFO:tasks.workunit.client.0.smithi081.stdout: 1678 ? 00:00:00 systemd 2023-10-25T23:38:26.449 INFO:tasks.workunit.client.0.smithi081.stdout: 1681 ? 00:00:00 (sd-pam) 2023-10-25T23:38:26.449 INFO:tasks.workunit.client.0.smithi081.stdout: 86586 ? 00:00:00 sshd 2023-10-25T23:38:26.449 INFO:tasks.workunit.client.0.smithi081.stdout: 113584 ? 00:00:00 timeout 2023-10-25T23:38:26.450 INFO:tasks.workunit.client.0.smithi081.stdout: 113605 ? 00:00:00 snaptest-double 2023-10-25T23:38:26.450 INFO:tasks.workunit.client.0.smithi081.stdout: 113805 ? 00:00:00 ps 2023-10-25T23:38:26.450 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a/.snap/one a/.snap/two 2023-10-25T23:38:26.459 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm a/foo 2023-10-25T23:38:26.461 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir a 2023-10-25T23:38:26.466 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo OK 2023-10-25T23:38:26.467 INFO:tasks.workunit.client.0.smithi081.stdout:OK 2023-10-25T23:38:26.467 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-25T23:38:26.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-25T23:38:26.541 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-estale.sh... 2023-10-25T23:38:26.542 DEBUG:teuthology.orchestra.run.smithi081:workunit test fs/snaps/snaptest-estale.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-estale.sh 2023-10-25T23:38:26.603 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/foo 2023-10-25T23:38:26.621 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo 'We want ENOENT, not ESTALE, here.' 2023-10-25T23:38:26.621 INFO:tasks.workunit.client.0.smithi081.stdout:We want ENOENT, not ESTALE, here. 2023-10-25T23:38:26.622 INFO:tasks.workunit.client.0.smithi081.stderr:++ seq 1 100 2023-10-25T23:38:26.622 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.622 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/1 2023-10-25T23:38:26.622 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.628 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/1': No such file or directory 2023-10-25T23:38:26.629 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.629 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/2 2023-10-25T23:38:26.629 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.630 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/2': No such file or directory 2023-10-25T23:38:26.631 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.631 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/3 2023-10-25T23:38:26.631 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.632 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/3': No such file or directory 2023-10-25T23:38:26.632 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.633 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/4 2023-10-25T23:38:26.633 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.633 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/4': No such file or directory 2023-10-25T23:38:26.634 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.634 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/5 2023-10-25T23:38:26.634 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.635 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/5': No such file or directory 2023-10-25T23:38:26.635 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.636 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/6 2023-10-25T23:38:26.636 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.636 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/6': No such file or directory 2023-10-25T23:38:26.637 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.637 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/7 2023-10-25T23:38:26.637 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.638 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/7': No such file or directory 2023-10-25T23:38:26.638 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.639 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/8 2023-10-25T23:38:26.639 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.639 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/8': No such file or directory 2023-10-25T23:38:26.640 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.640 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/9 2023-10-25T23:38:26.640 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.641 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/9': No such file or directory 2023-10-25T23:38:26.641 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.641 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/10 2023-10-25T23:38:26.642 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.642 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/10': No such file or directory 2023-10-25T23:38:26.643 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.643 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/11 2023-10-25T23:38:26.643 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.643 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/11': No such file or directory 2023-10-25T23:38:26.644 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.644 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/12 2023-10-25T23:38:26.645 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.645 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/12': No such file or directory 2023-10-25T23:38:26.646 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.646 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/13 2023-10-25T23:38:26.646 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.646 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/13': No such file or directory 2023-10-25T23:38:26.647 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.647 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/14 2023-10-25T23:38:26.647 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.648 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/14': No such file or directory 2023-10-25T23:38:26.648 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.649 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/15 2023-10-25T23:38:26.649 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.649 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/15': No such file or directory 2023-10-25T23:38:26.651 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.651 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/16 2023-10-25T23:38:26.651 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.652 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/16': No such file or directory 2023-10-25T23:38:26.652 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.652 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/17 2023-10-25T23:38:26.653 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.653 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/17': No such file or directory 2023-10-25T23:38:26.654 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.654 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/18 2023-10-25T23:38:26.654 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.655 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/18': No such file or directory 2023-10-25T23:38:26.655 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.655 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/19 2023-10-25T23:38:26.656 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.656 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/19': No such file or directory 2023-10-25T23:38:26.657 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.657 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/20 2023-10-25T23:38:26.657 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.657 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/20': No such file or directory 2023-10-25T23:38:26.658 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.658 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/21 2023-10-25T23:38:26.658 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.659 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/21': No such file or directory 2023-10-25T23:38:26.659 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.660 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/22 2023-10-25T23:38:26.660 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.660 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/22': No such file or directory 2023-10-25T23:38:26.661 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.661 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/23 2023-10-25T23:38:26.661 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.662 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/23': No such file or directory 2023-10-25T23:38:26.662 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.663 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/24 2023-10-25T23:38:26.663 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.663 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/24': No such file or directory 2023-10-25T23:38:26.664 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.664 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/25 2023-10-25T23:38:26.664 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.665 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/25': No such file or directory 2023-10-25T23:38:26.665 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.665 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/26 2023-10-25T23:38:26.666 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.666 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/26': No such file or directory 2023-10-25T23:38:26.667 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.667 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/27 2023-10-25T23:38:26.667 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.667 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/27': No such file or directory 2023-10-25T23:38:26.668 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.668 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/28 2023-10-25T23:38:26.668 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.669 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/28': No such file or directory 2023-10-25T23:38:26.669 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.670 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/29 2023-10-25T23:38:26.670 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.670 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/29': No such file or directory 2023-10-25T23:38:26.671 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.671 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/30 2023-10-25T23:38:26.671 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.672 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/30': No such file or directory 2023-10-25T23:38:26.672 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.672 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/31 2023-10-25T23:38:26.673 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.673 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/31': No such file or directory 2023-10-25T23:38:26.674 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.674 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/32 2023-10-25T23:38:26.674 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.674 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/32': No such file or directory 2023-10-25T23:38:26.675 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.675 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/33 2023-10-25T23:38:26.675 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.676 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/33': No such file or directory 2023-10-25T23:38:26.676 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.677 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/34 2023-10-25T23:38:26.677 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.677 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/34': No such file or directory 2023-10-25T23:38:26.678 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.678 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/35 2023-10-25T23:38:26.678 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.679 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/35': No such file or directory 2023-10-25T23:38:26.679 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.680 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/36 2023-10-25T23:38:26.680 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.680 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/36': No such file or directory 2023-10-25T23:38:26.681 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.681 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/37 2023-10-25T23:38:26.681 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.682 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/37': No such file or directory 2023-10-25T23:38:26.682 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.682 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/38 2023-10-25T23:38:26.683 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.683 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/38': No such file or directory 2023-10-25T23:38:26.684 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.684 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/39 2023-10-25T23:38:26.684 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.684 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/39': No such file or directory 2023-10-25T23:38:26.685 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.685 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/40 2023-10-25T23:38:26.685 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.686 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/40': No such file or directory 2023-10-25T23:38:26.686 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.687 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/41 2023-10-25T23:38:26.687 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.687 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/41': No such file or directory 2023-10-25T23:38:26.688 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.688 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/42 2023-10-25T23:38:26.688 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.689 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/42': No such file or directory 2023-10-25T23:38:26.689 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.689 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/43 2023-10-25T23:38:26.690 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.690 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/43': No such file or directory 2023-10-25T23:38:26.691 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.691 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/44 2023-10-25T23:38:26.691 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.692 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/44': No such file or directory 2023-10-25T23:38:26.692 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.692 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/45 2023-10-25T23:38:26.693 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.693 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/45': No such file or directory 2023-10-25T23:38:26.693 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.694 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/46 2023-10-25T23:38:26.694 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.694 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/46': No such file or directory 2023-10-25T23:38:26.695 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.695 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/47 2023-10-25T23:38:26.695 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.696 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/47': No such file or directory 2023-10-25T23:38:26.696 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.696 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/48 2023-10-25T23:38:26.697 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.697 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/48': No such file or directory 2023-10-25T23:38:26.698 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.698 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/49 2023-10-25T23:38:26.698 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.698 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/49': No such file or directory 2023-10-25T23:38:26.699 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.699 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/50 2023-10-25T23:38:26.699 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.700 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/50': No such file or directory 2023-10-25T23:38:26.700 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.701 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/51 2023-10-25T23:38:26.701 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.701 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/51': No such file or directory 2023-10-25T23:38:26.702 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.702 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/52 2023-10-25T23:38:26.702 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.703 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/52': No such file or directory 2023-10-25T23:38:26.703 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.703 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/53 2023-10-25T23:38:26.704 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.704 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/53': No such file or directory 2023-10-25T23:38:26.705 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.705 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/54 2023-10-25T23:38:26.705 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.705 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/54': No such file or directory 2023-10-25T23:38:26.706 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.706 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/55 2023-10-25T23:38:26.706 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.707 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/55': No such file or directory 2023-10-25T23:38:26.707 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.708 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/56 2023-10-25T23:38:26.708 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.708 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/56': No such file or directory 2023-10-25T23:38:26.709 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.709 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/57 2023-10-25T23:38:26.709 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.710 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/57': No such file or directory 2023-10-25T23:38:26.710 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.710 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/58 2023-10-25T23:38:26.711 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.711 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/58': No such file or directory 2023-10-25T23:38:26.712 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.712 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/59 2023-10-25T23:38:26.712 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.712 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/59': No such file or directory 2023-10-25T23:38:26.713 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.713 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/60 2023-10-25T23:38:26.713 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.714 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/60': No such file or directory 2023-10-25T23:38:26.714 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.715 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/61 2023-10-25T23:38:26.715 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.715 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/61': No such file or directory 2023-10-25T23:38:26.716 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.716 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/62 2023-10-25T23:38:26.716 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.717 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/62': No such file or directory 2023-10-25T23:38:26.717 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.717 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/63 2023-10-25T23:38:26.718 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.718 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/63': No such file or directory 2023-10-25T23:38:26.719 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.719 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/64 2023-10-25T23:38:26.719 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.720 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/64': No such file or directory 2023-10-25T23:38:26.720 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.720 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/65 2023-10-25T23:38:26.721 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.721 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/65': No such file or directory 2023-10-25T23:38:26.722 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.722 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/66 2023-10-25T23:38:26.722 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.722 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/66': No such file or directory 2023-10-25T23:38:26.723 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.723 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/67 2023-10-25T23:38:26.723 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.724 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/67': No such file or directory 2023-10-25T23:38:26.724 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.725 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/68 2023-10-25T23:38:26.725 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.725 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/68': No such file or directory 2023-10-25T23:38:26.726 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.726 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/69 2023-10-25T23:38:26.726 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.727 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/69': No such file or directory 2023-10-25T23:38:26.727 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.728 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/70 2023-10-25T23:38:26.728 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.728 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/70': No such file or directory 2023-10-25T23:38:26.729 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.729 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/71 2023-10-25T23:38:26.729 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.730 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/71': No such file or directory 2023-10-25T23:38:26.730 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.730 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/72 2023-10-25T23:38:26.731 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.731 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/72': No such file or directory 2023-10-25T23:38:26.732 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.732 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/73 2023-10-25T23:38:26.732 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.732 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/73': No such file or directory 2023-10-25T23:38:26.733 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.733 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/74 2023-10-25T23:38:26.733 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.734 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/74': No such file or directory 2023-10-25T23:38:26.735 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.735 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/75 2023-10-25T23:38:26.735 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.735 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/75': No such file or directory 2023-10-25T23:38:26.736 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.736 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/76 2023-10-25T23:38:26.736 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.737 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/76': No such file or directory 2023-10-25T23:38:26.737 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.738 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/77 2023-10-25T23:38:26.738 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.738 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/77': No such file or directory 2023-10-25T23:38:26.739 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.739 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/78 2023-10-25T23:38:26.739 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.740 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/78': No such file or directory 2023-10-25T23:38:26.740 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.740 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/79 2023-10-25T23:38:26.741 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.741 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/79': No such file or directory 2023-10-25T23:38:26.741 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.742 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/80 2023-10-25T23:38:26.742 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.742 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/80': No such file or directory 2023-10-25T23:38:26.743 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.743 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/81 2023-10-25T23:38:26.743 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.744 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/81': No such file or directory 2023-10-25T23:38:26.744 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.744 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/82 2023-10-25T23:38:26.745 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.745 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/82': No such file or directory 2023-10-25T23:38:26.746 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.746 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/83 2023-10-25T23:38:26.746 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.746 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/83': No such file or directory 2023-10-25T23:38:26.747 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.747 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/84 2023-10-25T23:38:26.747 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.748 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/84': No such file or directory 2023-10-25T23:38:26.748 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.749 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/85 2023-10-25T23:38:26.749 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.749 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/85': No such file or directory 2023-10-25T23:38:26.750 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.750 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/86 2023-10-25T23:38:26.750 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.751 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/86': No such file or directory 2023-10-25T23:38:26.751 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.751 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/87 2023-10-25T23:38:26.752 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.752 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/87': No such file or directory 2023-10-25T23:38:26.753 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.753 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/88 2023-10-25T23:38:26.753 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.753 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/88': No such file or directory 2023-10-25T23:38:26.754 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.754 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/89 2023-10-25T23:38:26.754 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.755 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/89': No such file or directory 2023-10-25T23:38:26.755 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.756 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/90 2023-10-25T23:38:26.756 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.756 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/90': No such file or directory 2023-10-25T23:38:26.757 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.757 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/91 2023-10-25T23:38:26.757 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.758 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/91': No such file or directory 2023-10-25T23:38:26.758 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.759 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/92 2023-10-25T23:38:26.759 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.759 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/92': No such file or directory 2023-10-25T23:38:26.760 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.760 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/93 2023-10-25T23:38:26.760 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.761 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/93': No such file or directory 2023-10-25T23:38:26.761 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.761 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/94 2023-10-25T23:38:26.762 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.762 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/94': No such file or directory 2023-10-25T23:38:26.763 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.763 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/95 2023-10-25T23:38:26.763 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.763 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/95': No such file or directory 2023-10-25T23:38:26.764 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.764 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/96 2023-10-25T23:38:26.764 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.765 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/96': No such file or directory 2023-10-25T23:38:26.765 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.766 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/97 2023-10-25T23:38:26.766 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.766 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/97': No such file or directory 2023-10-25T23:38:26.767 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.767 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/98 2023-10-25T23:38:26.767 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.768 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/98': No such file or directory 2023-10-25T23:38:26.768 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.768 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/99 2023-10-25T23:38:26.769 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.769 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/99': No such file or directory 2023-10-25T23:38:26.770 INFO:tasks.workunit.client.0.smithi081.stderr:+ for f in `seq 1 100` 2023-10-25T23:38:26.770 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/foo/100 2023-10-25T23:38:26.770 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'No such file' 2023-10-25T23:38:26.770 INFO:tasks.workunit.client.0.smithi081.stdout:stat: cannot statx '.snap/foo/100': No such file or directory 2023-10-25T23:38:26.771 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/foo 2023-10-25T23:38:26.771 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo OK 2023-10-25T23:38:26.772 INFO:tasks.workunit.client.0.smithi081.stdout:OK 2023-10-25T23:38:26.772 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-25T23:38:26.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-25T23:38:26.840 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-git-ceph.sh... 2023-10-25T23:38:26.841 DEBUG:teuthology.orchestra.run.smithi081:workunit test fs/snaps/snaptest-git-ceph.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh 2023-10-25T23:38:26.902 INFO:tasks.workunit.client.0.smithi081.stderr:+ set -e 2023-10-25T23:38:26.903 INFO:tasks.workunit.client.0.smithi081.stderr:+ sudo git config --global http.sslVerify false 2023-10-25T23:38:26.914 INFO:tasks.workunit.client.0.smithi081.stderr:+ sudo git config --global http.postBuffer 1048576000 2023-10-25T23:38:26.926 INFO:tasks.workunit.client.0.smithi081.stderr:+ retried=false 2023-10-25T23:38:26.926 INFO:tasks.workunit.client.0.smithi081.stderr:+ trap -- retry EXIT 2023-10-25T23:38:26.926 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm -rf ceph 2023-10-25T23:38:26.927 INFO:tasks.workunit.client.0.smithi081.stderr:+ timeout 1800 git clone https://git.ceph.com/ceph.git 2023-10-25T23:38:26.928 INFO:tasks.workunit.client.0.smithi081.stderr:Cloning into 'ceph'... 2023-10-25T23:38:37.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:38:37.678 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:39:07.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:39:07.748 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:39:35.859 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 9% (1146/12067) Updating files: 10% (1207/12067) Updating files: 11% (1328/12067) Updating files: 12% (1449/12067) Updating files: 13% (1569/12067) Updating files: 14% (1690/12067) Updating files: 15% (1811/12067) Updating files: 15% (1904/12067) Updating files: 16% (1931/12067) Updating files: 17% (2052/12067) Updating files: 18% (2173/12067) Updating files: 19% (2293/12067) Updating files: 20% (2414/12067) Updating files: 21% (2535/12067) Updating files: 22% (2655/12067) Updating files: 22% (2684/12067) Updating files: 23% (2776/12067) Updating files: 24% (2897/12067) Updating files: 25% (3017/12067) Updating files: 26% (3138/12067) Updating files: 27% (3259/12067) Updating files: 28% (3379/12067) Updating files: 29% (3500/12067) Updating files: 29% (3523/12067) Updating files: 30% (3621/12067) Updating files: 31% (3741/12067) Updating files: 32% (3862/12067) Updating files: 33% (3983/12067) Updating files: 34% (4103/12067) Updating files: 35% (4224/12067) Updating files: 36% (4345/12067) Updating files: 36% (4412/12067) Updating files: 37% (4465/12067) Updating files: 38% (4586/12067) Updating files: 39% (4707/12067) Updating files: 40% (4827/12067) Updating files: 41% (4948/12067) Updating files: 42% (5069/12067) Updating files: 43% (5189/12067) Updating files: 43% (5253/12067) Updating files: 44% (5310/12067) Updating files: 45% (5431/12067) Updating files: 46% (5551/12067) Updating files: 47% (5672/12067) Updating files: 48% (5793/12067) Updating files: 49% (5913/12067) Updating files: 50% (6034/12067) Updating files: 51% (6155/12067) Updating files: 51% (6271/12067) Updating files: 52% (6275/12067) Updating files: 53% (6396/12067) Updating files: 54% (6517/12067) Updating files: 55% (6637/12067) Updating files: 56% (6758/12067) Updating files: 57% (6879/12067) Updating files: 58% (6999/12067) Updating files: 59% (7120/12067) Updating files: 60% (7241/12067) Updating files: 60% (7297/12067) Updating files: 61% (7361/12067) Updating files: 62% (7482/12067) Updating files: 63% (7603/12067) Updating files: 64% (7723/12067) Updating files: 65% (7844/12067) Updating files: 66% (7965/12067) Updating files: 67% (8085/12067) Updating files: 67% (8155/12067) Updating files: 68% (8206/12067) Updating files: 69% (8327/12067) Updating files: 70% (8447/12067) Updating files: 71% (8568/12067) Updating files: 72% (8689/12067) Updating files: 73% (8809/12067) Updating files: 74% (8930/12067) Updating files: 75% (9051/12067) Updating files: 75% (9097/12067) Updating files: 76% (9171/12067) Updating files: 77% (9292/12067) Updating files: 78% (9413/12067) Updating files: 79% (9533/12067) Updating files: 79% (9612/12067) Updating files: 80% (9654/12067) Updating files: 80% (9749/12067) Updating files: 80% (9751/12067) Updating files: 81% (9775/12067) Updating files: 82% (9895/12067) Updating files: 83% (10016/12067) Updating files: 84% (10137/12067) Updating files: 85% (10257/12067) Updating files: 86% (10378/12067) Updating files: 87% (10499/12067) Updating files: 88% (10619/12067) Updating files: 89% (10740/12067) Updating files: 89% (10763/12067) Updating files: 90% (10861/12067) Updating files: 91% (10981/12067) Updating files: 92% (11102/12067) Updating files: 93% (11223/12067) Updating files: 94% (11343/12067) Updating files: 95% (11464/12067) Updating files: 96% (11585/12067) Updating files: 97% (11705/12067) Updating files: 97% (11822/12067) Updating files: 98% (11826/12067) Updating files: 99% (11947/12067) Updating files: 100% (12067/12067) Updating files: 100% (12067/12067), done. 2023-10-25T23:39:35.884 INFO:tasks.workunit.client.0.smithi081.stderr:+ trap - EXIT 2023-10-25T23:39:35.884 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ceph 2023-10-25T23:39:35.885 INFO:tasks.workunit.client.0.smithi081.stderr:++ seq 1 90 2023-10-25T23:39:35.885 INFO:tasks.workunit.client.0.smithi081.stderr:+ versions='1 2023-10-25T23:39:35.886 INFO:tasks.workunit.client.0.smithi081.stderr:2 2023-10-25T23:39:35.886 INFO:tasks.workunit.client.0.smithi081.stderr:3 2023-10-25T23:39:35.887 INFO:tasks.workunit.client.0.smithi081.stderr:4 2023-10-25T23:39:35.887 INFO:tasks.workunit.client.0.smithi081.stderr:5 2023-10-25T23:39:35.887 INFO:tasks.workunit.client.0.smithi081.stderr:6 2023-10-25T23:39:35.887 INFO:tasks.workunit.client.0.smithi081.stderr:7 2023-10-25T23:39:35.888 INFO:tasks.workunit.client.0.smithi081.stderr:8 2023-10-25T23:39:35.888 INFO:tasks.workunit.client.0.smithi081.stderr:9 2023-10-25T23:39:35.888 INFO:tasks.workunit.client.0.smithi081.stderr:10 2023-10-25T23:39:35.888 INFO:tasks.workunit.client.0.smithi081.stderr:11 2023-10-25T23:39:35.889 INFO:tasks.workunit.client.0.smithi081.stderr:12 2023-10-25T23:39:35.889 INFO:tasks.workunit.client.0.smithi081.stderr:13 2023-10-25T23:39:35.890 INFO:tasks.workunit.client.0.smithi081.stderr:14 2023-10-25T23:39:35.890 INFO:tasks.workunit.client.0.smithi081.stderr:15 2023-10-25T23:39:35.890 INFO:tasks.workunit.client.0.smithi081.stderr:16 2023-10-25T23:39:35.890 INFO:tasks.workunit.client.0.smithi081.stderr:17 2023-10-25T23:39:35.891 INFO:tasks.workunit.client.0.smithi081.stderr:18 2023-10-25T23:39:35.891 INFO:tasks.workunit.client.0.smithi081.stderr:19 2023-10-25T23:39:35.891 INFO:tasks.workunit.client.0.smithi081.stderr:20 2023-10-25T23:39:35.892 INFO:tasks.workunit.client.0.smithi081.stderr:21 2023-10-25T23:39:35.892 INFO:tasks.workunit.client.0.smithi081.stderr:22 2023-10-25T23:39:35.892 INFO:tasks.workunit.client.0.smithi081.stderr:23 2023-10-25T23:39:35.892 INFO:tasks.workunit.client.0.smithi081.stderr:24 2023-10-25T23:39:35.893 INFO:tasks.workunit.client.0.smithi081.stderr:25 2023-10-25T23:39:35.893 INFO:tasks.workunit.client.0.smithi081.stderr:26 2023-10-25T23:39:35.893 INFO:tasks.workunit.client.0.smithi081.stderr:27 2023-10-25T23:39:35.893 INFO:tasks.workunit.client.0.smithi081.stderr:28 2023-10-25T23:39:35.894 INFO:tasks.workunit.client.0.smithi081.stderr:29 2023-10-25T23:39:35.894 INFO:tasks.workunit.client.0.smithi081.stderr:30 2023-10-25T23:39:35.894 INFO:tasks.workunit.client.0.smithi081.stderr:31 2023-10-25T23:39:35.894 INFO:tasks.workunit.client.0.smithi081.stderr:32 2023-10-25T23:39:35.894 INFO:tasks.workunit.client.0.smithi081.stderr:33 2023-10-25T23:39:35.895 INFO:tasks.workunit.client.0.smithi081.stderr:34 2023-10-25T23:39:35.895 INFO:tasks.workunit.client.0.smithi081.stderr:35 2023-10-25T23:39:35.895 INFO:tasks.workunit.client.0.smithi081.stderr:36 2023-10-25T23:39:35.895 INFO:tasks.workunit.client.0.smithi081.stderr:37 2023-10-25T23:39:35.895 INFO:tasks.workunit.client.0.smithi081.stderr:38 2023-10-25T23:39:35.896 INFO:tasks.workunit.client.0.smithi081.stderr:39 2023-10-25T23:39:35.896 INFO:tasks.workunit.client.0.smithi081.stderr:40 2023-10-25T23:39:35.896 INFO:tasks.workunit.client.0.smithi081.stderr:41 2023-10-25T23:39:35.896 INFO:tasks.workunit.client.0.smithi081.stderr:42 2023-10-25T23:39:35.897 INFO:tasks.workunit.client.0.smithi081.stderr:43 2023-10-25T23:39:35.897 INFO:tasks.workunit.client.0.smithi081.stderr:44 2023-10-25T23:39:35.897 INFO:tasks.workunit.client.0.smithi081.stderr:45 2023-10-25T23:39:35.897 INFO:tasks.workunit.client.0.smithi081.stderr:46 2023-10-25T23:39:35.898 INFO:tasks.workunit.client.0.smithi081.stderr:47 2023-10-25T23:39:35.898 INFO:tasks.workunit.client.0.smithi081.stderr:48 2023-10-25T23:39:35.898 INFO:tasks.workunit.client.0.smithi081.stderr:49 2023-10-25T23:39:35.898 INFO:tasks.workunit.client.0.smithi081.stderr:50 2023-10-25T23:39:35.899 INFO:tasks.workunit.client.0.smithi081.stderr:51 2023-10-25T23:39:35.899 INFO:tasks.workunit.client.0.smithi081.stderr:52 2023-10-25T23:39:35.899 INFO:tasks.workunit.client.0.smithi081.stderr:53 2023-10-25T23:39:35.899 INFO:tasks.workunit.client.0.smithi081.stderr:54 2023-10-25T23:39:35.899 INFO:tasks.workunit.client.0.smithi081.stderr:55 2023-10-25T23:39:35.899 INFO:tasks.workunit.client.0.smithi081.stderr:56 2023-10-25T23:39:35.900 INFO:tasks.workunit.client.0.smithi081.stderr:57 2023-10-25T23:39:35.900 INFO:tasks.workunit.client.0.smithi081.stderr:58 2023-10-25T23:39:35.900 INFO:tasks.workunit.client.0.smithi081.stderr:59 2023-10-25T23:39:35.900 INFO:tasks.workunit.client.0.smithi081.stderr:60 2023-10-25T23:39:35.900 INFO:tasks.workunit.client.0.smithi081.stderr:61 2023-10-25T23:39:35.901 INFO:tasks.workunit.client.0.smithi081.stderr:62 2023-10-25T23:39:35.901 INFO:tasks.workunit.client.0.smithi081.stderr:63 2023-10-25T23:39:35.901 INFO:tasks.workunit.client.0.smithi081.stderr:64 2023-10-25T23:39:35.901 INFO:tasks.workunit.client.0.smithi081.stderr:65 2023-10-25T23:39:35.901 INFO:tasks.workunit.client.0.smithi081.stderr:66 2023-10-25T23:39:35.902 INFO:tasks.workunit.client.0.smithi081.stderr:67 2023-10-25T23:39:35.902 INFO:tasks.workunit.client.0.smithi081.stderr:68 2023-10-25T23:39:35.902 INFO:tasks.workunit.client.0.smithi081.stderr:69 2023-10-25T23:39:35.902 INFO:tasks.workunit.client.0.smithi081.stderr:70 2023-10-25T23:39:35.902 INFO:tasks.workunit.client.0.smithi081.stderr:71 2023-10-25T23:39:35.903 INFO:tasks.workunit.client.0.smithi081.stderr:72 2023-10-25T23:39:35.903 INFO:tasks.workunit.client.0.smithi081.stderr:73 2023-10-25T23:39:35.903 INFO:tasks.workunit.client.0.smithi081.stderr:74 2023-10-25T23:39:35.903 INFO:tasks.workunit.client.0.smithi081.stderr:75 2023-10-25T23:39:35.903 INFO:tasks.workunit.client.0.smithi081.stderr:76 2023-10-25T23:39:35.904 INFO:tasks.workunit.client.0.smithi081.stderr:77 2023-10-25T23:39:35.904 INFO:tasks.workunit.client.0.smithi081.stderr:78 2023-10-25T23:39:35.904 INFO:tasks.workunit.client.0.smithi081.stderr:79 2023-10-25T23:39:35.904 INFO:tasks.workunit.client.0.smithi081.stderr:80 2023-10-25T23:39:35.904 INFO:tasks.workunit.client.0.smithi081.stderr:81 2023-10-25T23:39:35.904 INFO:tasks.workunit.client.0.smithi081.stderr:82 2023-10-25T23:39:35.905 INFO:tasks.workunit.client.0.smithi081.stderr:83 2023-10-25T23:39:35.905 INFO:tasks.workunit.client.0.smithi081.stderr:84 2023-10-25T23:39:35.905 INFO:tasks.workunit.client.0.smithi081.stderr:85 2023-10-25T23:39:35.905 INFO:tasks.workunit.client.0.smithi081.stderr:86 2023-10-25T23:39:35.905 INFO:tasks.workunit.client.0.smithi081.stderr:87 2023-10-25T23:39:35.906 INFO:tasks.workunit.client.0.smithi081.stderr:88 2023-10-25T23:39:35.906 INFO:tasks.workunit.client.0.smithi081.stderr:89 2023-10-25T23:39:35.906 INFO:tasks.workunit.client.0.smithi081.stderr:90' 2023-10-25T23:39:35.906 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:39:35.906 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 1 -eq 48 ']' 2023-10-25T23:39:35.907 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.1 2023-10-25T23:39:35.907 INFO:tasks.workunit.client.0.smithi081.stdout:v0.1 2023-10-25T23:39:35.908 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.1 2023-10-25T23:39:35.908 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.1 2023-10-25T23:39:37.810 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:39:37.815 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:40:07.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:40:07.902 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:40:10.329 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 4% (520/12857) Updating files: 5% (643/12857) Updating files: 6% (772/12857) Updating files: 6% (871/12857) Updating files: 7% (900/12857) Updating files: 8% (1029/12857) Updating files: 9% (1158/12857) Updating files: 9% (1214/12857) Updating files: 10% (1286/12857) Updating files: 11% (1415/12857) Updating files: 12% (1543/12857) Updating files: 12% (1570/12857) Updating files: 13% (1672/12857) Updating files: 14% (1800/12857) Updating files: 14% (1879/12857) Updating files: 15% (1929/12857) Updating files: 16% (2058/12857) Updating files: 16% (2169/12857) Updating files: 17% (2186/12857) Updating files: 18% (2315/12857) Updating files: 19% (2443/12857) Updating files: 19% (2456/12857) Updating files: 20% (2572/12857) Updating files: 21% (2700/12857) Updating files: 21% (2772/12857) Updating files: 22% (2829/12857) Updating files: 23% (2958/12857) Updating files: 24% (3086/12857) Updating files: 24% (3126/12857) Updating files: 25% (3215/12857) Updating files: 26% (3343/12857) Updating files: 27% (3472/12857) Updating files: 27% (3484/12857) Updating files: 28% (3600/12857) Updating files: 29% (3729/12857) Updating files: 29% (3802/12857) Updating files: 30% (3858/12857) Updating files: 31% (3986/12857) Updating files: 32% (4115/12857) Updating files: 32% (4167/12857) Updating files: 33% (4243/12857) Updating files: 34% (4372/12857) Updating files: 35% (4500/12857) Updating files: 35% (4524/12857) Updating files: 36% (4629/12857) Updating files: 37% (4758/12857) Updating files: 38% (4886/12857) Updating files: 38% (4952/12857) Updating files: 39% (5015/12857) Updating files: 40% (5143/12857) Updating files: 40% (5263/12857) Updating files: 41% (5272/12857) Updating files: 42% (5400/12857) Updating files: 43% (5529/12857) Updating files: 44% (5658/12857) Updating files: 44% (5765/12857) Updating files: 45% (5786/12857) Updating files: 46% (5915/12857) Updating files: 47% (6043/12857) Updating files: 47% (6169/12857) Updating files: 48% (6172/12857) Updating files: 49% (6300/12857) Updating files: 49% (6324/12857) Updating files: 49% (6330/12857) Updating files: 50% (6429/12857) Updating files: 51% (6558/12857) Updating files: 52% (6686/12857) Updating files: 52% (6708/12857) Updating files: 53% (6815/12857) Updating files: 54% (6943/12857) Updating files: 55% (7072/12857) Updating files: 56% (7200/12857) Updating files: 56% (7246/12857) Updating files: 57% (7329/12857) Updating files: 58% (7458/12857) Updating files: 59% (7586/12857) Updating files: 59% (7635/12857) Updating files: 60% (7715/12857) Updating files: 61% (7843/12857) Updating files: 62% (7972/12857) Updating files: 62% (8002/12857) Updating files: 63% (8100/12857) Updating files: 64% (8229/12857) Updating files: 64% (8291/12857) Updating files: 65% (8358/12857) Updating files: 66% (8486/12857) Updating files: 66% (8596/12857) Updating files: 67% (8615/12857) Updating files: 68% (8743/12857) Updating files: 69% (8872/12857) Updating files: 69% (8942/12857) Updating files: 70% (9000/12857) Updating files: 71% (9129/12857) Updating files: 72% (9258/12857) Updating files: 72% (9378/12857) Updating files: 73% (9386/12857) Updating files: 74% (9515/12857) Updating files: 75% (9643/12857) Updating files: 75% (9712/12857) Updating files: 76% (9772/12857) Updating files: 77% (9900/12857) Updating files: 78% (10029/12857) Updating files: 79% (10158/12857) Updating files: 79% (10219/12857) Updating files: 80% (10286/12857) Updating files: 81% (10415/12857) Updating files: 82% (10543/12857) Updating files: 82% (10641/12857) Updating files: 83% (10672/12857) Updating files: 84% (10800/12857) Updating files: 85% (10929/12857) Updating files: 85% (11035/12857) Updating files: 86% (11058/12857) Updating files: 87% (11186/12857) Updating files: 88% (11315/12857) Updating files: 88% (11437/12857) Updating files: 89% (11443/12857) Updating files: 90% (11572/12857) Updating files: 91% (11700/12857) Updating files: 92% (11829/12857) Updating files: 92% (11830/12857) Updating files: 93% (11958/12857) Updating files: 94% (12086/12857) Updating files: 95% (12215/12857) Updating files: 96% (12343/12857) Updating files: 97% (12472/12857) Updating files: 98% (12600/12857) Updating files: 98% (12692/12857) Updating files: 99% (12729/12857) Updating files: 100% (12857/12857) Updating files: 100% (12857/12857), done. 2023-10-25T23:40:10.680 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 204c175eea3 msg: blobhash on entity_name_t causes strange badness... should look into that, but avoid for now 2023-10-25T23:40:10.682 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.1 2023-10-25T23:40:10.740 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:10.741 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 2 -eq 48 ']' 2023-10-25T23:40:10.741 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.2 2023-10-25T23:40:10.741 INFO:tasks.workunit.client.0.smithi081.stdout:v0.2 2023-10-25T23:40:10.742 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.2 2023-10-25T23:40:10.742 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.2 2023-10-25T23:40:11.240 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 2b5f76f48e9 readme 2023-10-25T23:40:11.242 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.2 2023-10-25T23:40:11.391 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:11.391 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 3 -eq 48 ']' 2023-10-25T23:40:11.391 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.3 2023-10-25T23:40:11.391 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.3 2023-10-25T23:40:11.392 INFO:tasks.workunit.client.0.smithi081.stdout:v0.3 2023-10-25T23:40:11.392 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.3 2023-10-25T23:40:12.008 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 2e986fe9ddf include ceph.spec in configure.ac 2023-10-25T23:40:12.011 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.3 2023-10-25T23:40:12.371 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:12.372 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 4 -eq 48 ']' 2023-10-25T23:40:12.372 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.4 2023-10-25T23:40:12.372 INFO:tasks.workunit.client.0.smithi081.stdout:v0.4 2023-10-25T23:40:12.373 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.4 2023-10-25T23:40:12.373 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.4 2023-10-25T23:40:13.121 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 13b1bf7c492 kclient: initializing kaddr (merge fix) 2023-10-25T23:40:13.124 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.4 2023-10-25T23:40:13.429 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:13.429 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 5 -eq 48 ']' 2023-10-25T23:40:13.429 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.5 2023-10-25T23:40:13.430 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.5 2023-10-25T23:40:13.430 INFO:tasks.workunit.client.0.smithi081.stdout:v0.5 2023-10-25T23:40:13.430 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.5 2023-10-25T23:40:14.124 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 1dd420957f9 journal: detect size of raw block devices properly 2023-10-25T23:40:14.126 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.5 2023-10-25T23:40:14.324 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:14.324 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 6 -eq 48 ']' 2023-10-25T23:40:14.325 INFO:tasks.workunit.client.0.smithi081.stdout:v0.6 2023-10-25T23:40:14.325 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.6 2023-10-25T23:40:14.325 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.6 2023-10-25T23:40:14.325 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.6 2023-10-25T23:40:19.022 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 34% (78/227) Updating files: 35% (80/227) Updating files: 36% (82/227) Updating files: 37% (84/227) Updating files: 38% (87/227) Updating files: 39% (89/227) Updating files: 40% (91/227) Updating files: 41% (94/227) Updating files: 42% (96/227) Updating files: 43% (98/227) Updating files: 44% (100/227) Updating files: 45% (103/227) Updating files: 46% (105/227) Updating files: 47% (107/227) Updating files: 48% (109/227) Updating files: 49% (112/227) Updating files: 50% (114/227) Updating files: 51% (116/227) Updating files: 52% (119/227) Updating files: 53% (121/227) Updating files: 54% (123/227) Updating files: 55% (125/227) Updating files: 56% (128/227) Updating files: 57% (130/227) Updating files: 58% (132/227) Updating files: 59% (134/227) Updating files: 60% (137/227) Updating files: 61% (139/227) Updating files: 62% (141/227) Updating files: 63% (144/227) Updating files: 64% (146/227) Updating files: 65% (148/227) Updating files: 66% (150/227) Updating files: 67% (153/227) Updating files: 68% (155/227) Updating files: 69% (157/227) Updating files: 70% (159/227) Updating files: 71% (162/227) Updating files: 72% (164/227) Updating files: 73% (166/227) Updating files: 74% (168/227) Updating files: 75% (171/227) Updating files: 76% (173/227) Updating files: 77% (175/227) Updating files: 78% (178/227) Updating files: 79% (180/227) Updating files: 80% (182/227) Updating files: 81% (184/227) Updating files: 82% (187/227) Updating files: 83% (189/227) Updating files: 84% (191/227) Updating files: 85% (193/227) Updating files: 86% (196/227) Updating files: 87% (198/227) Updating files: 88% (200/227) Updating files: 89% (203/227) Updating files: 90% (205/227) Updating files: 91% (207/227) Updating files: 92% (209/227) Updating files: 93% (212/227) Updating files: 94% (214/227) Updating files: 95% (216/227) Updating files: 96% (218/227) Updating files: 97% (221/227) Updating files: 98% (223/227) Updating files: 99% (225/227) Updating files: 100% (227/227) Updating files: 100% (227/227), done. 2023-10-25T23:40:19.035 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at a4c752df713 v0.6 2023-10-25T23:40:19.038 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.6 2023-10-25T23:40:19.352 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:19.353 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 7 -eq 48 ']' 2023-10-25T23:40:19.353 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.7 2023-10-25T23:40:19.353 INFO:tasks.workunit.client.0.smithi081.stdout:v0.7 2023-10-25T23:40:19.354 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.7 2023-10-25T23:40:19.354 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.7 2023-10-25T23:40:19.970 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at c46e1b320c6 mkcephfs: btrfsctl -a between mkfs and mount 2023-10-25T23:40:19.972 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.7 2023-10-25T23:40:20.111 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:20.111 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 8 -eq 48 ']' 2023-10-25T23:40:20.111 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.8 2023-10-25T23:40:20.111 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.8 2023-10-25T23:40:20.112 INFO:tasks.workunit.client.0.smithi081.stdout:v0.8 2023-10-25T23:40:20.112 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.8 2023-10-25T23:40:20.633 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 284161c00ab kclient: kill dput/d_drop debug cruft 2023-10-25T23:40:20.635 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.8 2023-10-25T23:40:20.852 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:20.853 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 9 -eq 48 ']' 2023-10-25T23:40:20.853 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.9 2023-10-25T23:40:20.853 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.9 2023-10-25T23:40:20.854 INFO:tasks.workunit.client.0.smithi081.stdout:v0.9 2023-10-25T23:40:20.854 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.9 2023-10-25T23:40:21.317 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 41481853924 kclient: strip out kernel version compatibility cruft 2023-10-25T23:40:21.318 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.9 2023-10-25T23:40:21.491 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:21.492 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 10 -eq 48 ']' 2023-10-25T23:40:21.492 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.10 2023-10-25T23:40:21.492 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.10 2023-10-25T23:40:21.493 INFO:tasks.workunit.client.0.smithi081.stdout:v0.10 2023-10-25T23:40:21.493 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.10 2023-10-25T23:40:21.919 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 007313fe844 v0.10 2023-10-25T23:40:21.921 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.10 2023-10-25T23:40:22.015 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:22.016 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 11 -eq 48 ']' 2023-10-25T23:40:22.016 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.11 2023-10-25T23:40:22.016 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.11 2023-10-25T23:40:22.016 INFO:tasks.workunit.client.0.smithi081.stdout:v0.11 2023-10-25T23:40:22.017 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.11 2023-10-25T23:40:22.248 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 9fa6f5e7d09 v0.11 2023-10-25T23:40:22.249 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.11 2023-10-25T23:40:22.306 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:22.306 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 12 -eq 48 ']' 2023-10-25T23:40:22.306 INFO:tasks.workunit.client.0.smithi081.stdout:v0.12 2023-10-25T23:40:22.307 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.12 2023-10-25T23:40:22.307 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.12 2023-10-25T23:40:22.307 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.12 2023-10-25T23:40:22.516 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at f524150822a v0.12 2023-10-25T23:40:22.517 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.12 2023-10-25T23:40:22.591 INFO:tasks.workunit.client.0.smithi081.stdout:v0.13 2023-10-25T23:40:22.591 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:22.592 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 13 -eq 48 ']' 2023-10-25T23:40:22.592 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.13 2023-10-25T23:40:22.592 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.13 2023-10-25T23:40:22.592 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.13 2023-10-25T23:40:22.910 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 2b32297267d v0.13 2023-10-25T23:40:22.912 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.13 2023-10-25T23:40:23.052 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:23.052 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 14 -eq 48 ']' 2023-10-25T23:40:23.052 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.14 2023-10-25T23:40:23.052 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.14 2023-10-25T23:40:23.053 INFO:tasks.workunit.client.0.smithi081.stdout:v0.14 2023-10-25T23:40:23.053 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.14 2023-10-25T23:40:23.434 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 1ec1e8d6fb6 v0.14 2023-10-25T23:40:23.436 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.14 2023-10-25T23:40:23.540 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:23.540 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 15 -eq 48 ']' 2023-10-25T23:40:23.540 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.15 2023-10-25T23:40:23.540 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.15 2023-10-25T23:40:23.541 INFO:tasks.workunit.client.0.smithi081.stdout:v0.15 2023-10-25T23:40:23.541 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.15 2023-10-25T23:40:24.365 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at ab3c421eb95 v0.15 2023-10-25T23:40:24.366 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.15 2023-10-25T23:40:24.535 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:24.536 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 16 -eq 48 ']' 2023-10-25T23:40:24.536 INFO:tasks.workunit.client.0.smithi081.stdout:v0.16 2023-10-25T23:40:24.537 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.16 2023-10-25T23:40:24.537 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.16 2023-10-25T23:40:24.537 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.16 2023-10-25T23:40:24.906 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 38dbaa5175c v0.16 2023-10-25T23:40:24.907 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.16 2023-10-25T23:40:24.986 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:24.987 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 17 -eq 48 ']' 2023-10-25T23:40:24.987 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.17 2023-10-25T23:40:24.987 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.17 2023-10-25T23:40:24.988 INFO:tasks.workunit.client.0.smithi081.stdout:v0.17 2023-10-25T23:40:24.988 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.17 2023-10-25T23:40:25.526 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at dac3a8c35fb v0.17 2023-10-25T23:40:25.528 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.17 2023-10-25T23:40:25.631 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:25.631 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 18 -eq 48 ']' 2023-10-25T23:40:25.632 INFO:tasks.workunit.client.0.smithi081.stdout:v0.18 2023-10-25T23:40:25.632 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.18 2023-10-25T23:40:25.633 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.18 2023-10-25T23:40:25.633 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.18 2023-10-25T23:40:27.748 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 44% (348/779) Updating files: 45% (351/779) Updating files: 46% (359/779) Updating files: 47% (367/779) Updating files: 48% (374/779) Updating files: 49% (382/779) Updating files: 50% (390/779) Updating files: 51% (398/779) Updating files: 52% (406/779) Updating files: 53% (413/779) Updating files: 54% (421/779) Updating files: 55% (429/779) Updating files: 56% (437/779) Updating files: 57% (445/779) Updating files: 58% (452/779) Updating files: 59% (460/779) Updating files: 60% (468/779) Updating files: 61% (476/779) Updating files: 62% (483/779) Updating files: 63% (491/779) Updating files: 64% (499/779) Updating files: 65% (507/779) Updating files: 66% (515/779) Updating files: 67% (522/779) Updating files: 68% (530/779) Updating files: 69% (538/779) Updating files: 70% (546/779) Updating files: 71% (554/779) Updating files: 72% (561/779) Updating files: 73% (569/779) Updating files: 74% (577/779) Updating files: 75% (585/779) Updating files: 76% (593/779) Updating files: 77% (600/779) Updating files: 78% (608/779) Updating files: 79% (616/779) Updating files: 80% (624/779) Updating files: 81% (631/779) Updating files: 82% (639/779) Updating files: 83% (647/779) Updating files: 84% (655/779) Updating files: 85% (663/779) Updating files: 86% (670/779) Updating files: 87% (678/779) Updating files: 88% (686/779) Updating files: 89% (694/779) Updating files: 90% (702/779) Updating files: 91% (709/779) Updating files: 92% (717/779) Updating files: 92% (718/779) Updating files: 93% (725/779) Updating files: 94% (733/779) Updating files: 95% (741/779) Updating files: 96% (748/779) Updating files: 97% (756/779) Updating files: 98% (764/779) Updating files: 99% (772/779) Updating files: 100% (779/779) Updating files: 100% (779/779), done. 2023-10-25T23:40:27.768 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 2f10137986a v0.18 2023-10-25T23:40:27.770 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.18 2023-10-25T23:40:27.971 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:27.971 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 19 -eq 48 ']' 2023-10-25T23:40:27.971 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.19 2023-10-25T23:40:27.972 INFO:tasks.workunit.client.0.smithi081.stdout:v0.19 2023-10-25T23:40:27.972 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.19 2023-10-25T23:40:27.973 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.19 2023-10-25T23:40:28.554 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 98f5be53f85 v0.19 2023-10-25T23:40:28.555 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.19 2023-10-25T23:40:28.698 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:28.699 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 20 -eq 48 ']' 2023-10-25T23:40:28.699 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.20 2023-10-25T23:40:28.699 INFO:tasks.workunit.client.0.smithi081.stdout:v0.20 2023-10-25T23:40:28.700 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.20 2023-10-25T23:40:28.700 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.20 2023-10-25T23:40:29.306 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 266d2076b6c debian: fix up debian scripts 2023-10-25T23:40:29.307 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.20 2023-10-25T23:40:30.527 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:30.528 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 21 -eq 48 ']' 2023-10-25T23:40:30.528 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.21 2023-10-25T23:40:30.528 INFO:tasks.workunit.client.0.smithi081.stdout:v0.21 2023-10-25T23:40:30.529 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.21 2023-10-25T23:40:30.529 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.21 2023-10-25T23:40:37.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:40:37.998 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:40:38.212 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 60% (325/537) Updating files: 61% (328/537) Updating files: 62% (333/537) Updating files: 63% (339/537) Updating files: 64% (344/537) Updating files: 65% (350/537) Updating files: 66% (355/537) Updating files: 67% (360/537) Updating files: 68% (366/537) Updating files: 69% (371/537) Updating files: 70% (376/537) Updating files: 71% (382/537) Updating files: 72% (387/537) Updating files: 73% (393/537) Updating files: 74% (398/537) Updating files: 75% (403/537) Updating files: 76% (409/537) Updating files: 77% (414/537) Updating files: 78% (419/537) Updating files: 79% (425/537) Updating files: 80% (430/537) Updating files: 81% (435/537) Updating files: 82% (441/537) Updating files: 83% (446/537) Updating files: 84% (452/537) Updating files: 85% (457/537) Updating files: 86% (462/537) Updating files: 87% (468/537) Updating files: 88% (473/537) Updating files: 89% (478/537) Updating files: 90% (484/537) Updating files: 91% (489/537) Updating files: 92% (495/537) Updating files: 93% (500/537) Updating files: 94% (505/537) Updating files: 95% (511/537) Updating files: 96% (516/537) Updating files: 97% (521/537) Updating files: 98% (527/537) Updating files: 99% (532/537) Updating files: 100% (537/537) Updating files: 100% (537/537), done. 2023-10-25T23:40:38.224 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 090436f56ac v0.21 2023-10-25T23:40:38.227 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.21 2023-10-25T23:40:38.349 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:38.349 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 22 -eq 48 ']' 2023-10-25T23:40:38.350 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.22 2023-10-25T23:40:38.350 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.22 2023-10-25T23:40:38.351 INFO:tasks.workunit.client.0.smithi081.stdout:v0.22 2023-10-25T23:40:38.351 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.22 2023-10-25T23:40:38.972 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 8a7c95f60ad v0.22 2023-10-25T23:40:38.974 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.22 2023-10-25T23:40:39.105 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:39.105 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 23 -eq 48 ']' 2023-10-25T23:40:39.106 INFO:tasks.workunit.client.0.smithi081.stdout:v0.23 2023-10-25T23:40:39.106 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.23 2023-10-25T23:40:39.107 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.23 2023-10-25T23:40:39.107 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.23 2023-10-25T23:40:39.518 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 5d1d8d0c460 v0.23 2023-10-25T23:40:39.520 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.23 2023-10-25T23:40:39.779 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:39.779 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 24 -eq 48 ']' 2023-10-25T23:40:39.779 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.24 2023-10-25T23:40:39.780 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.24 2023-10-25T23:40:39.780 INFO:tasks.workunit.client.0.smithi081.stdout:v0.24 2023-10-25T23:40:39.781 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.24 2023-10-25T23:40:40.313 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 180a4176035 v0.24 2023-10-25T23:40:40.314 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.24 2023-10-25T23:40:40.442 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:40.443 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 25 -eq 48 ']' 2023-10-25T23:40:40.443 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.25 2023-10-25T23:40:40.443 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.25 2023-10-25T23:40:40.444 INFO:tasks.workunit.client.0.smithi081.stdout:v0.25 2023-10-25T23:40:40.444 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.25 2023-10-25T23:40:41.666 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 82% (511/622) Updating files: 83% (517/622) Updating files: 84% (523/622) Updating files: 85% (529/622) Updating files: 86% (535/622) Updating files: 87% (542/622) Updating files: 88% (548/622) Updating files: 89% (554/622) Updating files: 90% (560/622) Updating files: 91% (567/622) Updating files: 92% (573/622) Updating files: 93% (579/622) Updating files: 94% (585/622) Updating files: 95% (591/622) Updating files: 96% (598/622) Updating files: 97% (604/622) Updating files: 98% (610/622) Updating files: 99% (616/622) Updating files: 100% (622/622) Updating files: 100% (622/622), done. 2023-10-25T23:40:41.693 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 3fa121bf0a8 v0.25 2023-10-25T23:40:41.696 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.25 2023-10-25T23:40:41.897 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:41.897 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 26 -eq 48 ']' 2023-10-25T23:40:41.898 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.26 2023-10-25T23:40:41.898 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.26 2023-10-25T23:40:41.898 INFO:tasks.workunit.client.0.smithi081.stdout:v0.26 2023-10-25T23:40:41.899 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.26 2023-10-25T23:40:42.721 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 9981ff90968 v0.26 2023-10-25T23:40:42.723 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.26 2023-10-25T23:40:42.763 INFO:tasks.workunit.client.0.smithi081.stdout:v0.27 2023-10-25T23:40:42.764 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:42.764 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 27 -eq 48 ']' 2023-10-25T23:40:42.764 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.27 2023-10-25T23:40:42.765 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.27 2023-10-25T23:40:42.765 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.27 2023-10-25T23:40:43.513 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 793034c62c8 v0.27 2023-10-25T23:40:43.515 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.27 2023-10-25T23:40:43.664 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:43.665 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 28 -eq 48 ']' 2023-10-25T23:40:43.665 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.28 2023-10-25T23:40:43.665 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.28 2023-10-25T23:40:43.665 INFO:tasks.workunit.client.0.smithi081.stdout:v0.28 2023-10-25T23:40:43.666 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.28 2023-10-25T23:40:44.343 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 071881d7e55 v0.28 2023-10-25T23:40:44.345 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.28 2023-10-25T23:40:44.526 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:44.527 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 29 -eq 48 ']' 2023-10-25T23:40:44.527 INFO:tasks.workunit.client.0.smithi081.stdout:v0.29 2023-10-25T23:40:44.528 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.29 2023-10-25T23:40:44.528 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.29 2023-10-25T23:40:44.528 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.29 2023-10-25T23:40:44.974 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 8e69c39f699 v0.29 2023-10-25T23:40:44.975 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.29 2023-10-25T23:40:45.150 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:45.150 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 30 -eq 48 ']' 2023-10-25T23:40:45.150 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.30 2023-10-25T23:40:45.150 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.30 2023-10-25T23:40:45.151 INFO:tasks.workunit.client.0.smithi081.stdout:v0.30 2023-10-25T23:40:45.151 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.30 2023-10-25T23:40:46.751 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 84% (241/285) Updating files: 85% (243/285) Updating files: 86% (246/285) Updating files: 87% (248/285) Updating files: 88% (251/285) Updating files: 89% (254/285) Updating files: 90% (257/285) Updating files: 91% (260/285) Updating files: 92% (263/285) Updating files: 93% (266/285) Updating files: 94% (268/285) Updating files: 95% (271/285) Updating files: 96% (274/285) Updating files: 97% (277/285) Updating files: 98% (280/285) Updating files: 99% (283/285) Updating files: 100% (285/285) Updating files: 100% (285/285), done. 2023-10-25T23:40:46.781 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 64b1b2c70f0 v0.30 2023-10-25T23:40:46.783 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.30 2023-10-25T23:40:46.924 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:46.924 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 31 -eq 48 ']' 2023-10-25T23:40:46.925 INFO:tasks.workunit.client.0.smithi081.stdout:v0.31 2023-10-25T23:40:46.925 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.31 2023-10-25T23:40:46.926 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.31 2023-10-25T23:40:46.926 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.31 2023-10-25T23:40:48.142 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 81% (326/398) Updating files: 82% (327/398) Updating files: 83% (331/398) Updating files: 84% (335/398) Updating files: 85% (339/398) Updating files: 86% (343/398) Updating files: 87% (347/398) Updating files: 88% (351/398) Updating files: 89% (355/398) Updating files: 90% (359/398) Updating files: 91% (363/398) Updating files: 92% (367/398) Updating files: 93% (371/398) Updating files: 94% (375/398) Updating files: 95% (379/398) Updating files: 96% (383/398) Updating files: 97% (387/398) Updating files: 98% (391/398) Updating files: 99% (395/398) Updating files: 100% (398/398) Updating files: 100% (398/398), done. 2023-10-25T23:40:48.162 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 9019c6ce640 v0.31 2023-10-25T23:40:48.164 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.31 2023-10-25T23:40:48.327 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:48.328 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 32 -eq 48 ']' 2023-10-25T23:40:48.328 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.32 2023-10-25T23:40:48.328 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.32 2023-10-25T23:40:48.329 INFO:tasks.workunit.client.0.smithi081.stdout:v0.32 2023-10-25T23:40:48.329 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.32 2023-10-25T23:40:48.900 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at c08d08baa6a v0.32 2023-10-25T23:40:48.902 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.32 2023-10-25T23:40:49.022 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:49.023 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 33 -eq 48 ']' 2023-10-25T23:40:49.023 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.33 2023-10-25T23:40:49.023 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.33 2023-10-25T23:40:49.023 INFO:tasks.workunit.client.0.smithi081.stdout:v0.33 2023-10-25T23:40:49.024 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.33 2023-10-25T23:40:49.453 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 340b4348bf6 v0.33 2023-10-25T23:40:49.454 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.33 2023-10-25T23:40:49.584 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:49.585 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 34 -eq 48 ']' 2023-10-25T23:40:49.585 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.34 2023-10-25T23:40:49.585 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.34 2023-10-25T23:40:49.585 INFO:tasks.workunit.client.0.smithi081.stdout:v0.34 2023-10-25T23:40:49.586 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.34 2023-10-25T23:40:49.918 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 2f039eeeb74 v0.34 2023-10-25T23:40:49.920 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.34 2023-10-25T23:40:50.061 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:50.062 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 35 -eq 48 ']' 2023-10-25T23:40:50.062 INFO:tasks.workunit.client.0.smithi081.stdout:v0.35 2023-10-25T23:40:50.063 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.35 2023-10-25T23:40:50.063 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.35 2023-10-25T23:40:50.063 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.35 2023-10-25T23:40:50.865 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 0afda378124 v0.35 2023-10-25T23:40:50.867 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.35 2023-10-25T23:40:51.022 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:40:51.022 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 36 -eq 48 ']' 2023-10-25T23:40:51.023 INFO:tasks.workunit.client.0.smithi081.stdout:v0.36 2023-10-25T23:40:51.023 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.36 2023-10-25T23:40:51.023 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.36 2023-10-25T23:40:51.023 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.36 2023-10-25T23:41:06.371 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 56% (139/244) Updating files: 57% (140/244) Updating files: 58% (142/244) Updating files: 59% (144/244) Updating files: 60% (147/244) Updating files: 61% (149/244) Updating files: 62% (152/244) Updating files: 63% (154/244) Updating files: 64% (157/244) Updating files: 65% (159/244) Updating files: 66% (162/244) Updating files: 67% (164/244) Updating files: 68% (166/244) Updating files: 69% (169/244) Updating files: 70% (171/244) Updating files: 71% (174/244) Updating files: 72% (176/244) Updating files: 73% (179/244) Updating files: 74% (181/244) Updating files: 75% (183/244) Updating files: 76% (186/244) Updating files: 77% (188/244) Updating files: 78% (191/244) Updating files: 79% (193/244) Updating files: 80% (196/244) Updating files: 81% (198/244) Updating files: 82% (201/244) Updating files: 83% (203/244) Updating files: 84% (205/244) Updating files: 85% (208/244) Updating files: 86% (210/244) Updating files: 87% (213/244) Updating files: 88% (215/244) Updating files: 89% (218/244) Updating files: 90% (220/244) Updating files: 91% (223/244) Updating files: 92% (225/244) Updating files: 93% (227/244) Updating files: 94% (230/244) Updating files: 95% (232/244) Updating files: 96% (235/244) Updating files: 97% (237/244) Updating files: 98% (240/244) Updating files: 99% (242/244) Updating files: 100% (244/244) Updating files: 100% (244/244), done. 2023-10-25T23:41:06.395 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 877cacbbdbb v0.36 2023-10-25T23:41:06.396 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.36 2023-10-25T23:41:06.671 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:06.671 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 37 -eq 48 ']' 2023-10-25T23:41:06.671 INFO:tasks.workunit.client.0.smithi081.stdout:v0.37 2023-10-25T23:41:06.672 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.37 2023-10-25T23:41:06.672 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.37 2023-10-25T23:41:06.672 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.37 2023-10-25T23:41:07.903 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 79% (144/181) Updating files: 80% (145/181) Updating files: 81% (147/181) Updating files: 82% (149/181) Updating files: 83% (151/181) Updating files: 84% (153/181) Updating files: 85% (154/181) Updating files: 86% (156/181) Updating files: 87% (158/181) Updating files: 88% (160/181) Updating files: 89% (162/181) Updating files: 90% (163/181) Updating files: 91% (165/181) Updating files: 92% (167/181) Updating files: 93% (169/181) Updating files: 94% (171/181) Updating files: 95% (172/181) Updating files: 96% (174/181) Updating files: 97% (176/181) Updating files: 98% (178/181) Updating files: 99% (180/181) Updating files: 100% (181/181) Updating files: 100% (181/181), done. 2023-10-25T23:41:07.937 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at a6f3bbb744a v0.37 2023-10-25T23:41:07.938 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.37 2023-10-25T23:41:08.045 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:08.046 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 38 -eq 48 ']' 2023-10-25T23:41:08.046 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.38 2023-10-25T23:41:08.046 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.38 2023-10-25T23:41:08.047 INFO:tasks.workunit.client.0.smithi081.stdout:v0.38 2023-10-25T23:41:08.047 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.38 2023-10-25T23:41:08.113 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:41:08.116 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:41:08.585 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at b600ec2ac7c v0.38 2023-10-25T23:41:08.587 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.38 2023-10-25T23:41:08.712 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:08.713 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 39 -eq 48 ']' 2023-10-25T23:41:08.713 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.39 2023-10-25T23:41:08.713 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.39 2023-10-25T23:41:08.714 INFO:tasks.workunit.client.0.smithi081.stdout:v0.39 2023-10-25T23:41:08.714 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.39 2023-10-25T23:41:09.502 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 321ecdaba2c v0.39 2023-10-25T23:41:09.503 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.39 2023-10-25T23:41:09.680 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:09.680 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 40 -eq 48 ']' 2023-10-25T23:41:09.681 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.40 2023-10-25T23:41:09.681 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.40 2023-10-25T23:41:09.681 INFO:tasks.workunit.client.0.smithi081.stdout:v0.40 2023-10-25T23:41:09.682 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.40 2023-10-25T23:41:10.376 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 7eea40ea37f v0.40 2023-10-25T23:41:10.377 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.40 2023-10-25T23:41:10.488 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:10.488 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 41 -eq 48 ']' 2023-10-25T23:41:10.488 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.41 2023-10-25T23:41:10.489 INFO:tasks.workunit.client.0.smithi081.stdout:v0.41 2023-10-25T23:41:10.489 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.41 2023-10-25T23:41:10.489 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.41 2023-10-25T23:41:10.772 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at c1345f7136a v0.41 2023-10-25T23:41:10.773 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.41 2023-10-25T23:41:10.858 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:10.859 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 42 -eq 48 ']' 2023-10-25T23:41:10.859 INFO:tasks.workunit.client.0.smithi081.stdout:v0.42 2023-10-25T23:41:10.860 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.42 2023-10-25T23:41:10.860 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.42 2023-10-25T23:41:10.860 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.42 2023-10-25T23:41:11.665 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at b205c64c687 v0.42 2023-10-25T23:41:11.666 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.42 2023-10-25T23:41:11.807 INFO:tasks.workunit.client.0.smithi081.stdout:v0.43 2023-10-25T23:41:11.807 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:11.808 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 43 -eq 48 ']' 2023-10-25T23:41:11.808 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.43 2023-10-25T23:41:11.808 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.43 2023-10-25T23:41:11.808 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.43 2023-10-25T23:41:15.601 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 2% (3/111) Updating files: 3% (4/111) Updating files: 4% (5/111) Updating files: 5% (6/111) Updating files: 6% (7/111) Updating files: 7% (8/111) Updating files: 8% (9/111) Updating files: 9% (10/111) Updating files: 10% (12/111) Updating files: 11% (13/111) Updating files: 12% (14/111) Updating files: 13% (15/111) Updating files: 14% (16/111) Updating files: 15% (17/111) Updating files: 16% (18/111) Updating files: 17% (19/111) Updating files: 18% (20/111) Updating files: 19% (22/111) Updating files: 20% (23/111) Updating files: 21% (24/111) Updating files: 22% (25/111) Updating files: 23% (26/111) Updating files: 24% (27/111) Updating files: 25% (28/111) Updating files: 26% (29/111) Updating files: 27% (30/111) Updating files: 28% (32/111) Updating files: 29% (33/111) Updating files: 30% (34/111) Updating files: 31% (35/111) Updating files: 32% (36/111) Updating files: 33% (37/111) Updating files: 34% (38/111) Updating files: 35% (39/111) Updating files: 36% (40/111) Updating files: 37% (42/111) Updating files: 38% (43/111) Updating files: 39% (44/111) Updating files: 40% (45/111) Updating files: 41% (46/111) Updating files: 42% (47/111) Updating files: 43% (48/111) Updating files: 44% (49/111) Updating files: 45% (50/111) Updating files: 46% (52/111) Updating files: 47% (53/111) Updating files: 48% (54/111) Updating files: 49% (55/111) Updating files: 50% (56/111) Updating files: 51% (57/111) Updating files: 52% (58/111) Updating files: 53% (59/111) Updating files: 54% (60/111) Updating files: 55% (62/111) Updating files: 56% (63/111) Updating files: 57% (64/111) Updating files: 58% (65/111) Updating files: 59% (66/111) Updating files: 60% (67/111) Updating files: 61% (68/111) Updating files: 62% (69/111) Updating files: 63% (70/111) Updating files: 64% (72/111) Updating files: 65% (73/111) Updating files: 66% (74/111) Updating files: 67% (75/111) Updating files: 68% (76/111) Updating files: 69% (77/111) Updating files: 70% (78/111) Updating files: 71% (79/111) Updating files: 72% (80/111) Updating files: 73% (82/111) Updating files: 74% (83/111) Updating files: 75% (84/111) Updating files: 76% (85/111) Updating files: 77% (86/111) Updating files: 78% (87/111) Updating files: 79% (88/111) Updating files: 80% (89/111) Updating files: 81% (90/111) Updating files: 82% (92/111) Updating files: 83% (93/111) Updating files: 84% (94/111) Updating files: 85% (95/111) Updating files: 86% (96/111) Updating files: 87% (97/111) Updating files: 88% (98/111) Updating files: 89% (99/111) Updating files: 90% (100/111) Updating files: 91% (102/111) Updating files: 92% (103/111) Updating files: 93% (104/111) Updating files: 94% (105/111) Updating files: 95% (106/111) Updating files: 96% (107/111) Updating files: 97% (108/111) Updating files: 98% (109/111) Updating files: 99% (110/111) Updating files: 100% (111/111) Updating files: 100% (111/111), done. 2023-10-25T23:41:15.625 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 9fa8781c014 v0.43 2023-10-25T23:41:15.626 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.43 2023-10-25T23:41:15.806 INFO:tasks.workunit.client.0.smithi081.stdout:v0.44 2023-10-25T23:41:15.806 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:15.807 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 44 -eq 48 ']' 2023-10-25T23:41:15.807 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.44 2023-10-25T23:41:15.807 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.44 2023-10-25T23:41:15.807 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.44 2023-10-25T23:41:16.461 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at cdd5298d276 v0.44 2023-10-25T23:41:16.462 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.44 2023-10-25T23:41:16.594 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:16.595 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 45 -eq 48 ']' 2023-10-25T23:41:16.595 INFO:tasks.workunit.client.0.smithi081.stdout:v0.45 2023-10-25T23:41:16.595 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.45 2023-10-25T23:41:16.596 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.45 2023-10-25T23:41:16.596 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.45 2023-10-25T23:41:17.344 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 0aea1cb1df5 v0.45 2023-10-25T23:41:17.345 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.45 2023-10-25T23:41:17.387 INFO:tasks.workunit.client.0.smithi081.stdout:v0.46 2023-10-25T23:41:17.388 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:17.388 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 46 -eq 48 ']' 2023-10-25T23:41:17.388 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.46 2023-10-25T23:41:17.388 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.46 2023-10-25T23:41:17.389 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.46 2023-10-25T23:41:18.342 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at cb7f1c9c752 v0.46 2023-10-25T23:41:18.343 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.46 2023-10-25T23:41:18.484 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:18.484 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 47 -eq 48 ']' 2023-10-25T23:41:18.485 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.47 2023-10-25T23:41:18.485 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.47 2023-10-25T23:41:18.485 INFO:tasks.workunit.client.0.smithi081.stdout:v0.47 2023-10-25T23:41:18.486 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.47 2023-10-25T23:41:19.316 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at ad663d58c89 v0.47 2023-10-25T23:41:19.317 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.47 2023-10-25T23:41:19.447 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:19.448 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 48 -eq 48 ']' 2023-10-25T23:41:19.448 INFO:tasks.workunit.client.0.smithi081.stderr:+ continue 2023-10-25T23:41:19.448 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:19.448 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 49 -eq 48 ']' 2023-10-25T23:41:19.449 INFO:tasks.workunit.client.0.smithi081.stdout:v0.49 2023-10-25T23:41:19.449 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.49 2023-10-25T23:41:19.450 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.49 2023-10-25T23:41:19.450 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.49 2023-10-25T23:41:20.789 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 79% (380/481) Updating files: 80% (385/481) Updating files: 81% (390/481) Updating files: 82% (395/481) Updating files: 83% (400/481) Updating files: 84% (405/481) Updating files: 85% (409/481) Updating files: 86% (414/481) Updating files: 87% (419/481) Updating files: 88% (424/481) Updating files: 89% (429/481) Updating files: 90% (433/481) Updating files: 91% (438/481) Updating files: 92% (443/481) Updating files: 93% (448/481) Updating files: 94% (453/481) Updating files: 95% (457/481) Updating files: 96% (462/481) Updating files: 97% (467/481) Updating files: 98% (472/481) Updating files: 99% (477/481) Updating files: 100% (481/481) Updating files: 100% (481/481), done. 2023-10-25T23:41:20.824 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at ca6265d0f4d v0.49 2023-10-25T23:41:20.826 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.49 2023-10-25T23:41:20.984 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:20.984 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 50 -eq 48 ']' 2023-10-25T23:41:20.985 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.50 2023-10-25T23:41:20.985 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.50 2023-10-25T23:41:20.985 INFO:tasks.workunit.client.0.smithi081.stdout:v0.50 2023-10-25T23:41:20.986 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.50 2023-10-25T23:41:21.428 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at a4428bd0e19 v0.50 2023-10-25T23:41:21.428 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.50 2023-10-25T23:41:21.564 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:21.564 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 51 -eq 48 ']' 2023-10-25T23:41:21.564 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.51 2023-10-25T23:41:21.564 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.51 2023-10-25T23:41:21.565 INFO:tasks.workunit.client.0.smithi081.stdout:v0.51 2023-10-25T23:41:21.565 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.51 2023-10-25T23:41:21.928 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at c03ca95d235 v0.51 2023-10-25T23:41:21.930 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.51 2023-10-25T23:41:22.086 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:22.087 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 52 -eq 48 ']' 2023-10-25T23:41:22.087 INFO:tasks.workunit.client.0.smithi081.stdout:v0.52 2023-10-25T23:41:22.088 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.52 2023-10-25T23:41:22.088 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.52 2023-10-25T23:41:22.088 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.52 2023-10-25T23:41:22.974 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at e48859474c4 v0.52 2023-10-25T23:41:22.974 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.52 2023-10-25T23:41:23.084 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:23.084 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 53 -eq 48 ']' 2023-10-25T23:41:23.084 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.53 2023-10-25T23:41:23.085 INFO:tasks.workunit.client.0.smithi081.stdout:v0.53 2023-10-25T23:41:23.085 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.53 2023-10-25T23:41:23.085 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.53 2023-10-25T23:41:24.882 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 37% (143/386) Updating files: 38% (147/386) Updating files: 39% (151/386) Updating files: 40% (155/386) Updating files: 41% (159/386) Updating files: 42% (163/386) Updating files: 43% (166/386) Updating files: 44% (170/386) Updating files: 45% (174/386) Updating files: 46% (178/386) Updating files: 47% (182/386) Updating files: 48% (186/386) Updating files: 49% (190/386) Updating files: 50% (193/386) Updating files: 51% (197/386) Updating files: 52% (201/386) Updating files: 53% (205/386) Updating files: 54% (209/386) Updating files: 55% (213/386) Updating files: 56% (217/386) Updating files: 57% (221/386) Updating files: 58% (224/386) Updating files: 59% (228/386) Updating files: 60% (232/386) Updating files: 61% (236/386) Updating files: 62% (240/386) Updating files: 63% (244/386) Updating files: 64% (248/386) Updating files: 65% (251/386) Updating files: 66% (255/386) Updating files: 67% (259/386) Updating files: 68% (263/386) Updating files: 69% (267/386) Updating files: 70% (271/386) Updating files: 71% (275/386) Updating files: 72% (278/386) Updating files: 73% (282/386) Updating files: 74% (286/386) Updating files: 75% (290/386) Updating files: 76% (294/386) Updating files: 77% (298/386) Updating files: 78% (302/386) Updating files: 79% (305/386) Updating files: 80% (309/386) Updating files: 81% (313/386) Updating files: 82% (317/386) Updating files: 83% (321/386) Updating files: 84% (325/386) Updating files: 85% (329/386) Updating files: 86% (332/386) Updating files: 87% (336/386) Updating files: 88% (340/386) Updating files: 89% (344/386) Updating files: 90% (348/386) Updating files: 91% (352/386) Updating files: 92% (356/386) Updating files: 93% (359/386) Updating files: 94% (363/386) Updating files: 95% (367/386) Updating files: 96% (371/386) Updating files: 97% (375/386) Updating files: 98% (379/386) Updating files: 99% (383/386) Updating files: 100% (386/386) Updating files: 100% (386/386), done. 2023-10-25T23:41:24.927 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 2528b5ee105 v0.43 2023-10-25T23:41:24.929 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.53 2023-10-25T23:41:25.070 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:25.070 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 54 -eq 48 ']' 2023-10-25T23:41:25.071 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.54 2023-10-25T23:41:25.071 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.54 2023-10-25T23:41:25.071 INFO:tasks.workunit.client.0.smithi081.stdout:v0.54 2023-10-25T23:41:25.072 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.54 2023-10-25T23:41:25.766 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 60b84b095b1 v0.54 2023-10-25T23:41:25.768 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.54 2023-10-25T23:41:25.891 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:25.891 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 55 -eq 48 ']' 2023-10-25T23:41:25.891 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.55 2023-10-25T23:41:25.891 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.55 2023-10-25T23:41:25.892 INFO:tasks.workunit.client.0.smithi081.stdout:v0.55 2023-10-25T23:41:25.892 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.55 2023-10-25T23:41:35.254 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 69% (373/540) Updating files: 70% (378/540) Updating files: 71% (384/540) Updating files: 72% (389/540) Updating files: 73% (395/540) Updating files: 74% (400/540) Updating files: 75% (405/540) Updating files: 76% (411/540) Updating files: 77% (416/540) Updating files: 78% (422/540) Updating files: 79% (427/540) Updating files: 80% (432/540) Updating files: 81% (438/540) Updating files: 81% (440/540) Updating files: 82% (443/540) Updating files: 83% (449/540) Updating files: 84% (454/540) Updating files: 85% (459/540) Updating files: 86% (465/540) Updating files: 87% (470/540) Updating files: 88% (476/540) Updating files: 89% (481/540) Updating files: 90% (486/540) Updating files: 91% (492/540) Updating files: 92% (497/540) Updating files: 93% (503/540) Updating files: 94% (508/540) Updating files: 95% (513/540) Updating files: 96% (519/540) Updating files: 97% (524/540) Updating files: 98% (530/540) Updating files: 99% (535/540) Updating files: 100% (540/540) Updating files: 100% (540/540), done. 2023-10-25T23:41:35.281 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 690f8175606 v0.55 2023-10-25T23:41:35.283 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.55 2023-10-25T23:41:35.423 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:35.423 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 56 -eq 48 ']' 2023-10-25T23:41:35.423 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.56 2023-10-25T23:41:35.424 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.56 2023-10-25T23:41:35.424 INFO:tasks.workunit.client.0.smithi081.stdout:v0.56 2023-10-25T23:41:35.424 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.56 2023-10-25T23:41:36.315 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 1a32f0a0b42 v0.56 2023-10-25T23:41:36.317 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.56 2023-10-25T23:41:36.671 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:36.672 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 57 -eq 48 ']' 2023-10-25T23:41:36.672 INFO:tasks.workunit.client.0.smithi081.stdout:v0.57 2023-10-25T23:41:36.673 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.57 2023-10-25T23:41:36.673 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.57 2023-10-25T23:41:36.673 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.57 2023-10-25T23:41:37.943 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 76% (234/304) Updating files: 77% (235/304) Updating files: 78% (238/304) Updating files: 79% (241/304) Updating files: 80% (244/304) Updating files: 81% (247/304) Updating files: 82% (250/304) Updating files: 83% (253/304) Updating files: 84% (256/304) Updating files: 85% (259/304) Updating files: 86% (262/304) Updating files: 87% (265/304) Updating files: 88% (268/304) Updating files: 89% (271/304) Updating files: 90% (274/304) Updating files: 91% (277/304) Updating files: 92% (280/304) Updating files: 93% (283/304) Updating files: 94% (286/304) Updating files: 95% (289/304) Updating files: 96% (292/304) Updating files: 97% (295/304) Updating files: 98% (298/304) Updating files: 99% (301/304) Updating files: 100% (304/304) Updating files: 100% (304/304), done. 2023-10-25T23:41:37.973 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 9a7a9d06c06 v0.57 2023-10-25T23:41:37.976 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.57 2023-10-25T23:41:38.097 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:38.098 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 58 -eq 48 ']' 2023-10-25T23:41:38.098 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.58 2023-10-25T23:41:38.098 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.58 2023-10-25T23:41:38.099 INFO:tasks.workunit.client.0.smithi081.stdout:v0.58 2023-10-25T23:41:38.099 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.58 2023-10-25T23:41:38.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:41:38.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:41:38.318 INFO:tasks.ceph.mds.a.smithi081.stderr:2023-10-25T23:41:38.317+0000 7f0749bb7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 114512) UID: 0 2023-10-25T23:41:38.318 INFO:tasks.ceph.mds.c.smithi081.stderr:2023-10-25T23:41:38.317+0000 7fd1817f3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 114512) UID: 0 2023-10-25T23:41:39.148 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at ba3f91e7504 v0.58 2023-10-25T23:41:39.150 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.58 2023-10-25T23:41:39.258 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:39.259 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 59 -eq 48 ']' 2023-10-25T23:41:39.259 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.59 2023-10-25T23:41:39.259 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.59 2023-10-25T23:41:39.259 INFO:tasks.workunit.client.0.smithi081.stdout:v0.59 2023-10-25T23:41:39.260 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.59 2023-10-25T23:41:40.011 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at cbae6a435c6 v0.59 2023-10-25T23:41:40.017 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.59 2023-10-25T23:41:40.120 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:40.121 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 60 -eq 48 ']' 2023-10-25T23:41:40.121 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.60 2023-10-25T23:41:40.122 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.60 2023-10-25T23:41:40.122 INFO:tasks.workunit.client.0.smithi081.stdout:v0.60 2023-10-25T23:41:40.122 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.60 2023-10-25T23:41:41.422 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 68% (175/256) Updating files: 69% (177/256) Updating files: 70% (180/256) Updating files: 71% (182/256) Updating files: 72% (185/256) Updating files: 73% (187/256) Updating files: 74% (190/256) Updating files: 75% (192/256) Updating files: 76% (195/256) Updating files: 77% (198/256) Updating files: 78% (200/256) Updating files: 79% (203/256) Updating files: 80% (205/256) Updating files: 81% (208/256) Updating files: 82% (210/256) Updating files: 83% (213/256) Updating files: 84% (216/256) Updating files: 85% (218/256) Updating files: 86% (221/256) Updating files: 87% (223/256) Updating files: 88% (226/256) Updating files: 89% (228/256) Updating files: 90% (231/256) Updating files: 91% (233/256) Updating files: 92% (236/256) Updating files: 93% (239/256) Updating files: 94% (241/256) Updating files: 95% (244/256) Updating files: 96% (246/256) Updating files: 97% (249/256) Updating files: 98% (251/256) Updating files: 99% (254/256) Updating files: 100% (256/256) Updating files: 100% (256/256), done. 2023-10-25T23:41:41.457 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at f26f7a39021 v0.60 2023-10-25T23:41:41.459 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.60 2023-10-25T23:41:41.581 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:41.582 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 61 -eq 48 ']' 2023-10-25T23:41:41.582 INFO:tasks.workunit.client.0.smithi081.stdout:v0.61 2023-10-25T23:41:41.583 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.61 2023-10-25T23:41:41.583 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.61 2023-10-25T23:41:41.583 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.61 2023-10-25T23:41:42.930 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 73% (277/376) Updating files: 74% (279/376) Updating files: 75% (282/376) Updating files: 76% (286/376) Updating files: 77% (290/376) Updating files: 78% (294/376) Updating files: 79% (298/376) Updating files: 80% (301/376) Updating files: 81% (305/376) Updating files: 82% (309/376) Updating files: 83% (313/376) Updating files: 84% (316/376) Updating files: 85% (320/376) Updating files: 86% (324/376) Updating files: 87% (328/376) Updating files: 88% (331/376) Updating files: 89% (335/376) Updating files: 90% (339/376) Updating files: 91% (343/376) Updating files: 92% (346/376) Updating files: 93% (350/376) Updating files: 94% (354/376) Updating files: 95% (358/376) Updating files: 96% (361/376) Updating files: 97% (365/376) Updating files: 98% (369/376) Updating files: 99% (373/376) Updating files: 100% (376/376) Updating files: 100% (376/376), done. 2023-10-25T23:41:42.961 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 237f3f1e8d8 v0.61 2023-10-25T23:41:42.964 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.61 2023-10-25T23:41:43.068 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:43.068 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 62 -eq 48 ']' 2023-10-25T23:41:43.069 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.62 2023-10-25T23:41:43.069 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.62 2023-10-25T23:41:43.070 INFO:tasks.workunit.client.0.smithi081.stdout:v0.62 2023-10-25T23:41:43.070 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.62 2023-10-25T23:41:43.319 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 9382379cc6b v0.62 2023-10-25T23:41:43.320 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.62 2023-10-25T23:41:43.402 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:43.403 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 63 -eq 48 ']' 2023-10-25T23:41:43.403 INFO:tasks.workunit.client.0.smithi081.stdout:v0.63 2023-10-25T23:41:43.404 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.63 2023-10-25T23:41:43.404 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.63 2023-10-25T23:41:43.404 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.63 2023-10-25T23:41:44.007 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 054e96cf79e v0.63 2023-10-25T23:41:44.010 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.63 2023-10-25T23:41:44.132 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:44.132 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 64 -eq 48 ']' 2023-10-25T23:41:44.132 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.64 2023-10-25T23:41:44.132 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.64 2023-10-25T23:41:44.133 INFO:tasks.workunit.client.0.smithi081.stdout:v0.64 2023-10-25T23:41:44.133 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.64 2023-10-25T23:41:44.784 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 42e06c12db6 v0.64 2023-10-25T23:41:44.788 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.64 2023-10-25T23:41:44.864 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:44.864 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 65 -eq 48 ']' 2023-10-25T23:41:44.864 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.65 2023-10-25T23:41:44.864 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.65 2023-10-25T23:41:44.865 INFO:tasks.workunit.client.0.smithi081.stdout:v0.65 2023-10-25T23:41:44.865 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.65 2023-10-25T23:41:46.323 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 97% (197/203) Updating files: 98% (199/203) Updating files: 99% (201/203) Updating files: 100% (203/203) Updating files: 100% (203/203), done. 2023-10-25T23:41:46.364 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at c2d517ef966 v0.65 2023-10-25T23:41:46.368 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.65 2023-10-25T23:41:46.476 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:46.476 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 66 -eq 48 ']' 2023-10-25T23:41:46.476 INFO:tasks.workunit.client.0.smithi081.stdout:v0.66 2023-10-25T23:41:46.477 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.66 2023-10-25T23:41:46.477 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.66 2023-10-25T23:41:46.477 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.66 2023-10-25T23:41:47.087 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at b6b48dbefad v0.66 2023-10-25T23:41:47.090 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.66 2023-10-25T23:41:47.323 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:47.325 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 67 -eq 48 ']' 2023-10-25T23:41:47.325 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.67 2023-10-25T23:41:47.325 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.67 2023-10-25T23:41:47.326 INFO:tasks.workunit.client.0.smithi081.stdout:v0.67 2023-10-25T23:41:47.326 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.67 2023-10-25T23:41:58.915 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 31% (113/355) Updating files: 32% (114/355) Updating files: 33% (118/355) Updating files: 34% (121/355) Updating files: 35% (125/355) Updating files: 36% (128/355) Updating files: 37% (132/355) Updating files: 38% (135/355) Updating files: 39% (139/355) Updating files: 40% (142/355) Updating files: 41% (146/355) Updating files: 42% (150/355) Updating files: 43% (153/355) Updating files: 44% (157/355) Updating files: 45% (160/355) Updating files: 46% (164/355) Updating files: 47% (167/355) Updating files: 48% (171/355) Updating files: 49% (174/355) Updating files: 50% (178/355) Updating files: 51% (182/355) Updating files: 52% (185/355) Updating files: 53% (189/355) Updating files: 54% (192/355) Updating files: 55% (196/355) Updating files: 56% (199/355) Updating files: 57% (203/355) Updating files: 58% (206/355) Updating files: 59% (210/355) Updating files: 60% (213/355) Updating files: 61% (217/355) Updating files: 62% (221/355) Updating files: 63% (224/355) Updating files: 64% (228/355) Updating files: 65% (231/355) Updating files: 66% (235/355) Updating files: 67% (238/355) Updating files: 68% (242/355) Updating files: 69% (245/355) Updating files: 70% (249/355) Updating files: 71% (253/355) Updating files: 72% (256/355) Updating files: 73% (260/355) Updating files: 74% (263/355) Updating files: 75% (267/355) Updating files: 76% (270/355) Updating files: 77% (274/355) Updating files: 78% (277/355) Updating files: 79% (281/355) Updating files: 80% (284/355) Updating files: 81% (288/355) Updating files: 82% (292/355) Updating files: 83% (295/355) Updating files: 84% (299/355) Updating files: 85% (302/355) Updating files: 86% (306/355) Updating files: 87% (309/355) Updating files: 88% (313/355) Updating files: 89% (316/355) Updating files: 90% (320/355) Updating files: 91% (324/355) Updating files: 92% (327/355) Updating files: 93% (331/355) Updating files: 94% (334/355) Updating files: 95% (338/355) Updating files: 96% (341/355) Updating files: 97% (345/355) Updating files: 98% (348/355) Updating files: 99% (352/355) Updating files: 100% (355/355) Updating files: 100% (355/355), done. 2023-10-25T23:41:58.939 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at e3b7bc5bce8 v0.67 2023-10-25T23:41:58.941 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.67 2023-10-25T23:41:59.187 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:41:59.187 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 68 -eq 48 ']' 2023-10-25T23:41:59.188 INFO:tasks.workunit.client.0.smithi081.stdout:v0.68 2023-10-25T23:41:59.188 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.68 2023-10-25T23:41:59.188 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.68 2023-10-25T23:41:59.189 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.68 2023-10-25T23:42:00.351 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 83% (201/241) Updating files: 84% (203/241) Updating files: 85% (205/241) Updating files: 86% (208/241) Updating files: 87% (210/241) Updating files: 88% (213/241) Updating files: 89% (215/241) Updating files: 90% (217/241) Updating files: 91% (220/241) Updating files: 92% (222/241) Updating files: 93% (225/241) Updating files: 94% (227/241) Updating files: 95% (229/241) Updating files: 96% (232/241) Updating files: 97% (234/241) Updating files: 98% (237/241) Updating files: 99% (239/241) Updating files: 100% (241/241) Updating files: 100% (241/241), done. 2023-10-25T23:42:00.400 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at b4cf0f2574b v0.68 2023-10-25T23:42:00.402 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.68 2023-10-25T23:42:00.499 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:00.500 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 69 -eq 48 ']' 2023-10-25T23:42:00.500 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.69 2023-10-25T23:42:00.500 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.69 2023-10-25T23:42:00.501 INFO:tasks.workunit.client.0.smithi081.stdout:v0.69 2023-10-25T23:42:00.501 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.69 2023-10-25T23:42:01.154 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 6ca6f2f9f75 v0.69 2023-10-25T23:42:01.156 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.69 2023-10-25T23:42:01.266 INFO:tasks.workunit.client.0.smithi081.stdout:v0.70 2023-10-25T23:42:01.266 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:01.266 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 70 -eq 48 ']' 2023-10-25T23:42:01.266 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.70 2023-10-25T23:42:01.267 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.70 2023-10-25T23:42:01.267 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.70 2023-10-25T23:42:01.463 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at e3bb0656d92 v0.70 2023-10-25T23:42:01.464 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.70 2023-10-25T23:42:01.539 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:01.539 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 71 -eq 48 ']' 2023-10-25T23:42:01.539 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.71 2023-10-25T23:42:01.540 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.71 2023-10-25T23:42:01.540 INFO:tasks.workunit.client.0.smithi081.stdout:v0.71 2023-10-25T23:42:01.540 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.71 2023-10-25T23:42:03.172 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 65% (265/405) Updating files: 66% (268/405) Updating files: 67% (272/405) Updating files: 68% (276/405) Updating files: 69% (280/405) Updating files: 70% (284/405) Updating files: 71% (288/405) Updating files: 72% (292/405) Updating files: 73% (296/405) Updating files: 74% (300/405) Updating files: 75% (304/405) Updating files: 76% (308/405) Updating files: 77% (312/405) Updating files: 78% (316/405) Updating files: 79% (320/405) Updating files: 80% (324/405) Updating files: 81% (329/405) Updating files: 82% (333/405) Updating files: 83% (337/405) Updating files: 84% (341/405) Updating files: 85% (345/405) Updating files: 86% (349/405) Updating files: 87% (353/405) Updating files: 88% (357/405) Updating files: 89% (361/405) Updating files: 90% (365/405) Updating files: 91% (369/405) Updating files: 92% (373/405) Updating files: 93% (377/405) Updating files: 94% (381/405) Updating files: 95% (385/405) Updating files: 96% (389/405) Updating files: 97% (393/405) Updating files: 98% (397/405) Updating files: 99% (401/405) Updating files: 100% (405/405) Updating files: 100% (405/405), done. 2023-10-25T23:42:03.207 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at e509cb1e69c v0.71 2023-10-25T23:42:03.210 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.71 2023-10-25T23:42:03.342 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:03.342 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 72 -eq 48 ']' 2023-10-25T23:42:03.343 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.72 2023-10-25T23:42:03.343 INFO:tasks.workunit.client.0.smithi081.stdout:v0.72 2023-10-25T23:42:03.343 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.72 2023-10-25T23:42:03.344 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.72 2023-10-25T23:42:04.168 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 5832e2603c7 v0.72 2023-10-25T23:42:04.171 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.72 2023-10-25T23:42:04.290 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:04.291 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 73 -eq 48 ']' 2023-10-25T23:42:04.291 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.73 2023-10-25T23:42:04.291 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.73 2023-10-25T23:42:04.292 INFO:tasks.workunit.client.0.smithi081.stdout:v0.73 2023-10-25T23:42:04.292 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.73 2023-10-25T23:42:04.824 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at d8ad51ee8ab v0.73 2023-10-25T23:42:04.825 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.73 2023-10-25T23:42:04.929 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:04.929 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 74 -eq 48 ']' 2023-10-25T23:42:04.930 INFO:tasks.workunit.client.0.smithi081.stdout:v0.74 2023-10-25T23:42:04.930 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.74 2023-10-25T23:42:04.930 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.74 2023-10-25T23:42:04.930 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.74 2023-10-25T23:42:05.740 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at c165483bc72 v0.74 2023-10-25T23:42:05.742 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.74 2023-10-25T23:42:05.845 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:05.846 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 75 -eq 48 ']' 2023-10-25T23:42:05.846 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.75 2023-10-25T23:42:05.846 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.75 2023-10-25T23:42:05.847 INFO:tasks.workunit.client.0.smithi081.stdout:v0.75 2023-10-25T23:42:05.847 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.75 2023-10-25T23:42:06.965 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 90% (262/291) Updating files: 91% (265/291) Updating files: 92% (268/291) Updating files: 93% (271/291) Updating files: 94% (274/291) Updating files: 95% (277/291) Updating files: 96% (280/291) Updating files: 97% (283/291) Updating files: 98% (286/291) Updating files: 99% (289/291) Updating files: 100% (291/291) Updating files: 100% (291/291), done. 2023-10-25T23:42:07.030 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 946d6036958 v0.75 2023-10-25T23:42:07.034 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.75 2023-10-25T23:42:07.197 INFO:tasks.workunit.client.0.smithi081.stdout:v0.76 2023-10-25T23:42:07.197 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:07.198 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 76 -eq 48 ']' 2023-10-25T23:42:07.198 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.76 2023-10-25T23:42:07.198 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.76 2023-10-25T23:42:07.198 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.76 2023-10-25T23:42:15.401 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 53% (90/168) Updating files: 54% (91/168) Updating files: 55% (93/168) Updating files: 56% (95/168) Updating files: 57% (96/168) Updating files: 58% (98/168) Updating files: 59% (100/168) Updating files: 60% (101/168) Updating files: 61% (103/168) Updating files: 62% (105/168) Updating files: 63% (106/168) Updating files: 64% (108/168) Updating files: 65% (110/168) Updating files: 66% (111/168) Updating files: 67% (113/168) Updating files: 68% (115/168) Updating files: 69% (116/168) Updating files: 70% (118/168) Updating files: 71% (120/168) Updating files: 72% (121/168) Updating files: 73% (123/168) Updating files: 74% (125/168) Updating files: 75% (126/168) Updating files: 76% (128/168) Updating files: 77% (130/168) Updating files: 78% (132/168) Updating files: 79% (133/168) Updating files: 80% (135/168) Updating files: 81% (137/168) Updating files: 82% (138/168) Updating files: 83% (140/168) Updating files: 84% (142/168) Updating files: 85% (143/168) Updating files: 86% (145/168) Updating files: 87% (147/168) Updating files: 88% (148/168) Updating files: 89% (150/168) Updating files: 90% (152/168) Updating files: 91% (153/168) Updating files: 92% (155/168) Updating files: 93% (157/168) Updating files: 94% (158/168) Updating files: 95% (160/168) Updating files: 96% (162/168) Updating files: 97% (163/168) Updating files: 98% (165/168) Updating files: 99% (167/168) Updating files: 100% (168/168) Updating files: 100% (168/168), done. 2023-10-25T23:42:15.437 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 3b990136bfa v0.76 2023-10-25T23:42:15.439 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.76 2023-10-25T23:42:15.544 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:15.544 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 77 -eq 48 ']' 2023-10-25T23:42:15.544 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.77 2023-10-25T23:42:15.544 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.77 2023-10-25T23:42:15.545 INFO:tasks.workunit.client.0.smithi081.stdout:v0.77 2023-10-25T23:42:15.545 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.77 2023-10-25T23:42:16.696 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 87% (260/298) Updating files: 88% (263/298) Updating files: 89% (266/298) Updating files: 90% (269/298) Updating files: 91% (272/298) Updating files: 92% (275/298) Updating files: 93% (278/298) Updating files: 94% (281/298) Updating files: 95% (284/298) Updating files: 96% (287/298) Updating files: 97% (290/298) Updating files: 98% (293/298) Updating files: 99% (296/298) Updating files: 100% (298/298) Updating files: 100% (298/298), done. 2023-10-25T23:42:16.736 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 1bca9c5c412 v0.77 2023-10-25T23:42:16.739 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.77 2023-10-25T23:42:17.090 INFO:tasks.workunit.client.0.smithi081.stdout:v0.78 2023-10-25T23:42:17.091 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:17.091 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 78 -eq 48 ']' 2023-10-25T23:42:17.091 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.78 2023-10-25T23:42:17.092 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.78 2023-10-25T23:42:17.092 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.78 2023-10-25T23:42:19.038 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 50% (249/496) Updating files: 51% (253/496) Updating files: 52% (258/496) Updating files: 53% (263/496) Updating files: 54% (268/496) Updating files: 55% (273/496) Updating files: 56% (278/496) Updating files: 57% (283/496) Updating files: 58% (288/496) Updating files: 59% (293/496) Updating files: 60% (298/496) Updating files: 61% (303/496) Updating files: 62% (308/496) Updating files: 63% (313/496) Updating files: 64% (318/496) Updating files: 65% (323/496) Updating files: 66% (328/496) Updating files: 67% (333/496) Updating files: 68% (338/496) Updating files: 69% (343/496) Updating files: 70% (348/496) Updating files: 71% (353/496) Updating files: 72% (358/496) Updating files: 73% (363/496) Updating files: 74% (368/496) Updating files: 75% (372/496) Updating files: 76% (377/496) Updating files: 77% (382/496) Updating files: 78% (387/496) Updating files: 79% (392/496) Updating files: 80% (397/496) Updating files: 81% (402/496) Updating files: 82% (407/496) Updating files: 83% (412/496) Updating files: 84% (417/496) Updating files: 85% (422/496) Updating files: 86% (427/496) Updating files: 87% (432/496) Updating files: 88% (437/496) Updating files: 89% (442/496) Updating files: 90% (447/496) Updating files: 91% (452/496) Updating files: 92% (457/496) Updating files: 93% (462/496) Updating files: 94% (467/496) Updating files: 95% (472/496) Updating files: 96% (477/496) Updating files: 97% (482/496) Updating files: 98% (487/496) Updating files: 99% (492/496) Updating files: 100% (496/496) Updating files: 100% (496/496), done. 2023-10-25T23:42:19.072 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at f6c746c314d 0.78 2023-10-25T23:42:19.075 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.78 2023-10-25T23:42:19.216 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:19.216 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 79 -eq 48 ']' 2023-10-25T23:42:19.217 INFO:tasks.workunit.client.0.smithi081.stdout:v0.79 2023-10-25T23:42:19.217 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.79 2023-10-25T23:42:19.218 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.79 2023-10-25T23:42:19.218 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.79 2023-10-25T23:42:20.719 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 66% (219/329) Updating files: 67% (221/329) Updating files: 68% (224/329) Updating files: 69% (228/329) Updating files: 70% (231/329) Updating files: 71% (234/329) Updating files: 72% (237/329) Updating files: 73% (241/329) Updating files: 74% (244/329) Updating files: 75% (247/329) Updating files: 76% (251/329) Updating files: 77% (254/329) Updating files: 78% (257/329) Updating files: 79% (260/329) Updating files: 80% (264/329) Updating files: 81% (267/329) Updating files: 82% (270/329) Updating files: 83% (274/329) Updating files: 84% (277/329) Updating files: 85% (280/329) Updating files: 86% (283/329) Updating files: 87% (287/329) Updating files: 88% (290/329) Updating files: 89% (293/329) Updating files: 90% (297/329) Updating files: 91% (300/329) Updating files: 92% (303/329) Updating files: 93% (306/329) Updating files: 94% (310/329) Updating files: 95% (313/329) Updating files: 96% (316/329) Updating files: 97% (320/329) Updating files: 98% (323/329) Updating files: 99% (326/329) Updating files: 100% (329/329) Updating files: 100% (329/329), done. 2023-10-25T23:42:20.755 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 4c2d73a5095 0.79 2023-10-25T23:42:20.759 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.79 2023-10-25T23:42:20.878 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:20.878 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 80 -eq 48 ']' 2023-10-25T23:42:20.878 INFO:tasks.workunit.client.0.smithi081.stdout:v0.80 2023-10-25T23:42:20.879 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.80 2023-10-25T23:42:20.879 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.80 2023-10-25T23:42:20.879 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.80 2023-10-25T23:42:24.624 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 81% (143/176) Updating files: 82% (145/176) Updating files: 83% (147/176) Updating files: 84% (148/176) Updating files: 85% (150/176) Updating files: 86% (152/176) Updating files: 87% (154/176) Updating files: 88% (155/176) Updating files: 89% (157/176) Updating files: 90% (159/176) Updating files: 91% (161/176) Updating files: 92% (162/176) Updating files: 93% (164/176) Updating files: 94% (166/176) Updating files: 95% (168/176) Updating files: 96% (169/176) Updating files: 97% (171/176) Updating files: 98% (173/176) Updating files: 99% (175/176) Updating files: 100% (176/176) Updating files: 100% (176/176), done. 2023-10-25T23:42:24.651 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at b78644e7dee 0.80 2023-10-25T23:42:24.653 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.80 2023-10-25T23:42:24.754 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:24.754 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 81 -eq 48 ']' 2023-10-25T23:42:24.754 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.81 2023-10-25T23:42:24.755 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.81 2023-10-25T23:42:24.755 INFO:tasks.workunit.client.0.smithi081.stdout:v0.81 2023-10-25T23:42:24.756 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.81 2023-10-25T23:42:26.211 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 68% (212/309) Updating files: 69% (214/309) Updating files: 70% (217/309) Updating files: 71% (220/309) Updating files: 72% (223/309) Updating files: 73% (226/309) Updating files: 74% (229/309) Updating files: 75% (232/309) Updating files: 76% (235/309) Updating files: 77% (238/309) Updating files: 78% (242/309) Updating files: 79% (245/309) Updating files: 80% (248/309) Updating files: 81% (251/309) Updating files: 82% (254/309) Updating files: 83% (257/309) Updating files: 84% (260/309) Updating files: 85% (263/309) Updating files: 86% (266/309) Updating files: 87% (269/309) Updating files: 88% (272/309) Updating files: 89% (276/309) Updating files: 90% (279/309) Updating files: 91% (282/309) Updating files: 92% (285/309) Updating files: 93% (288/309) Updating files: 94% (291/309) Updating files: 95% (294/309) Updating files: 96% (297/309) Updating files: 97% (300/309) Updating files: 98% (303/309) Updating files: 99% (306/309) Updating files: 100% (309/309) Updating files: 100% (309/309), done. 2023-10-25T23:42:26.294 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 8de9501df27 0.81 2023-10-25T23:42:26.299 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.81 2023-10-25T23:42:26.481 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:26.481 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 82 -eq 48 ']' 2023-10-25T23:42:26.482 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.82 2023-10-25T23:42:26.482 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.82 2023-10-25T23:42:26.483 INFO:tasks.workunit.client.0.smithi081.stdout:v0.82 2023-10-25T23:42:26.483 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.82 2023-10-25T23:42:27.637 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 77% (158/204) Updating files: 78% (160/204) Updating files: 79% (162/204) Updating files: 80% (164/204) Updating files: 81% (166/204) Updating files: 82% (168/204) Updating files: 83% (170/204) Updating files: 84% (172/204) Updating files: 85% (174/204) Updating files: 86% (176/204) Updating files: 87% (178/204) Updating files: 88% (180/204) Updating files: 89% (182/204) Updating files: 90% (184/204) Updating files: 91% (186/204) Updating files: 92% (188/204) Updating files: 93% (190/204) Updating files: 94% (192/204) Updating files: 95% (194/204) Updating files: 96% (196/204) Updating files: 97% (198/204) Updating files: 98% (200/204) Updating files: 99% (202/204) Updating files: 100% (204/204) Updating files: 100% (204/204), done. 2023-10-25T23:42:27.677 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 14085f42ddd 0.82 2023-10-25T23:42:27.679 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.82 2023-10-25T23:42:27.787 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:27.787 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 83 -eq 48 ']' 2023-10-25T23:42:27.788 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.83 2023-10-25T23:42:27.788 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.83 2023-10-25T23:42:27.788 INFO:tasks.workunit.client.0.smithi081.stdout:v0.83 2023-10-25T23:42:27.789 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.83 2023-10-25T23:42:28.652 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 78ff1f0a5df 0.83 2023-10-25T23:42:28.654 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.83 2023-10-25T23:42:28.766 INFO:tasks.workunit.client.0.smithi081.stdout:v0.84 2023-10-25T23:42:28.766 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:28.767 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 84 -eq 48 ']' 2023-10-25T23:42:28.767 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.84 2023-10-25T23:42:28.767 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.84 2023-10-25T23:42:28.767 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.84 2023-10-25T23:42:30.242 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 68% (244/356) Updating files: 69% (246/356) Updating files: 70% (250/356) Updating files: 71% (253/356) Updating files: 72% (257/356) Updating files: 73% (260/356) Updating files: 74% (264/356) Updating files: 75% (267/356) Updating files: 76% (271/356) Updating files: 77% (275/356) Updating files: 78% (278/356) Updating files: 79% (282/356) Updating files: 80% (285/356) Updating files: 81% (289/356) Updating files: 82% (292/356) Updating files: 83% (296/356) Updating files: 84% (300/356) Updating files: 85% (303/356) Updating files: 86% (307/356) Updating files: 87% (310/356) Updating files: 88% (314/356) Updating files: 89% (317/356) Updating files: 90% (321/356) Updating files: 91% (324/356) Updating files: 92% (328/356) Updating files: 93% (332/356) Updating files: 94% (335/356) Updating files: 95% (339/356) Updating files: 96% (342/356) Updating files: 97% (346/356) Updating files: 98% (349/356) Updating files: 99% (353/356) Updating files: 100% (356/356) Updating files: 100% (356/356), done. 2023-10-25T23:42:30.284 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 8336f81c5c7 0.84 2023-10-25T23:42:30.289 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.84 2023-10-25T23:42:30.387 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:30.387 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 85 -eq 48 ']' 2023-10-25T23:42:30.388 INFO:tasks.workunit.client.0.smithi081.stdout:v0.85 2023-10-25T23:42:30.388 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.85 2023-10-25T23:42:30.388 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.85 2023-10-25T23:42:30.388 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.85 2023-10-25T23:42:31.663 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 77% (188/243) Updating files: 78% (190/243) Updating files: 79% (192/243) Updating files: 80% (195/243) Updating files: 81% (197/243) Updating files: 82% (200/243) Updating files: 83% (202/243) Updating files: 84% (205/243) Updating files: 85% (207/243) Updating files: 86% (209/243) Updating files: 87% (212/243) Updating files: 88% (214/243) Updating files: 89% (217/243) Updating files: 90% (219/243) Updating files: 91% (222/243) Updating files: 92% (224/243) Updating files: 93% (226/243) Updating files: 94% (229/243) Updating files: 95% (231/243) Updating files: 96% (234/243) Updating files: 97% (236/243) Updating files: 98% (239/243) Updating files: 99% (241/243) Updating files: 100% (243/243) Updating files: 100% (243/243), done. 2023-10-25T23:42:31.708 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at a0c22842db9 0.85 2023-10-25T23:42:31.710 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.85 2023-10-25T23:42:31.853 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:31.853 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 86 -eq 48 ']' 2023-10-25T23:42:31.853 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.86 2023-10-25T23:42:31.854 INFO:tasks.workunit.client.0.smithi081.stdout:v0.86 2023-10-25T23:42:31.854 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.86 2023-10-25T23:42:31.854 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.86 2023-10-25T23:42:33.707 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 52% (234/447) Updating files: 53% (237/447) Updating files: 54% (242/447) Updating files: 55% (246/447) Updating files: 56% (251/447) Updating files: 57% (255/447) Updating files: 58% (260/447) Updating files: 59% (264/447) Updating files: 60% (269/447) Updating files: 61% (273/447) Updating files: 62% (278/447) Updating files: 63% (282/447) Updating files: 64% (287/447) Updating files: 65% (291/447) Updating files: 66% (296/447) Updating files: 67% (300/447) Updating files: 68% (304/447) Updating files: 69% (309/447) Updating files: 70% (313/447) Updating files: 71% (318/447) Updating files: 72% (322/447) Updating files: 73% (327/447) Updating files: 74% (331/447) Updating files: 75% (336/447) Updating files: 76% (340/447) Updating files: 77% (345/447) Updating files: 78% (349/447) Updating files: 79% (354/447) Updating files: 80% (358/447) Updating files: 81% (363/447) Updating files: 82% (367/447) Updating files: 83% (372/447) Updating files: 84% (376/447) Updating files: 85% (380/447) Updating files: 86% (385/447) Updating files: 87% (389/447) Updating files: 88% (394/447) Updating files: 89% (398/447) Updating files: 90% (403/447) Updating files: 91% (407/447) Updating files: 92% (412/447) Updating files: 93% (416/447) Updating files: 94% (421/447) Updating files: 95% (425/447) Updating files: 96% (430/447) Updating files: 97% (434/447) Updating files: 98% (439/447) Updating files: 99% (443/447) Updating files: 100% (447/447) Updating files: 100% (447/447), done. 2023-10-25T23:42:33.741 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 97dcc0539df 0.86 2023-10-25T23:42:33.744 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.86 2023-10-25T23:42:33.892 INFO:tasks.workunit.client.0.smithi081.stdout:v0.87 2023-10-25T23:42:33.892 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:33.893 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 87 -eq 48 ']' 2023-10-25T23:42:33.893 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.87 2023-10-25T23:42:33.893 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.87 2023-10-25T23:42:33.893 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.87 2023-10-25T23:42:34.189 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at c51c8f9d80f 0.87 2023-10-25T23:42:34.190 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.87 2023-10-25T23:42:34.264 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:34.265 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 88 -eq 48 ']' 2023-10-25T23:42:34.265 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.88 2023-10-25T23:42:34.265 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.88 2023-10-25T23:42:34.266 INFO:tasks.workunit.client.0.smithi081.stdout:v0.88 2023-10-25T23:42:34.266 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.88 2023-10-25T23:42:35.556 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 79% (265/335) Updating files: 80% (268/335) Updating files: 81% (272/335) Updating files: 82% (275/335) Updating files: 83% (279/335) Updating files: 84% (282/335) Updating files: 85% (285/335) Updating files: 86% (289/335) Updating files: 87% (292/335) Updating files: 88% (295/335) Updating files: 89% (299/335) Updating files: 90% (302/335) Updating files: 91% (305/335) Updating files: 92% (309/335) Updating files: 93% (312/335) Updating files: 94% (315/335) Updating files: 95% (319/335) Updating files: 96% (322/335) Updating files: 97% (325/335) Updating files: 98% (329/335) Updating files: 99% (332/335) Updating files: 100% (335/335) Updating files: 100% (335/335), done. 2023-10-25T23:42:35.601 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 4be687bf448 0.88 2023-10-25T23:42:35.605 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.88 2023-10-25T23:42:35.728 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:35.729 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 89 -eq 48 ']' 2023-10-25T23:42:35.729 INFO:tasks.workunit.client.0.smithi081.stdout:v0.89 2023-10-25T23:42:35.730 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.89 2023-10-25T23:42:35.730 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.89 2023-10-25T23:42:35.730 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.89 2023-10-25T23:42:37.613 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 62% (124/197) Updating files: 63% (125/197) Updating files: 64% (127/197) Updating files: 65% (129/197) Updating files: 66% (131/197) Updating files: 67% (132/197) Updating files: 68% (134/197) Updating files: 69% (136/197) Updating files: 70% (138/197) Updating files: 71% (140/197) Updating files: 72% (142/197) Updating files: 73% (144/197) Updating files: 74% (146/197) Updating files: 75% (148/197) Updating files: 76% (150/197) Updating files: 77% (152/197) Updating files: 78% (154/197) Updating files: 79% (156/197) Updating files: 80% (158/197) Updating files: 81% (160/197) Updating files: 82% (162/197) Updating files: 83% (164/197) Updating files: 84% (166/197) Updating files: 85% (168/197) Updating files: 86% (170/197) Updating files: 87% (172/197) Updating files: 88% (174/197) Updating files: 89% (176/197) Updating files: 90% (178/197) Updating files: 91% (180/197) Updating files: 92% (182/197) Updating files: 93% (184/197) Updating files: 94% (186/197) Updating files: 95% (188/197) Updating files: 96% (190/197) Updating files: 97% (192/197) Updating files: 98% (194/197) Updating files: 99% (196/197) Updating files: 100% (197/197) Updating files: 100% (197/197), done. 2023-10-25T23:42:37.649 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 68fdc0f68e6 0.89 2023-10-25T23:42:37.653 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.89 2023-10-25T23:42:37.747 INFO:tasks.workunit.client.0.smithi081.stdout:v0.90 2023-10-25T23:42:37.748 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:37.748 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 90 -eq 48 ']' 2023-10-25T23:42:37.748 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.90 2023-10-25T23:42:37.748 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo v0.90 2023-10-25T23:42:37.748 INFO:tasks.workunit.client.0.smithi081.stderr:+ git reset --hard v0.90 2023-10-25T23:42:38.728 INFO:tasks.workunit.client.0.smithi081.stdout:HEAD is now at 08bd1e1eee3 0.90 2023-10-25T23:42:38.730 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/v0.90 2023-10-25T23:42:38.848 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:38.849 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 1 -eq 48 ']' 2023-10-25T23:42:38.849 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.1 2023-10-25T23:42:38.849 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.1 2023-10-25T23:42:38.850 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.1 2023-10-25T23:42:38.850 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.1 2023-10-25T23:42:38.850 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:39.291 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:39.291 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:39.291 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 2 -eq 48 ']' 2023-10-25T23:42:39.291 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.2 2023-10-25T23:42:39.292 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.2 2023-10-25T23:42:39.292 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.2 2023-10-25T23:42:39.293 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.2 2023-10-25T23:42:39.293 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:39.582 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:39.583 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:39.583 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 3 -eq 48 ']' 2023-10-25T23:42:39.583 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.3 2023-10-25T23:42:39.584 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.3 2023-10-25T23:42:39.584 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.3 2023-10-25T23:42:39.584 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.3 2023-10-25T23:42:39.585 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:39.977 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:39.977 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:39.977 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 4 -eq 48 ']' 2023-10-25T23:42:39.978 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.4 2023-10-25T23:42:39.978 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.4 2023-10-25T23:42:39.978 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.4 2023-10-25T23:42:39.979 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.4 2023-10-25T23:42:39.979 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:40.292 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:40.292 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:40.292 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 5 -eq 48 ']' 2023-10-25T23:42:40.293 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.5 2023-10-25T23:42:40.293 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.5 2023-10-25T23:42:40.293 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.5 2023-10-25T23:42:40.294 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.5 2023-10-25T23:42:40.294 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:40.581 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:40.582 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:40.582 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 6 -eq 48 ']' 2023-10-25T23:42:40.582 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.6 2023-10-25T23:42:40.582 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.6 2023-10-25T23:42:40.583 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.6 2023-10-25T23:42:40.583 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.6 2023-10-25T23:42:40.583 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:41.001 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:41.001 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:41.001 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 7 -eq 48 ']' 2023-10-25T23:42:41.001 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.7 2023-10-25T23:42:41.002 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.7 2023-10-25T23:42:41.002 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.7 2023-10-25T23:42:41.003 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.7 2023-10-25T23:42:41.003 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:54.399 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:54.399 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:54.399 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 8 -eq 48 ']' 2023-10-25T23:42:54.400 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.8 2023-10-25T23:42:54.400 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.8 2023-10-25T23:42:54.400 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.8 2023-10-25T23:42:54.401 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.8 2023-10-25T23:42:54.401 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:54.823 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:54.824 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:54.824 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 9 -eq 48 ']' 2023-10-25T23:42:54.824 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.9 2023-10-25T23:42:54.824 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.9 2023-10-25T23:42:54.825 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.9 2023-10-25T23:42:54.825 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.9 2023-10-25T23:42:54.825 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:55.249 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:55.249 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:55.249 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 10 -eq 48 ']' 2023-10-25T23:42:55.250 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.10 2023-10-25T23:42:55.250 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.10 2023-10-25T23:42:55.250 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.10 2023-10-25T23:42:55.251 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.10 2023-10-25T23:42:55.251 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:55.728 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:55.728 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:55.728 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 11 -eq 48 ']' 2023-10-25T23:42:55.729 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.11 2023-10-25T23:42:55.729 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.11 2023-10-25T23:42:55.729 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.11 2023-10-25T23:42:55.730 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.11 2023-10-25T23:42:55.730 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:56.061 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:56.061 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:56.062 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 12 -eq 48 ']' 2023-10-25T23:42:56.062 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.12 2023-10-25T23:42:56.062 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.12 2023-10-25T23:42:56.063 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.12 2023-10-25T23:42:56.063 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.12 2023-10-25T23:42:56.063 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:56.481 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:56.482 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:56.482 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 13 -eq 48 ']' 2023-10-25T23:42:56.482 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.13 2023-10-25T23:42:56.482 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.13 2023-10-25T23:42:56.483 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.13 2023-10-25T23:42:56.483 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.13 2023-10-25T23:42:56.484 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:56.889 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:56.889 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:56.889 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 14 -eq 48 ']' 2023-10-25T23:42:56.890 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.14 2023-10-25T23:42:56.890 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.14 2023-10-25T23:42:56.891 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.14 2023-10-25T23:42:56.891 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.14 2023-10-25T23:42:56.891 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:57.441 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:57.441 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:57.441 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 15 -eq 48 ']' 2023-10-25T23:42:57.442 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.15 2023-10-25T23:42:57.442 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.15 2023-10-25T23:42:57.442 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.15 2023-10-25T23:42:57.443 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.15 2023-10-25T23:42:57.443 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:57.876 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:57.877 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:57.877 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 16 -eq 48 ']' 2023-10-25T23:42:57.877 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.16 2023-10-25T23:42:57.878 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.16 2023-10-25T23:42:57.878 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.16 2023-10-25T23:42:57.878 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.16 2023-10-25T23:42:57.879 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:58.365 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:58.366 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:58.366 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 17 -eq 48 ']' 2023-10-25T23:42:58.366 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.17 2023-10-25T23:42:58.367 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.17 2023-10-25T23:42:58.367 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.17 2023-10-25T23:42:58.367 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.17 2023-10-25T23:42:58.368 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:58.753 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:58.753 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:58.754 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 18 -eq 48 ']' 2023-10-25T23:42:58.754 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.18 2023-10-25T23:42:58.754 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.18 2023-10-25T23:42:58.754 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.18 2023-10-25T23:42:58.755 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.18 2023-10-25T23:42:58.755 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:59.226 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:59.226 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:59.226 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 19 -eq 48 ']' 2023-10-25T23:42:59.227 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.19 2023-10-25T23:42:59.229 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.19 2023-10-25T23:42:59.230 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.19 2023-10-25T23:42:59.230 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.19 2023-10-25T23:42:59.230 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:42:59.665 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:42:59.665 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:42:59.665 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 20 -eq 48 ']' 2023-10-25T23:42:59.665 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.20 2023-10-25T23:42:59.666 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.20 2023-10-25T23:42:59.666 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.20 2023-10-25T23:42:59.667 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.20 2023-10-25T23:42:59.667 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:02.210 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:02.210 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:02.210 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 21 -eq 48 ']' 2023-10-25T23:43:02.210 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.21 2023-10-25T23:43:02.211 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.21 2023-10-25T23:43:02.211 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.21 2023-10-25T23:43:02.212 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.21 2023-10-25T23:43:02.212 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:02.619 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:02.619 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:02.619 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 22 -eq 48 ']' 2023-10-25T23:43:02.619 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.22 2023-10-25T23:43:02.620 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.22 2023-10-25T23:43:02.620 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.22 2023-10-25T23:43:02.620 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.22 2023-10-25T23:43:02.621 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:03.083 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:03.083 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:03.083 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 23 -eq 48 ']' 2023-10-25T23:43:03.084 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.23 2023-10-25T23:43:03.084 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.23 2023-10-25T23:43:03.084 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.23 2023-10-25T23:43:03.085 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.23 2023-10-25T23:43:03.085 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:03.558 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:03.558 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:03.559 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 24 -eq 48 ']' 2023-10-25T23:43:03.559 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.24 2023-10-25T23:43:03.559 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.24 2023-10-25T23:43:03.559 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.24 2023-10-25T23:43:03.560 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.24 2023-10-25T23:43:03.560 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:03.932 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:03.932 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:03.932 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 25 -eq 48 ']' 2023-10-25T23:43:03.932 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.25 2023-10-25T23:43:03.933 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.25 2023-10-25T23:43:03.933 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.25 2023-10-25T23:43:03.933 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.25 2023-10-25T23:43:03.934 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:04.675 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:04.675 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:04.675 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 26 -eq 48 ']' 2023-10-25T23:43:04.676 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.26 2023-10-25T23:43:04.676 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.26 2023-10-25T23:43:04.677 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.26 2023-10-25T23:43:04.677 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.26 2023-10-25T23:43:04.677 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:05.217 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:05.218 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:05.218 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 27 -eq 48 ']' 2023-10-25T23:43:05.218 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.27 2023-10-25T23:43:05.219 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.27 2023-10-25T23:43:05.219 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.27 2023-10-25T23:43:05.219 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.27 2023-10-25T23:43:05.220 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:05.705 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:05.705 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:05.706 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 28 -eq 48 ']' 2023-10-25T23:43:05.706 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.28 2023-10-25T23:43:05.706 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.28 2023-10-25T23:43:05.707 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.28 2023-10-25T23:43:05.707 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.28 2023-10-25T23:43:05.707 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:06.105 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:06.105 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:06.105 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 29 -eq 48 ']' 2023-10-25T23:43:06.106 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.29 2023-10-25T23:43:06.106 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.29 2023-10-25T23:43:06.106 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.29 2023-10-25T23:43:06.107 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.29 2023-10-25T23:43:06.107 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:06.704 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:06.704 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:06.704 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 30 -eq 48 ']' 2023-10-25T23:43:06.704 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.30 2023-10-25T23:43:06.705 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.30 2023-10-25T23:43:06.705 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.30 2023-10-25T23:43:06.706 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.30 2023-10-25T23:43:06.706 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:07.131 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:07.131 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:07.132 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 31 -eq 48 ']' 2023-10-25T23:43:07.132 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.31 2023-10-25T23:43:07.133 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.31 2023-10-25T23:43:07.133 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.31 2023-10-25T23:43:07.133 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.31 2023-10-25T23:43:07.133 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:07.534 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:07.534 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:07.535 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 32 -eq 48 ']' 2023-10-25T23:43:07.535 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.32 2023-10-25T23:43:07.535 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.32 2023-10-25T23:43:07.536 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.32 2023-10-25T23:43:07.536 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.32 2023-10-25T23:43:07.536 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:08.044 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:08.045 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:08.045 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 33 -eq 48 ']' 2023-10-25T23:43:08.045 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.33 2023-10-25T23:43:08.045 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.33 2023-10-25T23:43:08.046 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.33 2023-10-25T23:43:08.046 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.33 2023-10-25T23:43:08.046 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:08.587 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:08.587 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:08.587 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 34 -eq 48 ']' 2023-10-25T23:43:08.587 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.34 2023-10-25T23:43:08.588 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.34 2023-10-25T23:43:08.588 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.34 2023-10-25T23:43:08.588 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.34 2023-10-25T23:43:08.589 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:09.111 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:09.111 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:09.112 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 35 -eq 48 ']' 2023-10-25T23:43:09.112 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.35 2023-10-25T23:43:09.113 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.35 2023-10-25T23:43:09.113 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.35 2023-10-25T23:43:09.113 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.35 2023-10-25T23:43:09.114 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:09.775 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:09.776 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:09.776 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 36 -eq 48 ']' 2023-10-25T23:43:09.776 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.36 2023-10-25T23:43:09.776 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.36 2023-10-25T23:43:09.777 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.36 2023-10-25T23:43:09.777 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.36 2023-10-25T23:43:09.777 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:12.269 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:12.270 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:12.270 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 37 -eq 48 ']' 2023-10-25T23:43:12.270 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.37 2023-10-25T23:43:12.271 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.37 2023-10-25T23:43:12.271 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.37 2023-10-25T23:43:12.271 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.37 2023-10-25T23:43:12.272 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:12.903 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:12.904 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:12.904 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 38 -eq 48 ']' 2023-10-25T23:43:12.904 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.38 2023-10-25T23:43:12.904 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.38 2023-10-25T23:43:12.905 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.38 2023-10-25T23:43:12.905 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.38 2023-10-25T23:43:12.905 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:13.545 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:13.545 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:13.545 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 39 -eq 48 ']' 2023-10-25T23:43:13.546 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.39 2023-10-25T23:43:13.546 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.39 2023-10-25T23:43:13.546 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.39 2023-10-25T23:43:13.547 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.39 2023-10-25T23:43:13.547 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:14.121 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:14.121 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:14.121 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 40 -eq 48 ']' 2023-10-25T23:43:14.121 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.40 2023-10-25T23:43:14.122 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.40 2023-10-25T23:43:14.122 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.40 2023-10-25T23:43:14.123 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.40 2023-10-25T23:43:14.123 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:14.717 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:14.718 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:14.718 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 41 -eq 48 ']' 2023-10-25T23:43:14.718 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.41 2023-10-25T23:43:14.719 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.41 2023-10-25T23:43:14.719 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.41 2023-10-25T23:43:14.719 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.41 2023-10-25T23:43:14.720 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:15.301 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:15.301 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:15.301 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 42 -eq 48 ']' 2023-10-25T23:43:15.301 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.42 2023-10-25T23:43:15.302 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.42 2023-10-25T23:43:15.302 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.42 2023-10-25T23:43:15.303 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.42 2023-10-25T23:43:15.303 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:15.927 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:15.928 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:15.928 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 43 -eq 48 ']' 2023-10-25T23:43:15.928 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.43 2023-10-25T23:43:15.929 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.43 2023-10-25T23:43:15.929 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.43 2023-10-25T23:43:15.929 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.43 2023-10-25T23:43:15.929 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:22.284 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:22.284 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:22.284 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 44 -eq 48 ']' 2023-10-25T23:43:22.285 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.44 2023-10-25T23:43:22.285 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.44 2023-10-25T23:43:22.286 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.44 2023-10-25T23:43:22.286 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.44 2023-10-25T23:43:22.286 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:22.914 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:22.915 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:22.915 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 45 -eq 48 ']' 2023-10-25T23:43:22.915 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.45 2023-10-25T23:43:22.916 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.45 2023-10-25T23:43:22.916 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.45 2023-10-25T23:43:22.916 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.45 2023-10-25T23:43:22.917 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:23.469 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:23.469 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:23.470 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 46 -eq 48 ']' 2023-10-25T23:43:23.470 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.46 2023-10-25T23:43:23.470 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.46 2023-10-25T23:43:23.470 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.46 2023-10-25T23:43:23.471 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.46 2023-10-25T23:43:23.471 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:24.145 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:24.146 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:24.146 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 47 -eq 48 ']' 2023-10-25T23:43:24.146 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.47 2023-10-25T23:43:24.147 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.47 2023-10-25T23:43:24.147 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.47 2023-10-25T23:43:24.147 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.47 2023-10-25T23:43:24.147 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:24.848 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:24.848 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:24.848 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 48 -eq 48 ']' 2023-10-25T23:43:24.848 INFO:tasks.workunit.client.0.smithi081.stderr:+ continue 2023-10-25T23:43:24.849 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:24.849 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 49 -eq 48 ']' 2023-10-25T23:43:24.849 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.49 2023-10-25T23:43:24.850 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.49 2023-10-25T23:43:24.850 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.49 2023-10-25T23:43:24.850 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.49 2023-10-25T23:43:24.851 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:25.747 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:25.747 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:25.747 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 50 -eq 48 ']' 2023-10-25T23:43:25.747 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.50 2023-10-25T23:43:25.748 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.50 2023-10-25T23:43:25.748 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.50 2023-10-25T23:43:25.749 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.50 2023-10-25T23:43:25.749 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:26.596 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:26.596 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:26.597 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 51 -eq 48 ']' 2023-10-25T23:43:26.597 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.51 2023-10-25T23:43:26.597 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.51 2023-10-25T23:43:26.598 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.51 2023-10-25T23:43:26.598 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.51 2023-10-25T23:43:26.598 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:27.361 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:27.362 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:27.362 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 52 -eq 48 ']' 2023-10-25T23:43:27.362 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.52 2023-10-25T23:43:27.363 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.52 2023-10-25T23:43:27.363 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.52 2023-10-25T23:43:27.363 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.52 2023-10-25T23:43:27.363 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:28.186 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:28.187 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:28.187 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 53 -eq 48 ']' 2023-10-25T23:43:28.187 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.53 2023-10-25T23:43:28.187 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.53 2023-10-25T23:43:28.188 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.53 2023-10-25T23:43:28.188 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.53 2023-10-25T23:43:28.188 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:29.095 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:29.095 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:29.096 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 54 -eq 48 ']' 2023-10-25T23:43:29.096 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.54 2023-10-25T23:43:29.096 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.54 2023-10-25T23:43:29.096 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.54 2023-10-25T23:43:29.097 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.54 2023-10-25T23:43:29.097 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:29.955 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:29.956 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:29.956 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 55 -eq 48 ']' 2023-10-25T23:43:29.956 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.55 2023-10-25T23:43:29.956 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.55 2023-10-25T23:43:29.957 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.55 2023-10-25T23:43:29.957 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.55 2023-10-25T23:43:29.957 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:31.068 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:31.069 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:31.069 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 56 -eq 48 ']' 2023-10-25T23:43:31.069 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.56 2023-10-25T23:43:31.069 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.56 2023-10-25T23:43:31.070 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.56 2023-10-25T23:43:31.070 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.56 2023-10-25T23:43:31.070 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:31.854 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:31.855 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:31.855 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 57 -eq 48 ']' 2023-10-25T23:43:31.855 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.57 2023-10-25T23:43:31.855 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.57 2023-10-25T23:43:31.856 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.57 2023-10-25T23:43:31.856 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.57 2023-10-25T23:43:31.856 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:32.770 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:32.770 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:32.770 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 58 -eq 48 ']' 2023-10-25T23:43:32.770 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.58 2023-10-25T23:43:32.771 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.58 2023-10-25T23:43:32.771 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.58 2023-10-25T23:43:32.772 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.58 2023-10-25T23:43:32.772 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:33.577 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:33.577 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:33.577 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 59 -eq 48 ']' 2023-10-25T23:43:33.577 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.59 2023-10-25T23:43:33.577 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.59 2023-10-25T23:43:33.578 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.59 2023-10-25T23:43:33.578 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.59 2023-10-25T23:43:33.579 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:34.536 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:34.536 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:34.537 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 60 -eq 48 ']' 2023-10-25T23:43:34.537 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.60 2023-10-25T23:43:34.537 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.60 2023-10-25T23:43:34.538 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.60 2023-10-25T23:43:34.538 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.60 2023-10-25T23:43:34.538 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:35.443 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:35.444 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:35.444 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 61 -eq 48 ']' 2023-10-25T23:43:35.444 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.61 2023-10-25T23:43:35.444 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.61 2023-10-25T23:43:35.445 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.61 2023-10-25T23:43:35.445 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.61 2023-10-25T23:43:35.445 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:36.425 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:36.426 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:36.426 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 62 -eq 48 ']' 2023-10-25T23:43:36.426 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.62 2023-10-25T23:43:36.426 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.62 2023-10-25T23:43:36.427 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.62 2023-10-25T23:43:36.427 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.62 2023-10-25T23:43:36.428 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:37.358 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:37.359 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:37.359 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 63 -eq 48 ']' 2023-10-25T23:43:37.359 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.63 2023-10-25T23:43:37.360 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.63 2023-10-25T23:43:37.360 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.63 2023-10-25T23:43:37.361 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.63 2023-10-25T23:43:37.361 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:38.283 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:38.284 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:38.284 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 64 -eq 48 ']' 2023-10-25T23:43:38.284 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.64 2023-10-25T23:43:38.285 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.64 2023-10-25T23:43:38.285 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.64 2023-10-25T23:43:38.285 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.64 2023-10-25T23:43:38.286 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:39.202 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:39.202 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:39.203 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 65 -eq 48 ']' 2023-10-25T23:43:39.203 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.65 2023-10-25T23:43:39.203 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.65 2023-10-25T23:43:39.203 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.65 2023-10-25T23:43:39.204 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.65 2023-10-25T23:43:39.204 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:40.032 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:40.032 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:40.032 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 66 -eq 48 ']' 2023-10-25T23:43:40.033 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.66 2023-10-25T23:43:40.033 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.66 2023-10-25T23:43:40.034 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.66 2023-10-25T23:43:40.034 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.66 2023-10-25T23:43:40.034 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:40.879 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:40.879 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:40.879 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 67 -eq 48 ']' 2023-10-25T23:43:40.879 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.67 2023-10-25T23:43:40.880 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.67 2023-10-25T23:43:40.880 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.67 2023-10-25T23:43:40.880 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.67 2023-10-25T23:43:40.881 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:42.224 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:42.224 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:42.225 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 68 -eq 48 ']' 2023-10-25T23:43:42.225 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.68 2023-10-25T23:43:42.225 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.68 2023-10-25T23:43:42.225 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.68 2023-10-25T23:43:42.226 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.68 2023-10-25T23:43:42.226 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:43.746 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:43.747 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:43.747 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 69 -eq 48 ']' 2023-10-25T23:43:43.747 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.69 2023-10-25T23:43:43.747 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.69 2023-10-25T23:43:43.748 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.69 2023-10-25T23:43:43.748 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.69 2023-10-25T23:43:43.748 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:44.842 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:44.842 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:44.842 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 70 -eq 48 ']' 2023-10-25T23:43:44.843 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.70 2023-10-25T23:43:44.843 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.70 2023-10-25T23:43:44.843 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.70 2023-10-25T23:43:44.844 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.70 2023-10-25T23:43:44.845 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:45.937 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:45.938 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:45.938 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 71 -eq 48 ']' 2023-10-25T23:43:45.938 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.71 2023-10-25T23:43:45.939 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.71 2023-10-25T23:43:45.939 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.71 2023-10-25T23:43:45.939 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.71 2023-10-25T23:43:45.940 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:47.035 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:47.036 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:47.036 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 72 -eq 48 ']' 2023-10-25T23:43:47.036 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.72 2023-10-25T23:43:47.036 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.72 2023-10-25T23:43:47.037 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.72 2023-10-25T23:43:47.037 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.72 2023-10-25T23:43:47.037 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:48.138 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:48.138 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:48.138 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 73 -eq 48 ']' 2023-10-25T23:43:48.139 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.73 2023-10-25T23:43:48.139 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.73 2023-10-25T23:43:48.139 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.73 2023-10-25T23:43:48.140 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.73 2023-10-25T23:43:48.140 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:49.266 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:49.267 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:49.267 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 74 -eq 48 ']' 2023-10-25T23:43:49.267 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.74 2023-10-25T23:43:49.267 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.74 2023-10-25T23:43:49.268 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.74 2023-10-25T23:43:49.268 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.74 2023-10-25T23:43:49.269 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:50.415 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:50.415 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:50.415 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 75 -eq 48 ']' 2023-10-25T23:43:50.415 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.75 2023-10-25T23:43:50.416 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.75 2023-10-25T23:43:50.416 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.75 2023-10-25T23:43:50.416 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.75 2023-10-25T23:43:50.417 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:51.649 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:51.649 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:51.649 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 76 -eq 48 ']' 2023-10-25T23:43:51.649 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.76 2023-10-25T23:43:51.650 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.76 2023-10-25T23:43:51.650 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.76 2023-10-25T23:43:51.651 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.76 2023-10-25T23:43:51.651 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:52.850 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:52.850 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:52.850 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 77 -eq 48 ']' 2023-10-25T23:43:52.851 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.77 2023-10-25T23:43:52.851 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.77 2023-10-25T23:43:52.851 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.77 2023-10-25T23:43:52.852 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.77 2023-10-25T23:43:52.852 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:54.095 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:54.096 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:54.096 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 78 -eq 48 ']' 2023-10-25T23:43:54.096 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.78 2023-10-25T23:43:54.097 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.78 2023-10-25T23:43:54.097 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.78 2023-10-25T23:43:54.097 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.78 2023-10-25T23:43:54.097 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:55.177 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:55.177 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:55.177 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 79 -eq 48 ']' 2023-10-25T23:43:55.178 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.79 2023-10-25T23:43:55.179 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.79 2023-10-25T23:43:55.179 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.79 2023-10-25T23:43:55.179 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.79 2023-10-25T23:43:55.179 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:56.404 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:56.405 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:56.405 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 80 -eq 48 ']' 2023-10-25T23:43:56.405 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.80 2023-10-25T23:43:56.405 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.80 2023-10-25T23:43:56.406 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.80 2023-10-25T23:43:56.406 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.80 2023-10-25T23:43:56.407 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:57.566 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:57.566 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:57.566 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 81 -eq 48 ']' 2023-10-25T23:43:57.566 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.81 2023-10-25T23:43:57.567 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.81 2023-10-25T23:43:57.567 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.81 2023-10-25T23:43:57.567 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.81 2023-10-25T23:43:57.568 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:43:58.783 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:43:58.783 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:43:58.783 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 82 -eq 48 ']' 2023-10-25T23:43:58.783 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.82 2023-10-25T23:43:58.784 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.82 2023-10-25T23:43:58.784 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.82 2023-10-25T23:43:58.784 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.82 2023-10-25T23:43:58.785 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:44:00.070 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:44:00.070 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:00.070 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 83 -eq 48 ']' 2023-10-25T23:44:00.070 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.83 2023-10-25T23:44:00.071 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.83 2023-10-25T23:44:00.071 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.83 2023-10-25T23:44:00.072 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.83 2023-10-25T23:44:00.072 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:44:01.440 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:44:01.440 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:01.440 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 84 -eq 48 ']' 2023-10-25T23:44:01.440 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.84 2023-10-25T23:44:01.441 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.84 2023-10-25T23:44:01.441 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.84 2023-10-25T23:44:01.442 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.84 2023-10-25T23:44:01.442 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:44:02.721 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:44:02.721 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:02.722 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 85 -eq 48 ']' 2023-10-25T23:44:02.723 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.85 2023-10-25T23:44:02.724 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.85 2023-10-25T23:44:02.726 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.85 2023-10-25T23:44:02.727 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.85 2023-10-25T23:44:02.727 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:44:04.101 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:44:04.101 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:04.101 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 86 -eq 48 ']' 2023-10-25T23:44:04.101 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.86 2023-10-25T23:44:04.102 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.86 2023-10-25T23:44:04.102 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.86 2023-10-25T23:44:04.103 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.86 2023-10-25T23:44:04.103 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:44:05.540 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:44:05.540 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:05.540 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 87 -eq 48 ']' 2023-10-25T23:44:05.540 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.87 2023-10-25T23:44:05.541 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.87 2023-10-25T23:44:05.541 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.87 2023-10-25T23:44:05.541 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.87 2023-10-25T23:44:05.542 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:44:06.879 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:44:06.879 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:06.879 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 88 -eq 48 ']' 2023-10-25T23:44:06.879 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.88 2023-10-25T23:44:06.880 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.88 2023-10-25T23:44:06.880 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.88 2023-10-25T23:44:06.881 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.88 2023-10-25T23:44:06.881 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:44:08.296 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:44:08.296 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:08.296 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 89 -eq 48 ']' 2023-10-25T23:44:08.296 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.89 2023-10-25T23:44:08.297 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.89 2023-10-25T23:44:08.297 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.89 2023-10-25T23:44:08.297 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.89 2023-10-25T23:44:08.298 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:44:09.642 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:44:09.642 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:09.643 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 90 -eq 48 ']' 2023-10-25T23:44:09.643 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.90 2023-10-25T23:44:09.643 INFO:tasks.workunit.client.0.smithi081.stdout:checking v0.90 2023-10-25T23:44:09.644 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo checking v0.90 2023-10-25T23:44:09.644 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd .snap/v0.90 2023-10-25T23:44:09.644 INFO:tasks.workunit.client.0.smithi081.stderr:+ git diff --exit-code 2023-10-25T23:44:11.124 INFO:tasks.workunit.client.0.smithi081.stderr:+ cd ../.. 2023-10-25T23:44:11.124 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.124 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 1 -eq 48 ']' 2023-10-25T23:44:11.125 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.1 2023-10-25T23:44:11.125 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.1 2023-10-25T23:44:11.134 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.134 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 2 -eq 48 ']' 2023-10-25T23:44:11.134 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.2 2023-10-25T23:44:11.134 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.2 2023-10-25T23:44:11.143 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.143 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 3 -eq 48 ']' 2023-10-25T23:44:11.144 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.3 2023-10-25T23:44:11.144 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.3 2023-10-25T23:44:11.152 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.152 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 4 -eq 48 ']' 2023-10-25T23:44:11.153 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.4 2023-10-25T23:44:11.153 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.4 2023-10-25T23:44:11.161 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.161 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 5 -eq 48 ']' 2023-10-25T23:44:11.161 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.5 2023-10-25T23:44:11.161 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.5 2023-10-25T23:44:11.169 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.170 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 6 -eq 48 ']' 2023-10-25T23:44:11.170 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.6 2023-10-25T23:44:11.170 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.6 2023-10-25T23:44:11.177 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.178 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 7 -eq 48 ']' 2023-10-25T23:44:11.178 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.7 2023-10-25T23:44:11.178 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.7 2023-10-25T23:44:11.188 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.188 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 8 -eq 48 ']' 2023-10-25T23:44:11.189 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.8 2023-10-25T23:44:11.189 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.8 2023-10-25T23:44:11.197 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.198 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 9 -eq 48 ']' 2023-10-25T23:44:11.199 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.9 2023-10-25T23:44:11.199 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.9 2023-10-25T23:44:11.207 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.207 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 10 -eq 48 ']' 2023-10-25T23:44:11.207 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.10 2023-10-25T23:44:11.207 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.10 2023-10-25T23:44:11.217 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.217 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 11 -eq 48 ']' 2023-10-25T23:44:11.218 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.11 2023-10-25T23:44:11.218 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.11 2023-10-25T23:44:11.228 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.228 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 12 -eq 48 ']' 2023-10-25T23:44:11.228 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.12 2023-10-25T23:44:11.228 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.12 2023-10-25T23:44:11.236 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.236 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 13 -eq 48 ']' 2023-10-25T23:44:11.237 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.13 2023-10-25T23:44:11.237 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.13 2023-10-25T23:44:11.246 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.246 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 14 -eq 48 ']' 2023-10-25T23:44:11.246 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.14 2023-10-25T23:44:11.247 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.14 2023-10-25T23:44:11.256 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.256 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 15 -eq 48 ']' 2023-10-25T23:44:11.256 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.15 2023-10-25T23:44:11.256 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.15 2023-10-25T23:44:11.265 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.265 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 16 -eq 48 ']' 2023-10-25T23:44:11.266 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.16 2023-10-25T23:44:11.266 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.16 2023-10-25T23:44:11.276 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.276 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 17 -eq 48 ']' 2023-10-25T23:44:11.277 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.17 2023-10-25T23:44:11.277 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.17 2023-10-25T23:44:11.285 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.286 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 18 -eq 48 ']' 2023-10-25T23:44:11.286 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.18 2023-10-25T23:44:11.286 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.18 2023-10-25T23:44:11.294 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.294 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 19 -eq 48 ']' 2023-10-25T23:44:11.295 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.19 2023-10-25T23:44:11.295 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.19 2023-10-25T23:44:11.303 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.304 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 20 -eq 48 ']' 2023-10-25T23:44:11.304 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.20 2023-10-25T23:44:11.304 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.20 2023-10-25T23:44:11.312 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.312 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 21 -eq 48 ']' 2023-10-25T23:44:11.313 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.21 2023-10-25T23:44:11.313 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.21 2023-10-25T23:44:11.321 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.321 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 22 -eq 48 ']' 2023-10-25T23:44:11.321 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.22 2023-10-25T23:44:11.321 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.22 2023-10-25T23:44:11.330 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.330 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 23 -eq 48 ']' 2023-10-25T23:44:11.330 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.23 2023-10-25T23:44:11.330 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.23 2023-10-25T23:44:11.338 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.339 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 24 -eq 48 ']' 2023-10-25T23:44:11.339 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.24 2023-10-25T23:44:11.339 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.24 2023-10-25T23:44:11.347 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.347 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 25 -eq 48 ']' 2023-10-25T23:44:11.348 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.25 2023-10-25T23:44:11.348 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.25 2023-10-25T23:44:11.359 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.359 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 26 -eq 48 ']' 2023-10-25T23:44:11.359 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.26 2023-10-25T23:44:11.359 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.26 2023-10-25T23:44:11.367 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.368 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 27 -eq 48 ']' 2023-10-25T23:44:11.368 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.27 2023-10-25T23:44:11.368 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.27 2023-10-25T23:44:11.376 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.377 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 28 -eq 48 ']' 2023-10-25T23:44:11.377 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.28 2023-10-25T23:44:11.377 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.28 2023-10-25T23:44:11.385 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.385 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 29 -eq 48 ']' 2023-10-25T23:44:11.385 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.29 2023-10-25T23:44:11.386 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.29 2023-10-25T23:44:11.394 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.394 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 30 -eq 48 ']' 2023-10-25T23:44:11.394 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.30 2023-10-25T23:44:11.394 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.30 2023-10-25T23:44:11.402 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.402 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 31 -eq 48 ']' 2023-10-25T23:44:11.403 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.31 2023-10-25T23:44:11.403 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.31 2023-10-25T23:44:11.410 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.411 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 32 -eq 48 ']' 2023-10-25T23:44:11.411 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.32 2023-10-25T23:44:11.411 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.32 2023-10-25T23:44:11.419 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.419 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 33 -eq 48 ']' 2023-10-25T23:44:11.419 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.33 2023-10-25T23:44:11.420 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.33 2023-10-25T23:44:11.428 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.428 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 34 -eq 48 ']' 2023-10-25T23:44:11.429 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.34 2023-10-25T23:44:11.429 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.34 2023-10-25T23:44:11.437 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.437 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 35 -eq 48 ']' 2023-10-25T23:44:11.438 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.35 2023-10-25T23:44:11.438 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.35 2023-10-25T23:44:11.447 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.447 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 36 -eq 48 ']' 2023-10-25T23:44:11.447 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.36 2023-10-25T23:44:11.447 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.36 2023-10-25T23:44:11.456 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.456 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 37 -eq 48 ']' 2023-10-25T23:44:11.456 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.37 2023-10-25T23:44:11.457 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.37 2023-10-25T23:44:11.465 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.465 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 38 -eq 48 ']' 2023-10-25T23:44:11.465 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.38 2023-10-25T23:44:11.465 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.38 2023-10-25T23:44:11.474 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.474 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 39 -eq 48 ']' 2023-10-25T23:44:11.474 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.39 2023-10-25T23:44:11.474 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.39 2023-10-25T23:44:11.483 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.483 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 40 -eq 48 ']' 2023-10-25T23:44:11.483 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.40 2023-10-25T23:44:11.483 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.40 2023-10-25T23:44:11.492 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.492 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 41 -eq 48 ']' 2023-10-25T23:44:11.493 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.41 2023-10-25T23:44:11.493 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.41 2023-10-25T23:44:11.501 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.502 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 42 -eq 48 ']' 2023-10-25T23:44:11.502 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.42 2023-10-25T23:44:11.502 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.42 2023-10-25T23:44:11.511 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.511 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 43 -eq 48 ']' 2023-10-25T23:44:11.511 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.43 2023-10-25T23:44:11.511 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.43 2023-10-25T23:44:11.520 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.520 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 44 -eq 48 ']' 2023-10-25T23:44:11.520 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.44 2023-10-25T23:44:11.520 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.44 2023-10-25T23:44:11.529 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.529 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 45 -eq 48 ']' 2023-10-25T23:44:11.529 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.45 2023-10-25T23:44:11.529 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.45 2023-10-25T23:44:11.538 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.539 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 46 -eq 48 ']' 2023-10-25T23:44:11.539 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.46 2023-10-25T23:44:11.539 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.46 2023-10-25T23:44:11.547 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.548 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 47 -eq 48 ']' 2023-10-25T23:44:11.548 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.47 2023-10-25T23:44:11.548 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.47 2023-10-25T23:44:11.559 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.559 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 48 -eq 48 ']' 2023-10-25T23:44:11.560 INFO:tasks.workunit.client.0.smithi081.stderr:+ continue 2023-10-25T23:44:11.560 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.560 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 49 -eq 48 ']' 2023-10-25T23:44:11.560 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.49 2023-10-25T23:44:11.560 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.49 2023-10-25T23:44:11.568 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.569 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 50 -eq 48 ']' 2023-10-25T23:44:11.569 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.50 2023-10-25T23:44:11.569 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.50 2023-10-25T23:44:11.579 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.579 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 51 -eq 48 ']' 2023-10-25T23:44:11.579 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.51 2023-10-25T23:44:11.579 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.51 2023-10-25T23:44:11.588 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.588 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 52 -eq 48 ']' 2023-10-25T23:44:11.588 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.52 2023-10-25T23:44:11.588 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.52 2023-10-25T23:44:11.597 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.598 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 53 -eq 48 ']' 2023-10-25T23:44:11.598 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.53 2023-10-25T23:44:11.598 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.53 2023-10-25T23:44:11.608 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.608 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 54 -eq 48 ']' 2023-10-25T23:44:11.608 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.54 2023-10-25T23:44:11.609 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.54 2023-10-25T23:44:11.621 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.622 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 55 -eq 48 ']' 2023-10-25T23:44:11.622 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.55 2023-10-25T23:44:11.622 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.55 2023-10-25T23:44:11.631 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.631 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 56 -eq 48 ']' 2023-10-25T23:44:11.631 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.56 2023-10-25T23:44:11.631 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.56 2023-10-25T23:44:11.641 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.641 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 57 -eq 48 ']' 2023-10-25T23:44:11.641 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.57 2023-10-25T23:44:11.642 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.57 2023-10-25T23:44:11.651 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.651 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 58 -eq 48 ']' 2023-10-25T23:44:11.651 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.58 2023-10-25T23:44:11.651 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.58 2023-10-25T23:44:11.660 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.660 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 59 -eq 48 ']' 2023-10-25T23:44:11.660 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.59 2023-10-25T23:44:11.661 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.59 2023-10-25T23:44:11.670 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.670 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 60 -eq 48 ']' 2023-10-25T23:44:11.670 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.60 2023-10-25T23:44:11.670 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.60 2023-10-25T23:44:11.679 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.679 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 61 -eq 48 ']' 2023-10-25T23:44:11.680 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.61 2023-10-25T23:44:11.680 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.61 2023-10-25T23:44:11.690 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.690 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 62 -eq 48 ']' 2023-10-25T23:44:11.690 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.62 2023-10-25T23:44:11.691 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.62 2023-10-25T23:44:11.700 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.700 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 63 -eq 48 ']' 2023-10-25T23:44:11.700 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.63 2023-10-25T23:44:11.700 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.63 2023-10-25T23:44:11.709 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.709 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 64 -eq 48 ']' 2023-10-25T23:44:11.710 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.64 2023-10-25T23:44:11.710 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.64 2023-10-25T23:44:11.719 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.719 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 65 -eq 48 ']' 2023-10-25T23:44:11.720 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.65 2023-10-25T23:44:11.720 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.65 2023-10-25T23:44:11.728 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.729 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 66 -eq 48 ']' 2023-10-25T23:44:11.729 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.66 2023-10-25T23:44:11.729 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.66 2023-10-25T23:44:11.738 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.738 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 67 -eq 48 ']' 2023-10-25T23:44:11.738 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.67 2023-10-25T23:44:11.739 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.67 2023-10-25T23:44:11.748 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.748 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 68 -eq 48 ']' 2023-10-25T23:44:11.748 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.68 2023-10-25T23:44:11.749 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.68 2023-10-25T23:44:11.758 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.758 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 69 -eq 48 ']' 2023-10-25T23:44:11.758 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.69 2023-10-25T23:44:11.758 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.69 2023-10-25T23:44:11.768 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.768 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 70 -eq 48 ']' 2023-10-25T23:44:11.768 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.70 2023-10-25T23:44:11.769 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.70 2023-10-25T23:44:11.778 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.778 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 71 -eq 48 ']' 2023-10-25T23:44:11.779 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.71 2023-10-25T23:44:11.779 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.71 2023-10-25T23:44:11.788 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.788 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 72 -eq 48 ']' 2023-10-25T23:44:11.788 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.72 2023-10-25T23:44:11.789 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.72 2023-10-25T23:44:11.798 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.798 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 73 -eq 48 ']' 2023-10-25T23:44:11.798 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.73 2023-10-25T23:44:11.799 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.73 2023-10-25T23:44:11.808 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.808 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 74 -eq 48 ']' 2023-10-25T23:44:11.808 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.74 2023-10-25T23:44:11.809 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.74 2023-10-25T23:44:11.818 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.819 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 75 -eq 48 ']' 2023-10-25T23:44:11.819 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.75 2023-10-25T23:44:11.819 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.75 2023-10-25T23:44:11.829 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.829 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 76 -eq 48 ']' 2023-10-25T23:44:11.830 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.76 2023-10-25T23:44:11.830 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.76 2023-10-25T23:44:11.839 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.840 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 77 -eq 48 ']' 2023-10-25T23:44:11.840 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.77 2023-10-25T23:44:11.840 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.77 2023-10-25T23:44:11.850 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.850 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 78 -eq 48 ']' 2023-10-25T23:44:11.850 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.78 2023-10-25T23:44:11.851 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.78 2023-10-25T23:44:11.860 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.860 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 79 -eq 48 ']' 2023-10-25T23:44:11.861 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.79 2023-10-25T23:44:11.861 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.79 2023-10-25T23:44:11.870 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.871 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 80 -eq 48 ']' 2023-10-25T23:44:11.871 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.80 2023-10-25T23:44:11.871 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.80 2023-10-25T23:44:11.880 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.881 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 81 -eq 48 ']' 2023-10-25T23:44:11.881 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.81 2023-10-25T23:44:11.881 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.81 2023-10-25T23:44:11.891 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.891 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 82 -eq 48 ']' 2023-10-25T23:44:11.891 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.82 2023-10-25T23:44:11.892 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.82 2023-10-25T23:44:11.902 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.902 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 83 -eq 48 ']' 2023-10-25T23:44:11.902 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.83 2023-10-25T23:44:11.902 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.83 2023-10-25T23:44:11.912 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.912 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 84 -eq 48 ']' 2023-10-25T23:44:11.912 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.84 2023-10-25T23:44:11.912 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.84 2023-10-25T23:44:11.922 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.922 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 85 -eq 48 ']' 2023-10-25T23:44:11.923 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.85 2023-10-25T23:44:11.923 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.85 2023-10-25T23:44:11.933 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.933 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 86 -eq 48 ']' 2023-10-25T23:44:11.934 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.86 2023-10-25T23:44:11.934 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.86 2023-10-25T23:44:11.944 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.944 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 87 -eq 48 ']' 2023-10-25T23:44:11.944 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.87 2023-10-25T23:44:11.945 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.87 2023-10-25T23:44:11.954 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.954 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 88 -eq 48 ']' 2023-10-25T23:44:11.955 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.88 2023-10-25T23:44:11.955 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.88 2023-10-25T23:44:11.966 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.966 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 89 -eq 48 ']' 2023-10-25T23:44:11.966 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.89 2023-10-25T23:44:11.967 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.89 2023-10-25T23:44:11.977 INFO:tasks.workunit.client.0.smithi081.stderr:+ for v in $versions 2023-10-25T23:44:11.978 INFO:tasks.workunit.client.0.smithi081.stderr:+ '[' 90 -eq 48 ']' 2023-10-25T23:44:11.978 INFO:tasks.workunit.client.0.smithi081.stderr:+ ver=v0.90 2023-10-25T23:44:11.978 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir .snap/v0.90 2023-10-25T23:44:11.989 INFO:tasks.workunit.client.0.smithi081.stdout:OK 2023-10-25T23:44:11.990 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo OK 2023-10-25T23:44:11.990 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-25T23:44:11.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-25T23:44:17.315 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:44:17.318 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:44:28.636 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-hardlink.sh... 2023-10-25T23:44:28.636 DEBUG:teuthology.orchestra.run.smithi081:workunit test fs/snaps/snaptest-hardlink.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-hardlink.sh 2023-10-25T23:44:28.671 INFO:tasks.workunit.client.0.smithi081.stderr:+ set -e 2023-10-25T23:44:28.671 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir 1 2 2023-10-25T23:44:28.673 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo asdf 2023-10-25T23:44:28.673 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo asdf 2023-10-25T23:44:28.674 INFO:tasks.workunit.client.0.smithi081.stderr:+ ln 1/file1 2/file1 2023-10-25T23:44:28.676 INFO:tasks.workunit.client.0.smithi081.stderr:+ ln 1/file2 2/file2 2023-10-25T23:44:28.677 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir 2/.snap/s1 2023-10-25T23:44:28.706 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo qwer 2023-10-25T23:44:28.715 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep asdf 2/.snap/s1/file1 2023-10-25T23:44:28.726 INFO:tasks.workunit.client.0.smithi081.stdout:asdf 2023-10-25T23:44:28.726 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm -f 1/file2 2023-10-25T23:44:28.728 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep asdf 2/.snap/s1/file2 2023-10-25T23:44:28.743 INFO:tasks.workunit.client.0.smithi081.stdout:asdf 2023-10-25T23:44:28.743 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm -f 2/file2 2023-10-25T23:44:28.746 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep asdf 2/.snap/s1/file2 2023-10-25T23:44:28.749 INFO:tasks.workunit.client.0.smithi081.stdout:asdf 2023-10-25T23:44:28.749 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir 2/.snap/s1 2023-10-25T23:44:28.754 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm -rf 1 2 2023-10-25T23:44:28.776 INFO:tasks.workunit.client.0.smithi081.stdout:OK 2023-10-25T23:44:28.777 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo OK 2023-10-25T23:44:28.777 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-25T23:44:28.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-25T23:44:28.849 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-intodir.sh... 2023-10-25T23:44:28.850 DEBUG:teuthology.orchestra.run.smithi081:workunit test fs/snaps/snaptest-intodir.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-intodir.sh 2023-10-25T23:44:28.911 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir foo 2023-10-25T23:44:28.913 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir foo/.snap/one 2023-10-25T23:44:28.938 INFO:tasks.workunit.client.0.smithi081.stderr:+ touch bar 2023-10-25T23:44:28.940 INFO:tasks.workunit.client.0.smithi081.stderr:+ mv bar foo 2023-10-25T23:44:28.943 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:44:36.884 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir baz 2023-10-25T23:44:36.888 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir baz/.snap/two 2023-10-25T23:44:36.920 INFO:tasks.workunit.client.0.smithi081.stderr:+ mv baz foo 2023-10-25T23:44:36.938 INFO:tasks.workunit.client.0.smithi081.stderr:+ sync 2023-10-25T23:44:37.164 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir foo/baz/.snap/two 2023-10-25T23:44:37.174 INFO:tasks.workunit.client.0.smithi081.stderr:+ rmdir foo/.snap/one 2023-10-25T23:44:37.181 INFO:tasks.workunit.client.0.smithi081.stderr:+ rm -r foo 2023-10-25T23:44:37.194 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo OK 2023-10-25T23:44:37.195 INFO:tasks.workunit.client.0.smithi081.stdout:OK 2023-10-25T23:44:37.195 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-25T23:44:37.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-25T23:44:37.272 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-multiple-capsnaps.sh... 2023-10-25T23:44:37.272 DEBUG:teuthology.orchestra.run.smithi081:workunit test fs/snaps/snaptest-multiple-capsnaps.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-multiple-capsnaps.sh 2023-10-25T23:44:37.336 INFO:tasks.workunit.client.0.smithi081.stderr:+ set -e 2023-10-25T23:44:37.336 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo asdf 2023-10-25T23:44:37.337 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/1 2023-10-25T23:44:37.368 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 777 a 2023-10-25T23:44:37.369 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/2 2023-10-25T23:44:37.395 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo qwer 2023-10-25T23:44:37.409 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/3 2023-10-25T23:44:37.435 INFO:tasks.workunit.client.0.smithi081.stderr:+ chmod 666 a 2023-10-25T23:44:37.438 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/4 2023-10-25T23:44:37.472 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo zxcv 2023-10-25T23:44:37.481 INFO:tasks.workunit.client.0.smithi081.stderr:+ mkdir .snap/5 2023-10-25T23:44:37.526 INFO:tasks.workunit.client.0.smithi081.stderr:+ ls -al .snap/1/a .snap/2/a .snap/3/a .snap/4/a .snap/5/a 2023-10-25T23:44:37.528 INFO:tasks.workunit.client.0.smithi081.stdout:-rw-rw-r--. 1 ubuntu ubuntu 5 Oct 25 23:44 .snap/1/a 2023-10-25T23:44:37.528 INFO:tasks.workunit.client.0.smithi081.stdout:-rw-rw-r--. 1 ubuntu ubuntu 5 Oct 25 23:44 .snap/2/a 2023-10-25T23:44:37.528 INFO:tasks.workunit.client.0.smithi081.stdout:-rwxrwxrwx. 1 ubuntu ubuntu 5 Oct 25 23:44 .snap/3/a 2023-10-25T23:44:37.528 INFO:tasks.workunit.client.0.smithi081.stdout:-rw-rw-rw-. 1 ubuntu ubuntu 5 Oct 25 23:44 .snap/4/a 2023-10-25T23:44:37.528 INFO:tasks.workunit.client.0.smithi081.stdout:-rw-rw-rw-. 1 ubuntu ubuntu 5 Oct 25 23:44 .snap/5/a 2023-10-25T23:44:37.529 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep asdf .snap/1/a 2023-10-25T23:44:37.529 INFO:tasks.workunit.client.0.smithi081.stdout:asdf 2023-10-25T23:44:37.530 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/1/a 2023-10-25T23:44:37.530 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'Size: 5' 2023-10-25T23:44:37.531 INFO:tasks.workunit.client.0.smithi081.stdout: Size: 5 Blocks: 1 IO Block: 4194304 regular file 2023-10-25T23:44:37.531 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep asdf .snap/2/a 2023-10-25T23:44:37.531 INFO:tasks.workunit.client.0.smithi081.stdout:asdf 2023-10-25T23:44:37.532 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/2/a 2023-10-25T23:44:37.532 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep 'Size: 5' 2023-10-25T23:44:37.533 INFO:tasks.workunit.client.0.smithi081.stdout: Size: 5 Blocks: 1 IO Block: 4194304 regular file 2023-10-25T23:44:37.533 INFO:tasks.workunit.client.0.smithi081.stderr:+ stat .snap/2/a 2023-10-25T23:44:37.533 INFO:tasks.workunit.client.0.smithi081.stderr:+ grep -- -rwxrwxrwx 2023-10-25T23:44:37.534 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T23:44:37.535 INFO:tasks.workunit:Stopping ['fs/snaps'] on client.0... 2023-10-25T23:44:37.535 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-25T23:44:37.829 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi081 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-multiple-capsnaps.sh' 2023-10-25T23:44:39.151 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=aeedaf5b85f94e20861cfe8bb8778dfb Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_384993681abceb8cb8affea10538d607052db4b4/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi081 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-multiple-capsnaps.sh' 2023-10-25T23:44:39.165 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-25T23:44:39.179 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-25T23:44:39.180 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:44:39.180 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T23:44:39.212 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-10-25T23:44:39.213 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-25T23:44:39.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T23:44:39.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.430+0000 7fd8629aa700 1 -- 172.21.15.81:0/3785591557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c1351e0 msgr2=0x7fd85c06a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:39.432 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.430+0000 7fd8629aa700 1 --2- 172.21.15.81:0/3785591557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c1351e0 0x7fd85c06a210 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd850005fd0 tx=0x7fd850009c70 comp rx=0 tx=0).stop 2023-10-25T23:44:39.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.430+0000 7fd8629aa700 1 -- 172.21.15.81:0/3785591557 shutdown_connections 2023-10-25T23:44:39.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.430+0000 7fd8629aa700 1 --2- 172.21.15.81:0/3785591557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c1351e0 0x7fd85c06a210 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:39.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.430+0000 7fd8629aa700 1 --2- 172.21.15.81:0/3785591557 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd85c06a750 0x7fd85c0bbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:39.433 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.430+0000 7fd8629aa700 1 -- 172.21.15.81:0/3785591557 >> 172.21.15.81:0/3785591557 conn(0x7fd85c0c0a40 msgr2=0x7fd85c0c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:39.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.430+0000 7fd8629aa700 1 -- 172.21.15.81:0/3785591557 shutdown_connections 2023-10-25T23:44:39.434 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.430+0000 7fd8629aa700 1 -- 172.21.15.81:0/3785591557 wait complete. 2023-10-25T23:44:39.437 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.431+0000 7fd8629aa700 1 Processor -- start 2023-10-25T23:44:39.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.431+0000 7fd8629aa700 1 -- start start 2023-10-25T23:44:39.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd8629aa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c06a750 0x7fd85c130f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:39.438 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd8629aa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd85c0bc3e0 0x7fd85c1e3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:39.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd8629aa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd85c1351e0 0x7fd85c1d7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:39.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd8629aa700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c1e6240 con 0x7fd85c06a750 2023-10-25T23:44:39.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd8629aa700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c1e2950 con 0x7fd85c0bc3e0 2023-10-25T23:44:39.439 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd8629aa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c1e2ed0 con 0x7fd85c1351e0 2023-10-25T23:44:39.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd85bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c06a750 0x7fd85c130f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:39.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd85bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c06a750 0x7fd85c130f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36984/0 (socket says 172.21.15.81:36984) 2023-10-25T23:44:39.440 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd85bfff700 1 -- 172.21.15.81:0/77518455 learned_addr learned my addr 172.21.15.81:0/77518455 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:39.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd85b7fe700 1 --2- 172.21.15.81:0/77518455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd85c0bc3e0 0x7fd85c1e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:39.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd860f47700 1 --2- 172.21.15.81:0/77518455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd85c1351e0 0x7fd85c1d7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:39.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd85bfff700 1 -- 172.21.15.81:0/77518455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd85c1351e0 msgr2=0x7fd85c1d7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:39.441 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd85bfff700 1 --2- 172.21.15.81:0/77518455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd85c1351e0 0x7fd85c1d7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:39.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd85bfff700 1 -- 172.21.15.81:0/77518455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd85c0bc3e0 msgr2=0x7fd85c1e3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:39.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd85bfff700 1 --2- 172.21.15.81:0/77518455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd85c0bc3e0 0x7fd85c1e3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:39.442 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd85bfff700 1 -- 172.21.15.81:0/77518455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8500095f0 con 0x7fd85c06a750 2023-10-25T23:44:39.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd85b7fe700 1 --2- 172.21.15.81:0/77518455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd85c0bc3e0 0x7fd85c1e3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:44:39.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd860f47700 1 --2- 172.21.15.81:0/77518455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd85c1351e0 0x7fd85c1d7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:44:39.443 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd85bfff700 1 --2- 172.21.15.81:0/77518455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c06a750 0x7fd85c130f60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd85000b5e0 tx=0x7fd850004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:39.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd858ff9700 1 -- 172.21.15.81:0/77518455 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85001c070 con 0x7fd85c06a750 2023-10-25T23:44:39.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.432+0000 7fd858ff9700 1 -- 172.21.15.81:0/77518455 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd85000b820 con 0x7fd85c06a750 2023-10-25T23:44:39.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.433+0000 7fd8629aa700 1 -- 172.21.15.81:0/77518455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85c0bb470 con 0x7fd85c06a750 2023-10-25T23:44:39.444 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.433+0000 7fd858ff9700 1 -- 172.21.15.81:0/77518455 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8500045f0 con 0x7fd85c06a750 2023-10-25T23:44:39.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.433+0000 7fd8629aa700 1 -- 172.21.15.81:0/77518455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85c1314a0 con 0x7fd85c06a750 2023-10-25T23:44:39.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.434+0000 7fd8629aa700 1 -- 172.21.15.81:0/77518455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85c04e4c0 con 0x7fd85c06a750 2023-10-25T23:44:39.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.434+0000 7fd858ff9700 1 -- 172.21.15.81:0/77518455 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd85000bbf0 con 0x7fd85c06a750 2023-10-25T23:44:39.445 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.434+0000 7fd858ff9700 1 --2- 172.21.15.81:0/77518455 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd84806aed0 0x7fd84806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:39.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.434+0000 7fd858ff9700 1 -- 172.21.15.81:0/77518455 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fd85008acd0 con 0x7fd85c06a750 2023-10-25T23:44:39.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.434+0000 7fd85b7fe700 1 --2- 172.21.15.81:0/77518455 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd84806aed0 0x7fd84806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:39.446 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.435+0000 7fd85b7fe700 1 --2- 172.21.15.81:0/77518455 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd84806aed0 0x7fd84806d390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0c0390 tx=0x7fd84c009260 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:39.447 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.439+0000 7fd858ff9700 1 -- 172.21.15.81:0/77518455 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd850055d60 con 0x7fd85c06a750 2023-10-25T23:44:39.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.668+0000 7fd8629aa700 1 -- 172.21.15.81:0/77518455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd85c0bcd30 con 0x7fd85c06a750 2023-10-25T23:44:39.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.669+0000 7fd858ff9700 1 -- 172.21.15.81:0/77518455 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16820 (secure 0 0 0) 0x7fd850025070 con 0x7fd85c06a750 2023-10-25T23:44:39.671 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:44:39.671 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"fsid":"97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf","created":"2023-10-25T23:35:42.986840+0000","modified":"2023-10-25T23:44:38.868183+0000","last_up_change":"2023-10-25T23:35:55.052199+0000","last_in_change":"2023-10-25T23:35:46.443490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T23:35:57.031170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T23:36:06.841771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T23:36:07.613269+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":689,"snap_epoch":40,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48415836-8f22-4dcd-baa3-1d09c90c9a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6809","nonce":1045657984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6811","nonce":1045657984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6815","nonce":1045657984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6813","nonce":1045657984}]},"public_addr":"172.21.15.81:6809/1045657984","cluster_addr":"172.21.15.81:6811/1045657984","heartbeat_back_addr":"172.21.15.81:6815/1045657984","heartbeat_front_addr":"172.21.15.81:6813/1045657984","state":["exists","up"]},{"osd":1,"uuid":"19a4f6b5-e75c-45ae-aa08-b3467e69eed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6801","nonce":725386907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6803","nonce":725386907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6807","nonce":725386907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6805","nonce":725386907}]},"public_addr":"172.21.15.81:6801/725386907","cluster_addr":"172.21.15.81:6803/725386907","heartbeat_back_addr":"172.21.15.81:6807/725386907","heartbeat_front_addr":"172.21.15.81:6805/725386907","state":["exists","up"]},{"osd":2,"uuid":"60645312-54f5-4a74-ae52-68d17ff2d6e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6825","nonce":1744054610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6827","nonce":1744054610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6831","nonce":1744054610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6829","nonce":1744054610}]},"public_addr":"172.21.15.81:6825/1744054610","cluster_addr":"172.21.15.81:6827/1744054610","heartbeat_back_addr":"172.21.15.81:6831/1744054610","heartbeat_front_addr":"172.21.15.81:6829/1744054610","state":["exists","up"]},{"osd":3,"uuid":"c636a4a2-c1e8-4306-a78b-fe37eebab526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6817","nonce":1391123341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6819","nonce":1391123341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6823","nonce":1391123341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6821","nonce":1391123341}]},"public_addr":"172.21.15.81:6817/1391123341","cluster_addr":"172.21.15.81:6819/1391123341","heartbeat_back_addr":"172.21.15.81:6823/1391123341","heartbeat_front_addr":"172.21.15.81:6821/1391123341","state":["exists","up"]},{"osd":4,"uuid":"3cafc826-e531-4aa7-8b2a-b592f318f138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6817","nonce":1232781703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6819","nonce":1232781703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6823","nonce":1232781703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6821","nonce":1232781703}]},"public_addr":"172.21.15.89:6817/1232781703","cluster_addr":"172.21.15.89:6819/1232781703","heartbeat_back_addr":"172.21.15.89:6823/1232781703","heartbeat_front_addr":"172.21.15.89:6821/1232781703","state":["exists","up"]},{"osd":5,"uuid":"6098deb2-258e-47e1-b283-9a24c9dddf27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6801","nonce":2255820086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6803","nonce":2255820086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6807","nonce":2255820086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6805","nonce":2255820086}]},"public_addr":"172.21.15.89:6801/2255820086","cluster_addr":"172.21.15.89:6803/2255820086","heartbeat_back_addr":"172.21.15.89:6807/2255820086","heartbeat_front_addr":"172.21.15.89:6805/2255820086","state":["exists","up"]},{"osd":6,"uuid":"d79f68de-3c19-4f68-bbd1-59c8484dfaa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6809","nonce":2561967165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6811","nonce":2561967165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6815","nonce":2561967165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6813","nonce":2561967165}]},"public_addr":"172.21.15.89:6809/2561967165","cluster_addr":"172.21.15.89:6811/2561967165","heartbeat_back_addr":"172.21.15.89:6815/2561967165","heartbeat_front_addr":"172.21.15.89:6813/2561967165","state":["exists","up"]},{"osd":7,"uuid":"f1f7002e-4de9-4a08-97a1-fb52a116687f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6825","nonce":2647243500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6827","nonce":2647243500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6831","nonce":2647243500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6829","nonce":2647243500}]},"public_addr":"172.21.15.89:6825/2647243500","cluster_addr":"172.21.15.89:6827/2647243500","heartbeat_back_addr":"172.21.15.89:6831/2647243500","heartbeat_front_addr":"172.21.15.89:6829/2647243500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.613750+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.593515+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.713198+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.725623+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.686409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.596728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.670930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.676762+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":686,"length":4}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":686,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T23:44:39.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.671+0000 7fd8629aa700 1 -- 172.21.15.81:0/77518455 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd84806aed0 msgr2=0x7fd84806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:39.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.671+0000 7fd8629aa700 1 --2- 172.21.15.81:0/77518455 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd84806aed0 0x7fd84806d390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0c0390 tx=0x7fd84c009260 comp rx=0 tx=0).stop 2023-10-25T23:44:39.673 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.671+0000 7fd8629aa700 1 -- 172.21.15.81:0/77518455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c06a750 msgr2=0x7fd85c130f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:39.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.671+0000 7fd8629aa700 1 --2- 172.21.15.81:0/77518455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c06a750 0x7fd85c130f60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd85000b5e0 tx=0x7fd850004310 comp rx=0 tx=0).stop 2023-10-25T23:44:39.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.671+0000 7fd8629aa700 1 -- 172.21.15.81:0/77518455 shutdown_connections 2023-10-25T23:44:39.674 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.671+0000 7fd8629aa700 1 --2- 172.21.15.81:0/77518455 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd85c1351e0 0x7fd85c1d7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:39.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.671+0000 7fd8629aa700 1 --2- 172.21.15.81:0/77518455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c06a750 0x7fd85c130f60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:39.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.671+0000 7fd8629aa700 1 --2- 172.21.15.81:0/77518455 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fd84806aed0 0x7fd84806d390 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:39.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.671+0000 7fd8629aa700 1 --2- 172.21.15.81:0/77518455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd85c0bc3e0 0x7fd85c1e3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:39.675 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.671+0000 7fd8629aa700 1 -- 172.21.15.81:0/77518455 >> 172.21.15.81:0/77518455 conn(0x7fd85c0c0a40 msgr2=0x7fd85c133f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:39.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.671+0000 7fd8629aa700 1 -- 172.21.15.81:0/77518455 shutdown_connections 2023-10-25T23:44:39.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.671+0000 7fd8629aa700 1 -- 172.21.15.81:0/77518455 wait complete. 2023-10-25T23:44:39.685 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-25T23:35:57.031170+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-25T23:36:06.841771+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-25T23:36:07.613269+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 689, 'snap_epoch': 40, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-25T23:44:39.686 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-25T23:44:39.812 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.810+0000 7fa5b69cc700 1 -- 172.21.15.81:0/2009605807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5b0144f60 msgr2=0x7fa5b014b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.810+0000 7fa5b69cc700 1 --2- 172.21.15.81:0/2009605807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5b0144f60 0x7fa5b014b990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4005fd0 tx=0x7fa5a4009c70 comp rx=0 tx=0).stop 2023-10-25T23:44:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.810+0000 7fa5b69cc700 1 -- 172.21.15.81:0/2009605807 shutdown_connections 2023-10-25T23:44:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.810+0000 7fa5b69cc700 1 --2- 172.21.15.81:0/2009605807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5b0144f60 0x7fa5b014b990 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.810+0000 7fa5b69cc700 1 -- 172.21.15.81:0/2009605807 >> 172.21.15.81:0/2009605807 conn(0x7fa5b006b320 msgr2=0x7fa5b006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.810+0000 7fa5b69cc700 1 -- 172.21.15.81:0/2009605807 shutdown_connections 2023-10-25T23:44:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.810+0000 7fa5b69cc700 1 -- 172.21.15.81:0/2009605807 wait complete. 2023-10-25T23:44:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.812+0000 7fa5b69cc700 1 Processor -- start 2023-10-25T23:44:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.812+0000 7fa5b69cc700 1 -- start start 2023-10-25T23:44:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5b69cc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5b00bb530 0x7fa5b00baef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5b69cc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5b0144f60 0x7fa5b013e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:39.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5b69cc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5b01538f0 0x7fa5b0135700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:39.824 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5b69cc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b013c6f0 con 0x7fa5b0144f60 2023-10-25T23:44:39.825 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5b69cc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b013ed00 con 0x7fa5b01538f0 2023-10-25T23:44:39.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5b69cc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b013c960 con 0x7fa5b00bb530 2023-10-25T23:44:39.826 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5af7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5b0144f60 0x7fa5b013e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:39.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5af7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5b0144f60 0x7fa5b013e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36998/0 (socket says 172.21.15.81:36998) 2023-10-25T23:44:39.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5af7fe700 1 -- 172.21.15.81:0/35280567 learned_addr learned my addr 172.21.15.81:0/35280567 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:39.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5b4f69700 1 --2- 172.21.15.81:0/35280567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5b01538f0 0x7fa5b0135700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:39.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5affff700 1 --2- 172.21.15.81:0/35280567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5b00bb530 0x7fa5b00baef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:39.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5af7fe700 1 -- 172.21.15.81:0/35280567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5b00bb530 msgr2=0x7fa5b00baef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5af7fe700 1 --2- 172.21.15.81:0/35280567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5b00bb530 0x7fa5b00baef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5af7fe700 1 -- 172.21.15.81:0/35280567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5b01538f0 msgr2=0x7fa5b0135700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5af7fe700 1 --2- 172.21.15.81:0/35280567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5b01538f0 0x7fa5b0135700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5af7fe700 1 -- 172.21.15.81:0/35280567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a40095f0 con 0x7fa5b0144f60 2023-10-25T23:44:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5affff700 1 --2- 172.21.15.81:0/35280567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5b00bb530 0x7fa5b00baef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:44:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5af7fe700 1 --2- 172.21.15.81:0/35280567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5b0144f60 0x7fa5b013e7c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000c420 tx=0x7fa5a000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5acff9700 1 -- 172.21.15.81:0/35280567 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a00052d0 con 0x7fa5b0144f60 2023-10-25T23:44:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5acff9700 1 -- 172.21.15.81:0/35280567 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa5a0005520 con 0x7fa5b0144f60 2023-10-25T23:44:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5acff9700 1 -- 172.21.15.81:0/35280567 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a00038e0 con 0x7fa5b0144f60 2023-10-25T23:44:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5b69cc700 1 -- 172.21.15.81:0/35280567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b00b9260 con 0x7fa5b0144f60 2023-10-25T23:44:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.813+0000 7fa5b69cc700 1 -- 172.21.15.81:0/35280567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b00b9820 con 0x7fa5b0144f60 2023-10-25T23:44:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.814+0000 7fa5b69cc700 1 -- 172.21.15.81:0/35280567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b01e4730 con 0x7fa5b0144f60 2023-10-25T23:44:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.815+0000 7fa5acff9700 1 -- 172.21.15.81:0/35280567 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa5a0003a40 con 0x7fa5b0144f60 2023-10-25T23:44:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.815+0000 7fa5acff9700 1 --2- 172.21.15.81:0/35280567 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa59c06aed0 0x7fa59c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.815+0000 7fa5acff9700 1 -- 172.21.15.81:0/35280567 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fa5a0088cd0 con 0x7fa5b0144f60 2023-10-25T23:44:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.815+0000 7fa5affff700 1 --2- 172.21.15.81:0/35280567 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa59c06aed0 0x7fa59c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.816+0000 7fa5affff700 1 --2- 172.21.15.81:0/35280567 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa59c06aed0 0x7fa59c06d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4000c00 tx=0x7fa5a40047c0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:39.820+0000 7fa5acff9700 1 -- 172.21.15.81:0/35280567 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5b01e4730 con 0x7fa5b0144f60 2023-10-25T23:44:40.010 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.009+0000 7fa5b69cc700 1 -- 172.21.15.81:0/35280567 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5b01e4730 con 0x7fa5b0144f60 2023-10-25T23:44:40.011 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.009+0000 7fa5acff9700 1 -- 172.21.15.81:0/35280567 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5b01e4730 con 0x7fa5b0144f60 2023-10-25T23:44:40.011 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2023-10-25T23:44:40.013 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.011+0000 7fa5b69cc700 1 -- 172.21.15.81:0/35280567 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa59c06aed0 msgr2=0x7fa59c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:40.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.011+0000 7fa5b69cc700 1 --2- 172.21.15.81:0/35280567 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa59c06aed0 0x7fa59c06d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4000c00 tx=0x7fa5a40047c0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.011+0000 7fa5b69cc700 1 -- 172.21.15.81:0/35280567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5b0144f60 msgr2=0x7fa5b013e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:40.014 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.011+0000 7fa5b69cc700 1 --2- 172.21.15.81:0/35280567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5b0144f60 0x7fa5b013e7c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000c420 tx=0x7fa5a000c7e0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.011+0000 7fa5b69cc700 1 -- 172.21.15.81:0/35280567 shutdown_connections 2023-10-25T23:44:40.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.011+0000 7fa5b69cc700 1 --2- 172.21.15.81:0/35280567 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fa59c06aed0 0x7fa59c06d390 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.011+0000 7fa5b69cc700 1 --2- 172.21.15.81:0/35280567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5b01538f0 0x7fa5b0135700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.015 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.011+0000 7fa5b69cc700 1 --2- 172.21.15.81:0/35280567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5b00bb530 0x7fa5b00baef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.011+0000 7fa5b69cc700 1 --2- 172.21.15.81:0/35280567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5b0144f60 0x7fa5b013e7c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.011+0000 7fa5b69cc700 1 -- 172.21.15.81:0/35280567 >> 172.21.15.81:0/35280567 conn(0x7fa5b006b320 msgr2=0x7fa5b00c0350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:40.017 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.011+0000 7fa5b69cc700 1 -- 172.21.15.81:0/35280567 shutdown_connections 2023-10-25T23:44:40.018 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.011+0000 7fa5b69cc700 1 -- 172.21.15.81:0/35280567 wait complete. 2023-10-25T23:44:40.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-25T23:44:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.150+0000 7fc4af6ad700 1 -- 172.21.15.81:0/192283662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a80bdb00 msgr2=0x7fc4a8155900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:40.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.150+0000 7fc4af6ad700 1 --2- 172.21.15.81:0/192283662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a80bdb00 0x7fc4a8155900 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80b6130 tx=0x7fc4a000b380 comp rx=0 tx=0).stop 2023-10-25T23:44:40.153 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.150+0000 7fc4af6ad700 1 -- 172.21.15.81:0/192283662 shutdown_connections 2023-10-25T23:44:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.150+0000 7fc4af6ad700 1 --2- 172.21.15.81:0/192283662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a80bdb00 0x7fc4a8155900 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.150+0000 7fc4af6ad700 1 --2- 172.21.15.81:0/192283662 >> v2:172.21.15.89:3300/0 conn(0x7fc4a80bb530 0x7fc4a80bd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.150+0000 7fc4af6ad700 1 -- 172.21.15.81:0/192283662 >> 172.21.15.81:0/192283662 conn(0x7fc4a806b320 msgr2=0x7fc4a806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.150+0000 7fc4af6ad700 1 -- 172.21.15.81:0/192283662 shutdown_connections 2023-10-25T23:44:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.150+0000 7fc4af6ad700 1 -- 172.21.15.81:0/192283662 wait complete. 2023-10-25T23:44:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.152+0000 7fc4af6ad700 1 Processor -- start 2023-10-25T23:44:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.152+0000 7fc4af6ad700 1 -- start start 2023-10-25T23:44:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.152+0000 7fc4af6ad700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a80bb530 0x7fc4a8146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.152+0000 7fc4af6ad700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4a80bdb00 0x7fc4a81d37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.152+0000 7fc4af6ad700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4a8144f60 0x7fc4a8141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.152+0000 7fc4af6ad700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a81d4770 con 0x7fc4a80bb530 2023-10-25T23:44:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.152+0000 7fc4af6ad700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a81d3d10 con 0x7fc4a80bdb00 2023-10-25T23:44:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.152+0000 7fc4af6ad700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a81e47c0 con 0x7fc4a8144f60 2023-10-25T23:44:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.152+0000 7fc4ad449700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a80bb530 0x7fc4a8146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.152+0000 7fc4ad449700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a80bb530 0x7fc4a8146d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37010/0 (socket says 172.21.15.81:37010) 2023-10-25T23:44:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.152+0000 7fc4ad449700 1 -- 172.21.15.81:0/1289186536 learned_addr learned my addr 172.21.15.81:0/1289186536 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.153+0000 7fc4acc48700 1 --2- 172.21.15.81:0/1289186536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4a80bdb00 0x7fc4a81d37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.153+0000 7fc4adc4a700 1 --2- 172.21.15.81:0/1289186536 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4a8144f60 0x7fc4a8141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.153+0000 7fc4ad449700 1 -- 172.21.15.81:0/1289186536 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4a8144f60 msgr2=0x7fc4a8141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.153+0000 7fc4ad449700 1 --2- 172.21.15.81:0/1289186536 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4a8144f60 0x7fc4a8141520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.153+0000 7fc4ad449700 1 -- 172.21.15.81:0/1289186536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4a80bdb00 msgr2=0x7fc4a81d37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.153+0000 7fc4ad449700 1 --2- 172.21.15.81:0/1289186536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4a80bdb00 0x7fc4a81d37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.153+0000 7fc4ad449700 1 -- 172.21.15.81:0/1289186536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a0009d00 con 0x7fc4a80bb530 2023-10-25T23:44:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.153+0000 7fc4acc48700 1 --2- 172.21.15.81:0/1289186536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4a80bdb00 0x7fc4a81d37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:44:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.153+0000 7fc4adc4a700 1 --2- 172.21.15.81:0/1289186536 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4a8144f60 0x7fc4a8141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:44:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.153+0000 7fc4ad449700 1 --2- 172.21.15.81:0/1289186536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a80bb530 0x7fc4a8146d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc49800c510 tx=0x7fc49800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.153+0000 7fc49dffb700 1 -- 172.21.15.81:0/1289186536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4980052d0 con 0x7fc4a80bb530 2023-10-25T23:44:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.153+0000 7fc49dffb700 1 -- 172.21.15.81:0/1289186536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc498005520 con 0x7fc4a80bb530 2023-10-25T23:44:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.153+0000 7fc4af6ad700 1 -- 172.21.15.81:0/1289186536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a81d4490 con 0x7fc4a80bb530 2023-10-25T23:44:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.153+0000 7fc49dffb700 1 -- 172.21.15.81:0/1289186536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4980038e0 con 0x7fc4a80bb530 2023-10-25T23:44:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.153+0000 7fc4af6ad700 1 -- 172.21.15.81:0/1289186536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a8145e40 con 0x7fc4a80bb530 2023-10-25T23:44:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.154+0000 7fc4af6ad700 1 -- 172.21.15.81:0/1289186536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a806dcc0 con 0x7fc4a80bb530 2023-10-25T23:44:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.154+0000 7fc49dffb700 1 -- 172.21.15.81:0/1289186536 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc498003a40 con 0x7fc4a80bb530 2023-10-25T23:44:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.155+0000 7fc49dffb700 1 --2- 172.21.15.81:0/1289186536 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc48c06aed0 0x7fc48c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.155+0000 7fc49dffb700 1 -- 172.21.15.81:0/1289186536 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fc498088d90 con 0x7fc4a80bb530 2023-10-25T23:44:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.155+0000 7fc4acc48700 1 --2- 172.21.15.81:0/1289186536 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc48c06aed0 0x7fc48c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:40.169 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.155+0000 7fc4acc48700 1 --2- 172.21.15.81:0/1289186536 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc48c06aed0 0x7fc48c06d390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80b8840 tx=0x7fc4a4009260 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.159+0000 7fc49dffb700 1 -- 172.21.15.81:0/1289186536 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc498053e20 con 0x7fc4a80bb530 2023-10-25T23:44:40.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.351+0000 7fc4af6ad700 1 -- 172.21.15.81:0/1289186536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc4a804e4c0 con 0x7fc4a80bb530 2023-10-25T23:44:40.353 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.351+0000 7fc49dffb700 1 -- 172.21.15.81:0/1289186536 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc498017020 con 0x7fc4a80bb530 2023-10-25T23:44:40.354 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2023-10-25T23:44:40.355 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.354+0000 7fc4af6ad700 1 -- 172.21.15.81:0/1289186536 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc48c06aed0 msgr2=0x7fc48c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:40.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.354+0000 7fc4af6ad700 1 --2- 172.21.15.81:0/1289186536 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc48c06aed0 0x7fc48c06d390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80b8840 tx=0x7fc4a4009260 comp rx=0 tx=0).stop 2023-10-25T23:44:40.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.354+0000 7fc4af6ad700 1 -- 172.21.15.81:0/1289186536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a80bb530 msgr2=0x7fc4a8146d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:40.356 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.354+0000 7fc4af6ad700 1 --2- 172.21.15.81:0/1289186536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a80bb530 0x7fc4a8146d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc49800c510 tx=0x7fc49800c8d0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.354+0000 7fc4af6ad700 1 -- 172.21.15.81:0/1289186536 shutdown_connections 2023-10-25T23:44:40.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.354+0000 7fc4af6ad700 1 --2- 172.21.15.81:0/1289186536 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4a8144f60 0x7fc4a8141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.357 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.354+0000 7fc4af6ad700 1 --2- 172.21.15.81:0/1289186536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a80bb530 0x7fc4a8146d40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.354+0000 7fc4af6ad700 1 --2- 172.21.15.81:0/1289186536 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc48c06aed0 0x7fc48c06d390 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.354+0000 7fc4af6ad700 1 --2- 172.21.15.81:0/1289186536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4a80bdb00 0x7fc4a81d37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.358 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.354+0000 7fc4af6ad700 1 -- 172.21.15.81:0/1289186536 >> 172.21.15.81:0/1289186536 conn(0x7fc4a806b320 msgr2=0x7fc4a80b8920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:40.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.354+0000 7fc4af6ad700 1 -- 172.21.15.81:0/1289186536 shutdown_connections 2023-10-25T23:44:40.359 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.354+0000 7fc4af6ad700 1 -- 172.21.15.81:0/1289186536 wait complete. 2023-10-25T23:44:40.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-25T23:44:40.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.492+0000 7f9601049700 1 -- 172.21.15.81:0/568272790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95fc06deb0 msgr2=0x7f95fc14c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:40.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.492+0000 7f9601049700 1 --2- 172.21.15.81:0/568272790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95fc06deb0 0x7f95fc14c2d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f95f00098c0 tx=0x7f95f0009bd0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.492+0000 7f9601049700 1 -- 172.21.15.81:0/568272790 shutdown_connections 2023-10-25T23:44:40.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.492+0000 7f9601049700 1 --2- 172.21.15.81:0/568272790 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95fc0c1580 0x7f95fc156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.492+0000 7f9601049700 1 --2- 172.21.15.81:0/568272790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95fc06deb0 0x7f95fc14c2d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.492+0000 7f9601049700 1 -- 172.21.15.81:0/568272790 >> 172.21.15.81:0/568272790 conn(0x7f95fc0c1a70 msgr2=0x7f95fc0c1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:40.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.492+0000 7f9601049700 1 -- 172.21.15.81:0/568272790 shutdown_connections 2023-10-25T23:44:40.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.492+0000 7f9601049700 1 -- 172.21.15.81:0/568272790 wait complete. 2023-10-25T23:44:40.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.494+0000 7f9601049700 1 Processor -- start 2023-10-25T23:44:40.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.494+0000 7f9601049700 1 -- start start 2023-10-25T23:44:40.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.494+0000 7f9601049700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95fc06deb0 0x7f95fc1d6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:40.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.494+0000 7f9601049700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95fc0b5100 0x7f95fc0a6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:40.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.494+0000 7f9601049700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc0c1580 0x7f95fc0a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:40.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.494+0000 7f9601049700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0a62d0 con 0x7f95fc0c1580 2023-10-25T23:44:40.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.494+0000 7f9601049700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc1d7050 con 0x7f95fc06deb0 2023-10-25T23:44:40.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.494+0000 7f9601049700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc1e6940 con 0x7f95fc0b5100 2023-10-25T23:44:40.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.495+0000 7f95fb59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc0c1580 0x7f95fc0a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:40.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.495+0000 7f95fb59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc0c1580 0x7f95fc0a6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37026/0 (socket says 172.21.15.81:37026) 2023-10-25T23:44:40.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.495+0000 7f95fb59e700 1 -- 172.21.15.81:0/8903360 learned_addr learned my addr 172.21.15.81:0/8903360 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:40.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.495+0000 7f95fa59c700 1 --2- 172.21.15.81:0/8903360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95fc0b5100 0x7f95fc0a6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:40.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.495+0000 7f95fad9d700 1 --2- 172.21.15.81:0/8903360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95fc06deb0 0x7f95fc1d6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:40.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.495+0000 7f95fb59e700 1 -- 172.21.15.81:0/8903360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95fc0b5100 msgr2=0x7f95fc0a6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:40.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.495+0000 7f95fb59e700 1 --2- 172.21.15.81:0/8903360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95fc0b5100 0x7f95fc0a6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.495+0000 7f95fb59e700 1 -- 172.21.15.81:0/8903360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95fc06deb0 msgr2=0x7f95fc1d6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:40.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.495+0000 7f95fb59e700 1 --2- 172.21.15.81:0/8903360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95fc06deb0 0x7f95fc1d6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.495+0000 7f95fb59e700 1 -- 172.21.15.81:0/8903360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f4009c40 con 0x7f95fc0c1580 2023-10-25T23:44:40.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.495+0000 7f95fb59e700 1 --2- 172.21.15.81:0/8903360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc0c1580 0x7f95fc0a6cc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f95f400c120 tx=0x7f95f400c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:40.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.495+0000 7f95e37fe700 1 -- 172.21.15.81:0/8903360 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f400cb90 con 0x7f95fc0c1580 2023-10-25T23:44:40.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.495+0000 7f9601049700 1 -- 172.21.15.81:0/8903360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f0009520 con 0x7f95fc0c1580 2023-10-25T23:44:40.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.495+0000 7f95e37fe700 1 -- 172.21.15.81:0/8903360 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f95f400e030 con 0x7f95fc0c1580 2023-10-25T23:44:40.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.495+0000 7f95e37fe700 1 -- 172.21.15.81:0/8903360 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f4003a00 con 0x7f95fc0c1580 2023-10-25T23:44:40.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.495+0000 7f9601049700 1 -- 172.21.15.81:0/8903360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95fc0a4b60 con 0x7f95fc0c1580 2023-10-25T23:44:40.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.496+0000 7f9601049700 1 -- 172.21.15.81:0/8903360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95fc0a64a0 con 0x7f95fc0c1580 2023-10-25T23:44:40.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.497+0000 7f95e37fe700 1 -- 172.21.15.81:0/8903360 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f95f4007500 con 0x7f95fc0c1580 2023-10-25T23:44:40.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.497+0000 7f95e37fe700 1 --2- 172.21.15.81:0/8903360 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f95e806aed0 0x7f95e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:40.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.497+0000 7f95e37fe700 1 -- 172.21.15.81:0/8903360 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f95f4089de0 con 0x7f95fc0c1580 2023-10-25T23:44:40.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.497+0000 7f95fad9d700 1 --2- 172.21.15.81:0/8903360 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f95e806aed0 0x7f95e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:40.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.498+0000 7f95fad9d700 1 --2- 172.21.15.81:0/8903360 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f95e806aed0 0x7f95e806d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f95f0000c00 tx=0x7f95f0019040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:40.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.501+0000 7f95e37fe700 1 -- 172.21.15.81:0/8903360 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f95fc0a64a0 con 0x7f95fc0c1580 2023-10-25T23:44:40.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.686+0000 7f9601049700 1 -- 172.21.15.81:0/8903360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f95fc04e4c0 con 0x7f95fc0c1580 2023-10-25T23:44:40.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.686+0000 7f95e37fe700 1 -- 172.21.15.81:0/8903360 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f95f4054df0 con 0x7f95fc0c1580 2023-10-25T23:44:40.689 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2023-10-25T23:44:40.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.688+0000 7f9601049700 1 -- 172.21.15.81:0/8903360 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f95e806aed0 msgr2=0x7f95e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:40.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.688+0000 7f9601049700 1 --2- 172.21.15.81:0/8903360 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f95e806aed0 0x7f95e806d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f95f0000c00 tx=0x7f95f0019040 comp rx=0 tx=0).stop 2023-10-25T23:44:40.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.688+0000 7f9601049700 1 -- 172.21.15.81:0/8903360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc0c1580 msgr2=0x7f95fc0a6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:40.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.688+0000 7f9601049700 1 --2- 172.21.15.81:0/8903360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc0c1580 0x7f95fc0a6cc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f95f400c120 tx=0x7f95f400c4e0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.688+0000 7f9601049700 1 -- 172.21.15.81:0/8903360 shutdown_connections 2023-10-25T23:44:40.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.688+0000 7f9601049700 1 --2- 172.21.15.81:0/8903360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc0c1580 0x7f95fc0a6cc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.692 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.688+0000 7f9601049700 1 --2- 172.21.15.81:0/8903360 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f95e806aed0 0x7f95e806d390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.688+0000 7f9601049700 1 --2- 172.21.15.81:0/8903360 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95fc06deb0 0x7f95fc1d6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.688+0000 7f9601049700 1 --2- 172.21.15.81:0/8903360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95fc0b5100 0x7f95fc0a6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.688+0000 7f9601049700 1 -- 172.21.15.81:0/8903360 >> 172.21.15.81:0/8903360 conn(0x7f95fc0c1a70 msgr2=0x7f95fc0a13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:40.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.689+0000 7f9601049700 1 -- 172.21.15.81:0/8903360 shutdown_connections 2023-10-25T23:44:40.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.689+0000 7f9601049700 1 -- 172.21.15.81:0/8903360 wait complete. 2023-10-25T23:44:40.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-25T23:44:40.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.825+0000 7f791fe54700 1 -- 172.21.15.81:0/3802085723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7918153340 msgr2=0x7f7918155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:40.827 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.825+0000 7f791fe54700 1 --2- 172.21.15.81:0/3802085723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7918153340 0x7f7918155730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7910009fd0 tx=0x7f791000b380 comp rx=0 tx=0).stop 2023-10-25T23:44:40.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.825+0000 7f791fe54700 1 -- 172.21.15.81:0/3802085723 shutdown_connections 2023-10-25T23:44:40.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.825+0000 7f791fe54700 1 --2- 172.21.15.81:0/3802085723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7918153340 0x7f7918155730 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.828 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.825+0000 7f791fe54700 1 --2- 172.21.15.81:0/3802085723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7918144e80 0x7f7918072240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.825+0000 7f791fe54700 1 -- 172.21.15.81:0/3802085723 >> 172.21.15.81:0/3802085723 conn(0x7f791806d9b0 msgr2=0x7f791806ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:40.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.825+0000 7f791fe54700 1 -- 172.21.15.81:0/3802085723 shutdown_connections 2023-10-25T23:44:40.829 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.825+0000 7f791fe54700 1 -- 172.21.15.81:0/3802085723 wait complete. 2023-10-25T23:44:40.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.826+0000 7f791fe54700 1 Processor -- start 2023-10-25T23:44:40.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.826+0000 7f791fe54700 1 -- start start 2023-10-25T23:44:40.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f791fe54700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7918071190 0x7f79180b9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:40.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f791fe54700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7918144e80 0x7f79181e2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:40.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f791fe54700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7918153340 0x7f7918140070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:40.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f791fe54700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7918147510 con 0x7f7918144e80 2023-10-25T23:44:40.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f791fe54700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7918153170 con 0x7f7918071190 2023-10-25T23:44:40.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f791fe54700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79180b9d50 con 0x7f7918153340 2023-10-25T23:44:40.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f791d3ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7918144e80 0x7f79181e2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:40.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f791d3ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7918144e80 0x7f79181e2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37038/0 (socket says 172.21.15.81:37038) 2023-10-25T23:44:40.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f791d3ef700 1 -- 172.21.15.81:0/1017337931 learned_addr learned my addr 172.21.15.81:0/1017337931 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:40.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f791dbf0700 1 --2- 172.21.15.81:0/1017337931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7918071190 0x7f79180b9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:40.835 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f791e3f1700 1 --2- 172.21.15.81:0/1017337931 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7918153340 0x7f7918140070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:40.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f791d3ef700 1 -- 172.21.15.81:0/1017337931 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7918153340 msgr2=0x7f7918140070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:40.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f791d3ef700 1 --2- 172.21.15.81:0/1017337931 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7918153340 0x7f7918140070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f791d3ef700 1 -- 172.21.15.81:0/1017337931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7918071190 msgr2=0x7f79180b9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:40.836 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f791d3ef700 1 --2- 172.21.15.81:0/1017337931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7918071190 0x7f79180b9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:40.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f791d3ef700 1 -- 172.21.15.81:0/1017337931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7910009d00 con 0x7f7918144e80 2023-10-25T23:44:40.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f791d3ef700 1 --2- 172.21.15.81:0/1017337931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7918144e80 0x7f79181e2850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f790800c540 tx=0x7f790800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:40.837 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f790e7fc700 1 -- 172.21.15.81:0/1017337931 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080052d0 con 0x7f7918144e80 2023-10-25T23:44:40.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f790e7fc700 1 -- 172.21.15.81:0/1017337931 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7908005520 con 0x7f7918144e80 2023-10-25T23:44:40.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f791fe54700 1 -- 172.21.15.81:0/1017337931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79180a4bc0 con 0x7f7918144e80 2023-10-25T23:44:40.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.827+0000 7f790e7fc700 1 -- 172.21.15.81:0/1017337931 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080038e0 con 0x7f7918144e80 2023-10-25T23:44:40.838 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.828+0000 7f791fe54700 1 -- 172.21.15.81:0/1017337931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79181e6970 con 0x7f7918144e80 2023-10-25T23:44:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.828+0000 7f791fe54700 1 -- 172.21.15.81:0/1017337931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7918067490 con 0x7f7918144e80 2023-10-25T23:44:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.829+0000 7f790e7fc700 1 -- 172.21.15.81:0/1017337931 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7908003a40 con 0x7f7918144e80 2023-10-25T23:44:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.829+0000 7f790e7fc700 1 --2- 172.21.15.81:0/1017337931 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f78fc06af00 0x7f78fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:40.839 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.829+0000 7f790e7fc700 1 -- 172.21.15.81:0/1017337931 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f7908088ca0 con 0x7f7918144e80 2023-10-25T23:44:40.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.829+0000 7f791dbf0700 1 --2- 172.21.15.81:0/1017337931 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f78fc06af00 0x7f78fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:40.840 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.830+0000 7f791dbf0700 1 --2- 172.21.15.81:0/1017337931 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f78fc06af00 0x7f78fc06d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7914005950 tx=0x7f791400b410 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:40.841 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:40.833+0000 7f790e7fc700 1 -- 172.21.15.81:0/1017337931 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7908053c90 con 0x7f7918144e80 2023-10-25T23:44:41.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.035+0000 7f791fe54700 1 -- 172.21.15.81:0/1017337931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f79181e67a0 con 0x7f7918144e80 2023-10-25T23:44:41.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.036+0000 7f790e7fc700 1 -- 172.21.15.81:0/1017337931 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7908017080 con 0x7f7918144e80 2023-10-25T23:44:41.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.037+0000 7f791fe54700 1 -- 172.21.15.81:0/1017337931 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f78fc06af00 msgr2=0x7f78fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:41.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.037+0000 7f791fe54700 1 --2- 172.21.15.81:0/1017337931 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f78fc06af00 0x7f78fc06d3c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7914005950 tx=0x7f791400b410 comp rx=0 tx=0).stop 2023-10-25T23:44:41.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.037+0000 7f791fe54700 1 -- 172.21.15.81:0/1017337931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7918144e80 msgr2=0x7f79181e2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:41.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.037+0000 7f791fe54700 1 --2- 172.21.15.81:0/1017337931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7918144e80 0x7f79181e2850 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f790800c540 tx=0x7f790800c850 comp rx=0 tx=0).stop 2023-10-25T23:44:41.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.038+0000 7f791fe54700 1 -- 172.21.15.81:0/1017337931 shutdown_connections 2023-10-25T23:44:41.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.038+0000 7f791fe54700 1 --2- 172.21.15.81:0/1017337931 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7918153340 0x7f7918140070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:41.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.038+0000 7f791fe54700 1 --2- 172.21.15.81:0/1017337931 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f78fc06af00 0x7f78fc06d3c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:41.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.038+0000 7f791fe54700 1 --2- 172.21.15.81:0/1017337931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7918071190 0x7f79180b9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:41.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.038+0000 7f791fe54700 1 --2- 172.21.15.81:0/1017337931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7918144e80 0x7f79181e2850 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:41.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.038+0000 7f791fe54700 1 -- 172.21.15.81:0/1017337931 >> 172.21.15.81:0/1017337931 conn(0x7f791806d9b0 msgr2=0x7f7918149de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:41.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.038+0000 7f791fe54700 1 -- 172.21.15.81:0/1017337931 shutdown_connections 2023-10-25T23:44:41.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.038+0000 7f791fe54700 1 -- 172.21.15.81:0/1017337931 wait complete. 2023-10-25T23:44:41.047 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2023-10-25T23:44:41.051 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-25T23:44:41.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:44:41.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-25T23:44:41.121 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2023-10-25T23:44:41.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:44:41.122 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-25T23:44:41.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:44:41.183 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2023-10-25T23:44:41.200 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-25T23:44:41.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:44:41.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-25T23:44:41.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-25T23:44:41.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2023-10-25T23:44:41.385 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-25T23:44:41.396 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-25T23:44:41.397 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T23:44:41.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.521+0000 7f2f38ff7700 1 -- 172.21.15.81:0/867710811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f340b59d0 msgr2=0x7f2f341446b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:41.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.521+0000 7f2f38ff7700 1 --2- 172.21.15.81:0/867710811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f340b59d0 0x7f2f341446b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2f28005fd0 tx=0x7f2f28009c70 comp rx=0 tx=0).stop 2023-10-25T23:44:41.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.521+0000 7f2f38ff7700 1 -- 172.21.15.81:0/867710811 shutdown_connections 2023-10-25T23:44:41.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.521+0000 7f2f38ff7700 1 --2- 172.21.15.81:0/867710811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f340b59d0 0x7f2f341446b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:41.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.521+0000 7f2f38ff7700 1 --2- 172.21.15.81:0/867710811 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f34071610 0x7f2f34144bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:41.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.521+0000 7f2f38ff7700 1 -- 172.21.15.81:0/867710811 >> 172.21.15.81:0/867710811 conn(0x7f2f340bc370 msgr2=0x7f2f340bc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:41.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.521+0000 7f2f38ff7700 1 -- 172.21.15.81:0/867710811 shutdown_connections 2023-10-25T23:44:41.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.521+0000 7f2f38ff7700 1 -- 172.21.15.81:0/867710811 wait complete. 2023-10-25T23:44:41.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.522+0000 7f2f38ff7700 1 Processor -- start 2023-10-25T23:44:41.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.522+0000 7f2f38ff7700 1 -- start start 2023-10-25T23:44:41.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.523+0000 7f2f38ff7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f34071610 0x7f2f340b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:41.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.523+0000 7f2f38ff7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f340b59d0 0x7f2f3412e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:41.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.523+0000 7f2f38ff7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f3414e2f0 0x7f2f340bd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:41.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.523+0000 7f2f38ff7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3412b3b0 con 0x7f2f340b59d0 2023-10-25T23:44:41.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.523+0000 7f2f38ff7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3412b970 con 0x7f2f34071610 2023-10-25T23:44:41.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.523+0000 7f2f38ff7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f341e30d0 con 0x7f2f3414e2f0 2023-10-25T23:44:41.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.523+0000 7f2f31d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f340b59d0 0x7f2f3412e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:41.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.523+0000 7f2f31d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f340b59d0 0x7f2f3412e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37052/0 (socket says 172.21.15.81:37052) 2023-10-25T23:44:41.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.523+0000 7f2f31d9b700 1 -- 172.21.15.81:0/1253462054 learned_addr learned my addr 172.21.15.81:0/1253462054 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:41.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.523+0000 7f2f32d9d700 1 --2- 172.21.15.81:0/1253462054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f3414e2f0 0x7f2f340bd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:41.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.523+0000 7f2f3259c700 1 --2- 172.21.15.81:0/1253462054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f34071610 0x7f2f340b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:41.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.523+0000 7f2f31d9b700 1 -- 172.21.15.81:0/1253462054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f3414e2f0 msgr2=0x7f2f340bd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:41.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.523+0000 7f2f31d9b700 1 --2- 172.21.15.81:0/1253462054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f3414e2f0 0x7f2f340bd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:41.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.523+0000 7f2f31d9b700 1 -- 172.21.15.81:0/1253462054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f34071610 msgr2=0x7f2f340b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:41.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.523+0000 7f2f31d9b700 1 --2- 172.21.15.81:0/1253462054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f34071610 0x7f2f340b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:41.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.523+0000 7f2f31d9b700 1 -- 172.21.15.81:0/1253462054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f280095f0 con 0x7f2f340b59d0 2023-10-25T23:44:41.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.524+0000 7f2f31d9b700 1 --2- 172.21.15.81:0/1253462054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f340b59d0 0x7f2f3412e980 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400d9b0 tx=0x7f2f2400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:41.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.524+0000 7f2f22ffd700 1 -- 172.21.15.81:0/1253462054 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f24009930 con 0x7f2f340b59d0 2023-10-25T23:44:41.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.524+0000 7f2f22ffd700 1 -- 172.21.15.81:0/1253462054 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2f24009b80 con 0x7f2f340b59d0 2023-10-25T23:44:41.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.524+0000 7f2f38ff7700 1 -- 172.21.15.81:0/1253462054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f341e3370 con 0x7f2f340b59d0 2023-10-25T23:44:41.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.524+0000 7f2f22ffd700 1 -- 172.21.15.81:0/1253462054 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f24010460 con 0x7f2f340b59d0 2023-10-25T23:44:41.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.524+0000 7f2f38ff7700 1 -- 172.21.15.81:0/1253462054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3412c140 con 0x7f2f340b59d0 2023-10-25T23:44:41.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.525+0000 7f2f38ff7700 1 -- 172.21.15.81:0/1253462054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3404e4c0 con 0x7f2f340b59d0 2023-10-25T23:44:41.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.525+0000 7f2f22ffd700 1 -- 172.21.15.81:0/1253462054 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2f240105c0 con 0x7f2f340b59d0 2023-10-25T23:44:41.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.526+0000 7f2f22ffd700 1 --2- 172.21.15.81:0/1253462054 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f2f1406aed0 0x7f2f1406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:41.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.526+0000 7f2f22ffd700 1 -- 172.21.15.81:0/1253462054 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f2f240897f0 con 0x7f2f340b59d0 2023-10-25T23:44:41.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.526+0000 7f2f3259c700 1 --2- 172.21.15.81:0/1253462054 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f2f1406aed0 0x7f2f1406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:41.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.526+0000 7f2f3259c700 1 --2- 172.21.15.81:0/1253462054 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f2f1406aed0 0x7f2f1406d390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2f28000c00 tx=0x7f2f280047c0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:41.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.530+0000 7f2f22ffd700 1 -- 172.21.15.81:0/1253462054 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2f24054880 con 0x7f2f340b59d0 2023-10-25T23:44:41.716 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.714+0000 7f2f38ff7700 1 -- 172.21.15.81:0/1253462054 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f340bd6d0 con 0x7f2f1406aed0 2023-10-25T23:44:41.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.723+0000 7f2f22ffd700 1 -- 172.21.15.81:0/1253462054 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+294571 (secure 0 0 0) 0x7f2f340bd6d0 con 0x7f2f1406aed0 2023-10-25T23:44:41.728 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:44:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.726+0000 7f2f38ff7700 1 -- 172.21.15.81:0/1253462054 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f2f1406aed0 msgr2=0x7f2f1406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.726+0000 7f2f38ff7700 1 --2- 172.21.15.81:0/1253462054 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f2f1406aed0 0x7f2f1406d390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2f28000c00 tx=0x7f2f280047c0 comp rx=0 tx=0).stop 2023-10-25T23:44:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.726+0000 7f2f38ff7700 1 -- 172.21.15.81:0/1253462054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f340b59d0 msgr2=0x7f2f3412e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.726+0000 7f2f38ff7700 1 --2- 172.21.15.81:0/1253462054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f340b59d0 0x7f2f3412e980 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400d9b0 tx=0x7f2f2400dcc0 comp rx=0 tx=0).stop 2023-10-25T23:44:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.726+0000 7f2f38ff7700 1 -- 172.21.15.81:0/1253462054 shutdown_connections 2023-10-25T23:44:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.726+0000 7f2f38ff7700 1 --2- 172.21.15.81:0/1253462054 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f3414e2f0 0x7f2f340bd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.726+0000 7f2f38ff7700 1 --2- 172.21.15.81:0/1253462054 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f2f1406aed0 0x7f2f1406d390 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.726+0000 7f2f38ff7700 1 --2- 172.21.15.81:0/1253462054 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f34071610 0x7f2f340b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.726+0000 7f2f38ff7700 1 --2- 172.21.15.81:0/1253462054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f340b59d0 0x7f2f3412e980 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.726+0000 7f2f38ff7700 1 -- 172.21.15.81:0/1253462054 >> 172.21.15.81:0/1253462054 conn(0x7f2f340bc370 msgr2=0x7f2f340bb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.726+0000 7f2f38ff7700 1 -- 172.21.15.81:0/1253462054 shutdown_connections 2023-10-25T23:44:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.726+0000 7f2f38ff7700 1 -- 172.21.15.81:0/1253462054 wait complete. 2023-10-25T23:44:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-25T23:44:41.741 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2023-10-25T23:44:41.119193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":884166692,"num_objects":566,"num_object_clones":0,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":566,"num_whiteouts":0,"num_read":14770,"num_read_kb":532589,"num_write":91898,"num_write_kb":4543617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":344,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146483,"ondisk_log_size":146483,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2708256,"kb_used_data":1731904,"kb_used_omap":12,"kb_used_meta":976243,"kb_avail":752266464,"statfs":{"total":773094113280,"available":770320859136,"internally_reserved":0,"allocated":1773469696,"data_stored":1771427978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":999673400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":860297,"num_objects":-95,"num_object_clones":-1,"num_object_copies":-190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-95,"num_whiteouts":0,"num_read":6,"num_read_kb":11,"num_write":141,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002745"},"pg_stats":[{"pgid":"3.3f","version":"38'1937","reported_seq":4535,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.553058+0000","last_change":"2023-10-25T23:44:32.561696+0000","last_active":"2023-10-25T23:44:32.553058+0000","last_peered":"2023-10-25T23:44:32.553058+0000","last_clean":"2023-10-25T23:44:32.553058+0000","last_became_active":"2023-10-25T23:36:09.292007+0000","last_became_peered":"2023-10-25T23:36:09.292007+0000","last_unstale":"2023-10-25T23:44:32.553058+0000","last_undegraded":"2023-10-25T23:44:32.553058+0000","last_fullsized":"2023-10-25T23:44:32.553058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1937,"log_dups_size":0,"ondisk_log_size":1937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:57:06.053396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14653339800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":3053,"num_write":1182,"num_write_kb":17288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.3e","version":"38'1934","reported_seq":4549,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.490809+0000","last_change":"2023-10-25T23:44:32.496598+0000","last_active":"2023-10-25T23:44:32.490809+0000","last_peered":"2023-10-25T23:44:32.490809+0000","last_clean":"2023-10-25T23:44:32.490809+0000","last_became_active":"2023-10-25T23:36:09.281890+0000","last_became_peered":"2023-10-25T23:36:09.281890+0000","last_unstale":"2023-10-25T23:44:32.490809+0000","last_undegraded":"2023-10-25T23:44:32.490809+0000","last_fullsized":"2023-10-25T23:44:32.490809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1934,"log_dups_size":0,"ondisk_log_size":1934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:22:19.658935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069104454999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":12821,"num_write":1152,"num_write_kb":16010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.3d","version":"38'2031","reported_seq":4609,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.561421+0000","last_change":"2023-10-25T23:44:32.578547+0000","last_active":"2023-10-25T23:44:32.561421+0000","last_peered":"2023-10-25T23:44:32.561421+0000","last_clean":"2023-10-25T23:44:32.561421+0000","last_became_active":"2023-10-25T23:36:09.284066+0000","last_became_peered":"2023-10-25T23:36:09.284066+0000","last_unstale":"2023-10-25T23:44:32.561421+0000","last_undegraded":"2023-10-25T23:44:32.561421+0000","last_fullsized":"2023-10-25T23:44:32.561421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:55:32.290039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.164461575,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":12209,"num_write":1200,"num_write_kb":24347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.3c","version":"38'2078","reported_seq":4756,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.488901+0000","last_change":"2023-10-25T23:44:32.499536+0000","last_active":"2023-10-25T23:44:32.488901+0000","last_peered":"2023-10-25T23:44:32.488901+0000","last_clean":"2023-10-25T23:44:32.488901+0000","last_became_active":"2023-10-25T23:36:09.299585+0000","last_became_peered":"2023-10-25T23:36:09.299585+0000","last_unstale":"2023-10-25T23:44:32.488901+0000","last_undegraded":"2023-10-25T23:44:32.488901+0000","last_fullsized":"2023-10-25T23:44:32.488901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2078,"log_dups_size":0,"ondisk_log_size":2078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:20:50.930557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104514565,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":4442,"num_write":1222,"num_write_kb":17071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.3b","version":"37'2218","reported_seq":4794,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.498046+0000","last_change":"2023-10-25T23:44:32.507952+0000","last_active":"2023-10-25T23:44:32.498046+0000","last_peered":"2023-10-25T23:44:32.498046+0000","last_clean":"2023-10-25T23:44:32.498046+0000","last_became_active":"2023-10-25T23:36:09.287403+0000","last_became_peered":"2023-10-25T23:36:09.287403+0000","last_unstale":"2023-10-25T23:44:32.498046+0000","last_undegraded":"2023-10-25T23:44:32.498046+0000","last_fullsized":"2023-10-25T23:44:32.498046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2218,"log_dups_size":0,"ondisk_log_size":2218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:10:34.048013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.096586196999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":4323,"num_write":1325,"num_write_kb":21852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.3a","version":"38'1924","reported_seq":4534,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.465554+0000","last_change":"2023-10-25T23:44:32.477919+0000","last_active":"2023-10-25T23:44:32.465554+0000","last_peered":"2023-10-25T23:44:32.465554+0000","last_clean":"2023-10-25T23:44:32.465554+0000","last_became_active":"2023-10-25T23:36:09.301305+0000","last_became_peered":"2023-10-25T23:36:09.301305+0000","last_unstale":"2023-10-25T23:44:32.465554+0000","last_undegraded":"2023-10-25T23:44:32.465554+0000","last_fullsized":"2023-10-25T23:44:32.465554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1924,"log_dups_size":0,"ondisk_log_size":1924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:31:23.915991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.083247637999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":4600,"num_write":1162,"num_write_kb":16604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.39","version":"37'2100","reported_seq":4681,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.543812+0000","last_change":"2023-10-25T23:44:32.553007+0000","last_active":"2023-10-25T23:44:32.543812+0000","last_peered":"2023-10-25T23:44:32.543812+0000","last_clean":"2023-10-25T23:44:32.543812+0000","last_became_active":"2023-10-25T23:36:09.293173+0000","last_became_peered":"2023-10-25T23:36:09.293173+0000","last_unstale":"2023-10-25T23:44:32.543812+0000","last_undegraded":"2023-10-25T23:44:32.543812+0000","last_fullsized":"2023-10-25T23:44:32.543812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:07:11.314981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.141433051,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":4028,"num_write":1252,"num_write_kb":24067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.38","version":"37'1943","reported_seq":4557,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.523048+0000","last_change":"2023-10-25T23:44:32.533836+0000","last_active":"2023-10-25T23:44:32.523048+0000","last_peered":"2023-10-25T23:44:32.523048+0000","last_clean":"2023-10-25T23:44:32.523048+0000","last_became_active":"2023-10-25T23:36:09.295518+0000","last_became_peered":"2023-10-25T23:36:09.295518+0000","last_unstale":"2023-10-25T23:44:32.523048+0000","last_undegraded":"2023-10-25T23:44:32.523048+0000","last_fullsized":"2023-10-25T23:44:32.523048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:31:23.915991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12500524399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":4005,"num_write":1156,"num_write_kb":40374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.37","version":"38'2130","reported_seq":4731,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.543773+0000","last_change":"2023-10-25T23:44:32.552979+0000","last_active":"2023-10-25T23:44:32.543773+0000","last_peered":"2023-10-25T23:44:32.543773+0000","last_clean":"2023-10-25T23:44:32.543773+0000","last_became_active":"2023-10-25T23:36:09.297036+0000","last_became_peered":"2023-10-25T23:36:09.297036+0000","last_unstale":"2023-10-25T23:44:32.543773+0000","last_undegraded":"2023-10-25T23:44:32.543773+0000","last_fullsized":"2023-10-25T23:44:32.543773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2130,"log_dups_size":0,"ondisk_log_size":2130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:09:03.392402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13789567699999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":8236,"num_write":1280,"num_write_kb":21230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.36","version":"38'1975","reported_seq":4589,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.511036+0000","last_change":"2023-10-25T23:44:39.516062+0000","last_active":"2023-10-25T23:44:39.511036+0000","last_peered":"2023-10-25T23:44:39.511036+0000","last_clean":"2023-10-25T23:44:39.511036+0000","last_became_active":"2023-10-25T23:36:09.297713+0000","last_became_peered":"2023-10-25T23:36:09.297713+0000","last_unstale":"2023-10-25T23:44:39.511036+0000","last_undegraded":"2023-10-25T23:44:39.511036+0000","last_fullsized":"2023-10-25T23:44:39.511036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:15:18.383242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052261503000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":4128,"num_write":1151,"num_write_kb":8179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.35","version":"38'2156","reported_seq":4751,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.516150+0000","last_change":"2023-10-25T23:44:39.519698+0000","last_active":"2023-10-25T23:44:39.516150+0000","last_peered":"2023-10-25T23:44:39.516150+0000","last_clean":"2023-10-25T23:44:39.516150+0000","last_became_active":"2023-10-25T23:36:50.071605+0000","last_became_peered":"2023-10-25T23:36:50.071605+0000","last_unstale":"2023-10-25T23:44:39.516150+0000","last_undegraded":"2023-10-25T23:44:39.516150+0000","last_fullsized":"2023-10-25T23:44:39.516150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2156,"log_dups_size":0,"ondisk_log_size":2156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:06.976880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056199102000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":4889,"num_write":1231,"num_write_kb":19417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.34","version":"38'2098","reported_seq":4702,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.965924+0000","last_change":"2023-10-25T23:44:38.977002+0000","last_active":"2023-10-25T23:44:38.965924+0000","last_peered":"2023-10-25T23:44:38.965924+0000","last_clean":"2023-10-25T23:44:38.965924+0000","last_became_active":"2023-10-25T23:36:09.291351+0000","last_became_peered":"2023-10-25T23:36:09.291351+0000","last_unstale":"2023-10-25T23:44:38.965924+0000","last_undegraded":"2023-10-25T23:44:38.965924+0000","last_fullsized":"2023-10-25T23:44:38.965924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2098,"log_dups_size":0,"ondisk_log_size":2098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:56:29.776633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104157445,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":4997,"num_write":1220,"num_write_kb":33278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.33","version":"38'2031","reported_seq":4624,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.544814+0000","last_change":"2023-10-25T23:44:32.558944+0000","last_active":"2023-10-25T23:44:32.544814+0000","last_peered":"2023-10-25T23:44:32.544814+0000","last_clean":"2023-10-25T23:44:32.544814+0000","last_became_active":"2023-10-25T23:36:09.289895+0000","last_became_peered":"2023-10-25T23:36:09.289895+0000","last_unstale":"2023-10-25T23:44:32.544814+0000","last_undegraded":"2023-10-25T23:44:32.544814+0000","last_fullsized":"2023-10-25T23:44:32.544814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:10:34.048013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14974707600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":8364,"num_write":1160,"num_write_kb":24700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.32","version":"38'2055","reported_seq":4664,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.535407+0000","last_change":"2023-10-25T23:44:32.546559+0000","last_active":"2023-10-25T23:44:32.535407+0000","last_peered":"2023-10-25T23:44:32.535407+0000","last_clean":"2023-10-25T23:44:32.535407+0000","last_became_active":"2023-10-25T23:36:09.283250+0000","last_became_peered":"2023-10-25T23:36:09.283250+0000","last_unstale":"2023-10-25T23:44:32.535407+0000","last_undegraded":"2023-10-25T23:44:32.535407+0000","last_fullsized":"2023-10-25T23:44:32.535407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:56:24.250407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13307770899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":4523,"num_write":1222,"num_write_kb":24181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.31","version":"37'2096","reported_seq":4691,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.466308+0000","last_change":"2023-10-25T23:44:32.474468+0000","last_active":"2023-10-25T23:44:32.466308+0000","last_peered":"2023-10-25T23:44:32.466308+0000","last_clean":"2023-10-25T23:44:32.466308+0000","last_became_active":"2023-10-25T23:36:09.286191+0000","last_became_peered":"2023-10-25T23:36:09.286191+0000","last_unstale":"2023-10-25T23:44:32.466308+0000","last_undegraded":"2023-10-25T23:44:32.466308+0000","last_fullsized":"2023-10-25T23:44:32.466308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2096,"log_dups_size":0,"ondisk_log_size":2096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:44:40.385223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055128609000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":4088,"num_write":1280,"num_write_kb":29409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.30","version":"38'2065","reported_seq":4671,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.467034+0000","last_change":"2023-10-25T23:44:32.467034+0000","last_active":"2023-10-25T23:44:32.467034+0000","last_peered":"2023-10-25T23:44:32.467034+0000","last_clean":"2023-10-25T23:44:32.467034+0000","last_became_active":"2023-10-25T23:36:09.301040+0000","last_became_peered":"2023-10-25T23:36:09.301040+0000","last_unstale":"2023-10-25T23:44:32.467034+0000","last_undegraded":"2023-10-25T23:44:32.467034+0000","last_fullsized":"2023-10-25T23:44:32.467034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:14:14.520328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072495613,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":14548,"num_write":1224,"num_write_kb":47800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.2f","version":"38'2110","reported_seq":4750,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.901148+0000","last_change":"2023-10-25T23:44:38.906227+0000","last_active":"2023-10-25T23:44:38.901148+0000","last_peered":"2023-10-25T23:44:38.901148+0000","last_clean":"2023-10-25T23:44:38.901148+0000","last_became_active":"2023-10-25T23:36:50.103220+0000","last_became_peered":"2023-10-25T23:36:50.103220+0000","last_unstale":"2023-10-25T23:44:38.901148+0000","last_undegraded":"2023-10-25T23:44:38.901148+0000","last_fullsized":"2023-10-25T23:44:38.901148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2110,"log_dups_size":0,"ondisk_log_size":2110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:48:12.956766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033066291999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":8493,"num_write":1280,"num_write_kb":14868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.2e","version":"37'1999","reported_seq":4610,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.902731+0000","last_change":"2023-10-25T23:44:38.907165+0000","last_active":"2023-10-25T23:44:38.902731+0000","last_peered":"2023-10-25T23:44:38.902731+0000","last_clean":"2023-10-25T23:44:38.902731+0000","last_became_active":"2023-10-25T23:36:09.282282+0000","last_became_peered":"2023-10-25T23:36:09.282282+0000","last_unstale":"2023-10-25T23:44:38.902731+0000","last_undegraded":"2023-10-25T23:44:38.902731+0000","last_fullsized":"2023-10-25T23:44:38.902731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1999,"log_dups_size":0,"ondisk_log_size":1999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:37:04.361378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033856860000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":3064,"num_write":1152,"num_write_kb":24838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.2d","version":"38'2186","reported_seq":4774,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.508072+0000","last_change":"2023-10-25T23:44:32.524616+0000","last_active":"2023-10-25T23:44:32.508072+0000","last_peered":"2023-10-25T23:44:32.508072+0000","last_clean":"2023-10-25T23:44:32.508072+0000","last_became_active":"2023-10-25T23:36:09.289457+0000","last_became_peered":"2023-10-25T23:36:09.289457+0000","last_unstale":"2023-10-25T23:44:32.508072+0000","last_undegraded":"2023-10-25T23:44:32.508072+0000","last_fullsized":"2023-10-25T23:44:32.508072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2186,"log_dups_size":0,"ondisk_log_size":2186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:22:15.481808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.110731284,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":8808,"num_write":1334,"num_write_kb":38138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.1f","version":"38'365","reported_seq":398,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.416028+0000","last_change":"2023-10-25T23:36:08.271164+0000","last_active":"2023-10-25T23:44:32.416028+0000","last_peered":"2023-10-25T23:44:32.416028+0000","last_clean":"2023-10-25T23:44:32.416028+0000","last_became_active":"2023-10-25T23:36:08.270911+0000","last_became_peered":"2023-10-25T23:36:08.270911+0000","last_unstale":"2023-10-25T23:44:32.416028+0000","last_undegraded":"2023-10-25T23:44:32.416028+0000","last_fullsized":"2023-10-25T23:44:32.416028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33555014,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":323,"num_write_kb":78531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"37'1980","reported_seq":4553,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.544866+0000","last_change":"2023-10-25T23:44:32.558952+0000","last_active":"2023-10-25T23:44:32.544866+0000","last_peered":"2023-10-25T23:44:32.544866+0000","last_clean":"2023-10-25T23:44:32.544866+0000","last_became_active":"2023-10-25T23:36:09.290260+0000","last_became_peered":"2023-10-25T23:36:09.290260+0000","last_unstale":"2023-10-25T23:44:32.544866+0000","last_undegraded":"2023-10-25T23:44:32.544866+0000","last_fullsized":"2023-10-25T23:44:32.544866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:20:50.930557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14940374000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":3083,"num_write":1169,"num_write_kb":11022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.1e","version":"34'636","reported_seq":669,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:27.867853+0000","last_change":"2023-10-25T23:36:08.269993+0000","last_active":"2023-10-25T23:44:27.867853+0000","last_peered":"2023-10-25T23:44:27.867853+0000","last_clean":"2023-10-25T23:44:27.867853+0000","last_became_active":"2023-10-25T23:36:08.269443+0000","last_became_peered":"2023-10-25T23:36:08.269443+0000","last_unstale":"2023-10-25T23:44:27.867853+0000","last_undegraded":"2023-10-25T23:44:27.867853+0000","last_fullsized":"2023-10-25T23:44:27.867853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":598,"num_write_kb":86544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"38'1958","reported_seq":4573,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.561470+0000","last_change":"2023-10-25T23:44:32.578618+0000","last_active":"2023-10-25T23:44:32.561470+0000","last_peered":"2023-10-25T23:44:32.561470+0000","last_clean":"2023-10-25T23:44:32.561470+0000","last_became_active":"2023-10-25T23:36:09.299738+0000","last_became_peered":"2023-10-25T23:36:09.299738+0000","last_unstale":"2023-10-25T23:44:32.561470+0000","last_undegraded":"2023-10-25T23:44:32.561470+0000","last_fullsized":"2023-10-25T23:44:32.561470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1958,"log_dups_size":0,"ondisk_log_size":1958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:57:05.654538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.162662744,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":3695,"num_write":1175,"num_write_kb":20733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.1d","version":"36'607","reported_seq":639,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:27.996233+0000","last_change":"2023-10-25T23:36:08.273879+0000","last_active":"2023-10-25T23:44:27.996233+0000","last_peered":"2023-10-25T23:44:27.996233+0000","last_clean":"2023-10-25T23:44:27.996233+0000","last_became_active":"2023-10-25T23:36:08.273574+0000","last_became_peered":"2023-10-25T23:36:08.273574+0000","last_unstale":"2023-10-25T23:44:27.996233+0000","last_undegraded":"2023-10-25T23:44:27.996233+0000","last_fullsized":"2023-10-25T23:44:27.996233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:27.340205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":582,"num_write_kb":140942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"38'2150","reported_seq":4731,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.488850+0000","last_change":"2023-10-25T23:44:32.488850+0000","last_active":"2023-10-25T23:44:32.488850+0000","last_peered":"2023-10-25T23:44:32.488850+0000","last_clean":"2023-10-25T23:44:32.488850+0000","last_became_active":"2023-10-25T23:36:09.299916+0000","last_became_peered":"2023-10-25T23:36:09.299916+0000","last_unstale":"2023-10-25T23:44:32.488850+0000","last_undegraded":"2023-10-25T23:44:32.488850+0000","last_fullsized":"2023-10-25T23:44:32.488850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2150,"log_dups_size":0,"ondisk_log_size":2150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:43:16.830999+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.094041616999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":4255,"num_write":1272,"num_write_kb":13349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.1c","version":"36'393","reported_seq":425,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:27.995399+0000","last_change":"2023-10-25T23:36:08.271714+0000","last_active":"2023-10-25T23:44:27.995399+0000","last_peered":"2023-10-25T23:44:27.995399+0000","last_clean":"2023-10-25T23:44:27.995399+0000","last_became_active":"2023-10-25T23:36:08.271442+0000","last_became_peered":"2023-10-25T23:36:08.271442+0000","last_unstale":"2023-10-25T23:44:27.995399+0000","last_undegraded":"2023-10-25T23:44:27.995399+0000","last_fullsized":"2023-10-25T23:44:27.995399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":379,"num_write_kb":83039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"38'2004","reported_seq":4614,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.488957+0000","last_change":"2023-10-25T23:44:32.499523+0000","last_active":"2023-10-25T23:44:32.488957+0000","last_peered":"2023-10-25T23:44:32.488957+0000","last_clean":"2023-10-25T23:44:32.488957+0000","last_became_active":"2023-10-25T23:36:09.299130+0000","last_became_peered":"2023-10-25T23:36:09.299130+0000","last_unstale":"2023-10-25T23:44:32.488957+0000","last_undegraded":"2023-10-25T23:44:32.488957+0000","last_fullsized":"2023-10-25T23:44:32.488957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2004,"log_dups_size":0,"ondisk_log_size":2004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:58:37.312724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104430467,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":3649,"num_write":1196,"num_write_kb":32686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.1b","version":"37'452","reported_seq":484,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.487083+0000","last_change":"2023-10-25T23:36:08.271119+0000","last_active":"2023-10-25T23:44:28.487083+0000","last_peered":"2023-10-25T23:44:28.487083+0000","last_clean":"2023-10-25T23:44:28.487083+0000","last_became_active":"2023-10-25T23:36:08.270138+0000","last_became_peered":"2023-10-25T23:36:08.270138+0000","last_unstale":"2023-10-25T23:44:28.487083+0000","last_undegraded":"2023-10-25T23:44:28.487083+0000","last_fullsized":"2023-10-25T23:44:28.487083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":475,"num_write_kb":111638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"38'2147","reported_seq":4757,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.956082+0000","last_change":"2023-10-25T23:44:38.965871+0000","last_active":"2023-10-25T23:44:38.956082+0000","last_peered":"2023-10-25T23:44:38.956082+0000","last_clean":"2023-10-25T23:44:38.956082+0000","last_became_active":"2023-10-25T23:36:09.287455+0000","last_became_peered":"2023-10-25T23:36:09.287455+0000","last_unstale":"2023-10-25T23:44:38.956082+0000","last_undegraded":"2023-10-25T23:44:38.956082+0000","last_fullsized":"2023-10-25T23:44:38.956082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2147,"log_dups_size":0,"ondisk_log_size":2147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:18.862050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.093404585999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":5171,"num_write":1282,"num_write_kb":34019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.1a","version":"37'538","reported_seq":572,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.948030+0000","last_change":"2023-10-25T23:36:08.272686+0000","last_active":"2023-10-25T23:44:37.948030+0000","last_peered":"2023-10-25T23:44:37.948030+0000","last_clean":"2023-10-25T23:44:37.948030+0000","last_became_active":"2023-10-25T23:36:08.271974+0000","last_became_peered":"2023-10-25T23:36:08.271974+0000","last_unstale":"2023-10-25T23:44:37.948030+0000","last_undegraded":"2023-10-25T23:44:37.948030+0000","last_fullsized":"2023-10-25T23:44:37.948030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":503,"num_write_kb":90640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"38'2093","reported_seq":4662,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.578662+0000","last_change":"2023-10-25T23:44:32.588835+0000","last_active":"2023-10-25T23:44:32.578662+0000","last_peered":"2023-10-25T23:44:32.578662+0000","last_clean":"2023-10-25T23:44:32.578662+0000","last_became_active":"2023-10-25T23:36:09.294176+0000","last_became_peered":"2023-10-25T23:36:09.294176+0000","last_unstale":"2023-10-25T23:44:32.578662+0000","last_undegraded":"2023-10-25T23:44:32.578662+0000","last_fullsized":"2023-10-25T23:44:32.578662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2093,"log_dups_size":0,"ondisk_log_size":2093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:15:01.855063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17501277800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":27232,"num_write":1210,"num_write_kb":20727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.19","version":"37'246","reported_seq":278,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.178636+0000","last_change":"2023-10-25T23:36:08.273513+0000","last_active":"2023-10-25T23:44:32.178636+0000","last_peered":"2023-10-25T23:44:32.178636+0000","last_clean":"2023-10-25T23:44:32.178636+0000","last_became_active":"2023-10-25T23:36:08.273035+0000","last_became_peered":"2023-10-25T23:36:08.273035+0000","last_unstale":"2023-10-25T23:44:32.178636+0000","last_undegraded":"2023-10-25T23:44:32.178636+0000","last_fullsized":"2023-10-25T23:44:32.178636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:21:29.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18998254,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":221,"num_write_kb":78125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"38'2316","reported_seq":4888,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.522977+0000","last_change":"2023-10-25T23:44:32.533846+0000","last_active":"2023-10-25T23:44:32.522977+0000","last_peered":"2023-10-25T23:44:32.522977+0000","last_clean":"2023-10-25T23:44:32.522977+0000","last_became_active":"2023-10-25T23:36:09.292546+0000","last_became_peered":"2023-10-25T23:36:09.292546+0000","last_unstale":"2023-10-25T23:44:32.522977+0000","last_undegraded":"2023-10-25T23:44:32.522977+0000","last_fullsized":"2023-10-25T23:44:32.522977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2316,"log_dups_size":0,"ondisk_log_size":2316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:43:16.830999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12497243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":23958,"num_write":1360,"num_write_kb":38473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.18","version":"36'1017","reported_seq":1049,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.139975+0000","last_change":"2023-10-25T23:36:08.277462+0000","last_active":"2023-10-25T23:44:28.139975+0000","last_peered":"2023-10-25T23:44:28.139975+0000","last_clean":"2023-10-25T23:44:28.139975+0000","last_became_active":"2023-10-25T23:36:08.277138+0000","last_became_peered":"2023-10-25T23:36:08.277138+0000","last_unstale":"2023-10-25T23:44:28.139975+0000","last_undegraded":"2023-10-25T23:44:28.139975+0000","last_fullsized":"2023-10-25T23:44:28.139975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:48:32.291671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":989,"num_write_kb":120913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"37'2057","reported_seq":4644,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.474714+0000","last_change":"2023-10-25T23:44:32.483491+0000","last_active":"2023-10-25T23:44:32.474714+0000","last_peered":"2023-10-25T23:44:32.474714+0000","last_clean":"2023-10-25T23:44:32.474714+0000","last_became_active":"2023-10-25T23:36:09.290456+0000","last_became_peered":"2023-10-25T23:36:09.290456+0000","last_unstale":"2023-10-25T23:44:32.474714+0000","last_undegraded":"2023-10-25T23:44:32.474714+0000","last_fullsized":"2023-10-25T23:44:32.474714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2057,"log_dups_size":0,"ondisk_log_size":2057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:58:04.342558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063862070000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":31667,"num_write":1204,"num_write_kb":33454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.17","version":"38'354","reported_seq":463,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.948090+0000","last_change":"2023-10-25T23:36:08.272869+0000","last_active":"2023-10-25T23:44:37.948090+0000","last_peered":"2023-10-25T23:44:37.948090+0000","last_clean":"2023-10-25T23:44:37.948090+0000","last_became_active":"2023-10-25T23:36:08.272120+0000","last_became_peered":"2023-10-25T23:36:08.272120+0000","last_unstale":"2023-10-25T23:44:37.948090+0000","last_undegraded":"2023-10-25T23:44:37.948090+0000","last_fullsized":"2023-10-25T23:44:37.948090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21516605,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":83,"num_read_kb":580,"num_write":347,"num_write_kb":84046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"38'2003","reported_seq":4594,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.499624+0000","last_change":"2023-10-25T23:44:32.509416+0000","last_active":"2023-10-25T23:44:32.499624+0000","last_peered":"2023-10-25T23:44:32.499624+0000","last_clean":"2023-10-25T23:44:32.499624+0000","last_became_active":"2023-10-25T23:36:09.293132+0000","last_became_peered":"2023-10-25T23:36:09.293132+0000","last_unstale":"2023-10-25T23:44:32.499624+0000","last_undegraded":"2023-10-25T23:44:32.499624+0000","last_fullsized":"2023-10-25T23:44:32.499624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2003,"log_dups_size":0,"ondisk_log_size":2003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:15:03.433377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11400234099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":3351,"num_write":1194,"num_write_kb":12593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.16","version":"38'676","reported_seq":708,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.394602+0000","last_change":"2023-10-25T23:36:08.272920+0000","last_active":"2023-10-25T23:44:32.394602+0000","last_peered":"2023-10-25T23:44:32.394602+0000","last_clean":"2023-10-25T23:44:32.394602+0000","last_became_active":"2023-10-25T23:36:08.272596+0000","last_became_peered":"2023-10-25T23:36:08.272596+0000","last_unstale":"2023-10-25T23:44:32.394602+0000","last_undegraded":"2023-10-25T23:44:32.394602+0000","last_fullsized":"2023-10-25T23:44:32.394602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":681,"num_write_kb":114510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"38'2403","reported_seq":4854,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.578599+0000","last_change":"2023-10-25T23:44:32.588826+0000","last_active":"2023-10-25T23:44:32.578599+0000","last_peered":"2023-10-25T23:44:32.578599+0000","last_clean":"2023-10-25T23:44:32.578599+0000","last_became_active":"2023-10-25T23:36:09.299938+0000","last_became_peered":"2023-10-25T23:36:09.299938+0000","last_unstale":"2023-10-25T23:44:32.578599+0000","last_undegraded":"2023-10-25T23:44:32.578599+0000","last_fullsized":"2023-10-25T23:44:32.578599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2403,"log_dups_size":0,"ondisk_log_size":2403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:18:14.857365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.172680212,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":3949,"num_write":1292,"num_write_kb":20710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.15","version":"38'671","reported_seq":703,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.419765+0000","last_change":"2023-10-25T23:36:08.279751+0000","last_active":"2023-10-25T23:44:32.419765+0000","last_peered":"2023-10-25T23:44:32.419765+0000","last_clean":"2023-10-25T23:44:32.419765+0000","last_became_active":"2023-10-25T23:36:08.279509+0000","last_became_peered":"2023-10-25T23:36:08.279509+0000","last_unstale":"2023-10-25T23:44:32.419765+0000","last_undegraded":"2023-10-25T23:44:32.419765+0000","last_fullsized":"2023-10-25T23:44:32.419765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":674,"num_write_kb":75677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"37'2100","reported_seq":4713,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.956038+0000","last_change":"2023-10-25T23:44:38.965806+0000","last_active":"2023-10-25T23:44:38.956038+0000","last_peered":"2023-10-25T23:44:38.956038+0000","last_clean":"2023-10-25T23:44:38.956038+0000","last_became_active":"2023-10-25T23:36:09.285196+0000","last_became_peered":"2023-10-25T23:36:09.285196+0000","last_unstale":"2023-10-25T23:44:38.956038+0000","last_undegraded":"2023-10-25T23:44:38.956038+0000","last_fullsized":"2023-10-25T23:44:38.956038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:57:33.172851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.093006917999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":5156,"num_write":1232,"num_write_kb":26142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.14","version":"37'525","reported_seq":559,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.948109+0000","last_change":"2023-10-25T23:36:08.272911+0000","last_active":"2023-10-25T23:44:37.948109+0000","last_peered":"2023-10-25T23:44:37.948109+0000","last_clean":"2023-10-25T23:44:37.948109+0000","last_became_active":"2023-10-25T23:36:08.272248+0000","last_became_peered":"2023-10-25T23:36:08.272248+0000","last_unstale":"2023-10-25T23:44:37.948109+0000","last_undegraded":"2023-10-25T23:44:37.948109+0000","last_fullsized":"2023-10-25T23:44:37.948109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166496,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":486,"num_write_kb":123603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"38'2004","reported_seq":4609,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.524715+0000","last_change":"2023-10-25T23:44:32.534402+0000","last_active":"2023-10-25T23:44:32.524715+0000","last_peered":"2023-10-25T23:44:32.524715+0000","last_clean":"2023-10-25T23:44:32.524715+0000","last_became_active":"2023-10-25T23:36:09.292300+0000","last_became_peered":"2023-10-25T23:36:09.292300+0000","last_unstale":"2023-10-25T23:44:32.524715+0000","last_undegraded":"2023-10-25T23:44:32.524715+0000","last_fullsized":"2023-10-25T23:44:32.524715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2004,"log_dups_size":0,"ondisk_log_size":2004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:25:10.694319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11980879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":3691,"num_write":1193,"num_write_kb":20847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.13","version":"36'212","reported_seq":244,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.472556+0000","last_change":"2023-10-25T23:36:08.274407+0000","last_active":"2023-10-25T23:44:28.472556+0000","last_peered":"2023-10-25T23:44:28.472556+0000","last_clean":"2023-10-25T23:44:28.472556+0000","last_became_active":"2023-10-25T23:36:08.274162+0000","last_became_peered":"2023-10-25T23:36:08.274162+0000","last_unstale":"2023-10-25T23:44:28.472556+0000","last_undegraded":"2023-10-25T23:44:28.472556+0000","last_fullsized":"2023-10-25T23:44:28.472556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360162,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":202,"num_write_kb":93162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"38'2303","reported_seq":4780,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.525183+0000","last_change":"2023-10-25T23:44:32.535345+0000","last_active":"2023-10-25T23:44:32.525183+0000","last_peered":"2023-10-25T23:44:32.525183+0000","last_clean":"2023-10-25T23:44:32.525183+0000","last_became_active":"2023-10-25T23:36:09.284386+0000","last_became_peered":"2023-10-25T23:36:09.284386+0000","last_unstale":"2023-10-25T23:44:32.525183+0000","last_undegraded":"2023-10-25T23:44:32.525183+0000","last_fullsized":"2023-10-25T23:44:32.525183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2303,"log_dups_size":0,"ondisk_log_size":2303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:25:24.082691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.122095678,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":8533,"num_write":1240,"num_write_kb":24417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.12","version":"35'180","reported_seq":212,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.140009+0000","last_change":"2023-10-25T23:36:08.271565+0000","last_active":"2023-10-25T23:44:28.140009+0000","last_peered":"2023-10-25T23:44:28.140009+0000","last_clean":"2023-10-25T23:44:28.140009+0000","last_became_active":"2023-10-25T23:36:08.271188+0000","last_became_peered":"2023-10-25T23:36:08.271188+0000","last_unstale":"2023-10-25T23:44:28.140009+0000","last_undegraded":"2023-10-25T23:44:28.140009+0000","last_fullsized":"2023-10-25T23:44:28.140009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:51:48.005011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":160,"num_write_kb":61795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"37'2148","reported_seq":4727,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.508023+0000","last_change":"2023-10-25T23:44:32.524610+0000","last_active":"2023-10-25T23:44:32.508023+0000","last_peered":"2023-10-25T23:44:32.508023+0000","last_clean":"2023-10-25T23:44:32.508023+0000","last_became_active":"2023-10-25T23:36:09.294200+0000","last_became_peered":"2023-10-25T23:36:09.294200+0000","last_unstale":"2023-10-25T23:44:32.508023+0000","last_undegraded":"2023-10-25T23:44:32.508023+0000","last_fullsized":"2023-10-25T23:44:32.508023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2148,"log_dups_size":0,"ondisk_log_size":2148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:58:37.312724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11302248199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":3992,"num_write":1263,"num_write_kb":18428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.11","version":"37'389","reported_seq":423,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.949534+0000","last_change":"2023-10-25T23:36:08.273427+0000","last_active":"2023-10-25T23:44:37.949534+0000","last_peered":"2023-10-25T23:44:37.949534+0000","last_clean":"2023-10-25T23:44:37.949534+0000","last_became_active":"2023-10-25T23:36:08.272301+0000","last_became_peered":"2023-10-25T23:36:08.272301+0000","last_unstale":"2023-10-25T23:44:37.949534+0000","last_undegraded":"2023-10-25T23:44:37.949534+0000","last_fullsized":"2023-10-25T23:44:37.949534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":376,"num_write_kb":99496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"38'2009","reported_seq":4631,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.502533+0000","last_change":"2023-10-25T23:44:39.507532+0000","last_active":"2023-10-25T23:44:39.502533+0000","last_peered":"2023-10-25T23:44:39.502533+0000","last_clean":"2023-10-25T23:44:39.502533+0000","last_became_active":"2023-10-25T23:36:09.291305+0000","last_became_peered":"2023-10-25T23:36:09.291305+0000","last_unstale":"2023-10-25T23:44:39.502533+0000","last_undegraded":"2023-10-25T23:44:39.502533+0000","last_fullsized":"2023-10-25T23:44:39.502533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:35:20.916506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044631746999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":3822,"num_write":1210,"num_write_kb":15603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.10","version":"36'336","reported_seq":370,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.871585+0000","last_change":"2023-10-25T23:36:08.277621+0000","last_active":"2023-10-25T23:44:37.871585+0000","last_peered":"2023-10-25T23:44:37.871585+0000","last_clean":"2023-10-25T23:44:37.871585+0000","last_became_active":"2023-10-25T23:36:08.277327+0000","last_became_peered":"2023-10-25T23:36:08.277327+0000","last_unstale":"2023-10-25T23:44:37.871585+0000","last_undegraded":"2023-10-25T23:44:37.871585+0000","last_fullsized":"2023-10-25T23:44:37.871585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:04.918703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":349,"num_write_kb":89245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"38'2078","reported_seq":4705,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.497526+0000","last_change":"2023-10-25T23:44:32.507949+0000","last_active":"2023-10-25T23:44:32.497526+0000","last_peered":"2023-10-25T23:44:32.497526+0000","last_clean":"2023-10-25T23:44:32.497526+0000","last_became_active":"2023-10-25T23:36:09.295231+0000","last_became_peered":"2023-10-25T23:36:09.295231+0000","last_unstale":"2023-10-25T23:44:32.497526+0000","last_undegraded":"2023-10-25T23:44:32.497526+0000","last_fullsized":"2023-10-25T23:44:32.497526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2078,"log_dups_size":0,"ondisk_log_size":2078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:20:50.930557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.096538947,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":12104,"num_write":1268,"num_write_kb":24673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.f","version":"36'388","reported_seq":422,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.871300+0000","last_change":"2023-10-25T23:36:08.263573+0000","last_active":"2023-10-25T23:44:37.871300+0000","last_peered":"2023-10-25T23:44:37.871300+0000","last_clean":"2023-10-25T23:44:37.871300+0000","last_became_active":"2023-10-25T23:36:08.263264+0000","last_became_peered":"2023-10-25T23:36:08.263264+0000","last_unstale":"2023-10-25T23:44:37.871300+0000","last_undegraded":"2023-10-25T23:44:37.871300+0000","last_fullsized":"2023-10-25T23:44:37.871300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554454,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":368,"num_write_kb":90831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"38'2065","reported_seq":4672,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.524666+0000","last_change":"2023-10-25T23:44:32.534422+0000","last_active":"2023-10-25T23:44:32.524666+0000","last_peered":"2023-10-25T23:44:32.524666+0000","last_clean":"2023-10-25T23:44:32.524666+0000","last_became_active":"2023-10-25T23:36:09.294298+0000","last_became_peered":"2023-10-25T23:36:09.294298+0000","last_unstale":"2023-10-25T23:44:32.524666+0000","last_undegraded":"2023-10-25T23:44:32.524666+0000","last_fullsized":"2023-10-25T23:44:32.524666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:15:03.433377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12011416900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":8972,"num_write":1223,"num_write_kb":21636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.4","version":"37'318","reported_seq":351,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:31.099513+0000","last_change":"2023-10-25T23:36:08.277383+0000","last_active":"2023-10-25T23:44:31.099513+0000","last_peered":"2023-10-25T23:44:31.099513+0000","last_clean":"2023-10-25T23:44:31.099513+0000","last_became_active":"2023-10-25T23:36:08.277087+0000","last_became_peered":"2023-10-25T23:36:08.277087+0000","last_unstale":"2023-10-25T23:44:31.099513+0000","last_undegraded":"2023-10-25T23:44:31.099513+0000","last_fullsized":"2023-10-25T23:44:31.099513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":307,"num_write_kb":115956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"38'2151","reported_seq":4738,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.499581+0000","last_change":"2023-10-25T23:44:32.509417+0000","last_active":"2023-10-25T23:44:32.499581+0000","last_peered":"2023-10-25T23:44:32.499581+0000","last_clean":"2023-10-25T23:44:32.499581+0000","last_became_active":"2023-10-25T23:36:50.069951+0000","last_became_peered":"2023-10-25T23:36:50.069951+0000","last_unstale":"2023-10-25T23:44:32.499581+0000","last_undegraded":"2023-10-25T23:44:32.499581+0000","last_fullsized":"2023-10-25T23:44:32.499581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2151,"log_dups_size":0,"ondisk_log_size":2151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:22:15.481808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.114189366,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":24659,"num_write":1256,"num_write_kb":46504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.2","version":"36'293","reported_seq":326,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:31.105686+0000","last_change":"2023-10-25T23:36:08.279568+0000","last_active":"2023-10-25T23:44:31.105686+0000","last_peered":"2023-10-25T23:44:31.105686+0000","last_clean":"2023-10-25T23:44:31.105686+0000","last_became_active":"2023-10-25T23:36:08.279302+0000","last_became_peered":"2023-10-25T23:36:08.279302+0000","last_unstale":"2023-10-25T23:44:31.105686+0000","last_undegraded":"2023-10-25T23:44:31.105686+0000","last_fullsized":"2023-10-25T23:44:31.105686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:27.340205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":257,"num_write_kb":101207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"37'2033","reported_seq":4663,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.965867+0000","last_change":"2023-10-25T23:44:38.976975+0000","last_active":"2023-10-25T23:44:38.965867+0000","last_peered":"2023-10-25T23:44:38.965867+0000","last_clean":"2023-10-25T23:44:38.965867+0000","last_became_active":"2023-10-25T23:36:09.292670+0000","last_became_peered":"2023-10-25T23:36:09.292670+0000","last_unstale":"2023-10-25T23:44:38.965867+0000","last_undegraded":"2023-10-25T23:44:38.965867+0000","last_fullsized":"2023-10-25T23:44:38.965867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:47:28.005164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104196124,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":4275,"num_write":1236,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.0","version":"37'2110","reported_seq":4697,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.466256+0000","last_change":"2023-10-25T23:44:32.474501+0000","last_active":"2023-10-25T23:44:32.466256+0000","last_peered":"2023-10-25T23:44:32.466256+0000","last_clean":"2023-10-25T23:44:32.466256+0000","last_became_active":"2023-10-25T23:36:09.283766+0000","last_became_peered":"2023-10-25T23:36:09.283766+0000","last_unstale":"2023-10-25T23:44:32.466256+0000","last_undegraded":"2023-10-25T23:44:32.466256+0000","last_fullsized":"2023-10-25T23:44:32.466256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2110,"log_dups_size":0,"ondisk_log_size":2110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:45:53.731749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055185130999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":3969,"num_write":1247,"num_write_kb":17464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.1","version":"36'550","reported_seq":878,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.871700+0000","last_change":"2023-10-25T23:36:08.264050+0000","last_active":"2023-10-25T23:44:37.871700+0000","last_peered":"2023-10-25T23:44:37.871700+0000","last_clean":"2023-10-25T23:44:37.871700+0000","last_became_active":"2023-10-25T23:36:08.263842+0000","last_became_peered":"2023-10-25T23:36:08.263842+0000","last_unstale":"2023-10-25T23:44:37.871700+0000","last_undegraded":"2023-10-25T23:44:37.871700+0000","last_fullsized":"2023-10-25T23:44:37.871700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:31.130445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":301,"num_read_kb":4287,"num_write":520,"num_write_kb":107914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"38'2106","reported_seq":4676,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.569558+0000","last_change":"2023-10-25T23:44:32.579545+0000","last_active":"2023-10-25T23:44:32.569558+0000","last_peered":"2023-10-25T23:44:32.569558+0000","last_clean":"2023-10-25T23:44:32.569558+0000","last_became_active":"2023-10-25T23:36:09.295595+0000","last_became_peered":"2023-10-25T23:36:09.295595+0000","last_unstale":"2023-10-25T23:44:32.569558+0000","last_undegraded":"2023-10-25T23:44:32.569558+0000","last_fullsized":"2023-10-25T23:44:32.569558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2106,"log_dups_size":0,"ondisk_log_size":2106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:47:48.760379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16669458700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":3321,"num_write":1232,"num_write_kb":16686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.3","version":"36'221","reported_seq":254,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:31.105720+0000","last_change":"2023-10-25T23:36:08.272009+0000","last_active":"2023-10-25T23:44:31.105720+0000","last_peered":"2023-10-25T23:44:31.105720+0000","last_clean":"2023-10-25T23:44:31.105720+0000","last_became_active":"2023-10-25T23:36:08.271640+0000","last_became_peered":"2023-10-25T23:36:08.271640+0000","last_unstale":"2023-10-25T23:44:31.105720+0000","last_undegraded":"2023-10-25T23:44:31.105720+0000","last_fullsized":"2023-10-25T23:44:31.105720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:40.023263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":206,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":186,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:27.995191+0000","last_change":"2023-10-25T23:35:58.277542+0000","last_active":"2023-10-25T23:44:27.995191+0000","last_peered":"2023-10-25T23:44:27.995191+0000","last_clean":"2023-10-25T23:44:27.995191+0000","last_became_active":"2023-10-25T23:35:58.276606+0000","last_became_peered":"2023-10-25T23:35:58.276606+0000","last_unstale":"2023-10-25T23:44:27.995191+0000","last_undegraded":"2023-10-25T23:44:27.995191+0000","last_fullsized":"2023-10-25T23:44:27.995191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:35:57.197265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:35:57.197265+0000","last_clean_scrub_stamp":"2023-10-25T23:35:57.197265+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:53:55.116662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"38'1942","reported_seq":4532,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.523005+0000","last_change":"2023-10-25T23:44:32.535944+0000","last_active":"2023-10-25T23:44:32.523005+0000","last_peered":"2023-10-25T23:44:32.523005+0000","last_clean":"2023-10-25T23:44:32.523005+0000","last_became_active":"2023-10-25T23:36:09.291072+0000","last_became_peered":"2023-10-25T23:36:09.291072+0000","last_unstale":"2023-10-25T23:44:32.523005+0000","last_undegraded":"2023-10-25T23:44:32.523005+0000","last_fullsized":"2023-10-25T23:44:32.523005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1942,"log_dups_size":0,"ondisk_log_size":1942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:08:35.964760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.124694893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":28650,"num_write":1164,"num_write_kb":22232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.0","version":"36'240","reported_seq":273,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:27.995297+0000","last_change":"2023-10-25T23:36:08.277937+0000","last_active":"2023-10-25T23:44:27.995297+0000","last_peered":"2023-10-25T23:44:27.995297+0000","last_clean":"2023-10-25T23:44:27.995297+0000","last_became_active":"2023-10-25T23:36:08.277663+0000","last_became_peered":"2023-10-25T23:36:08.277663+0000","last_unstale":"2023-10-25T23:44:27.995297+0000","last_undegraded":"2023-10-25T23:44:27.995297+0000","last_fullsized":"2023-10-25T23:44:27.995297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:04.918703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":226,"num_write_kb":82970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"38'485","reported_seq":518,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.414939+0000","last_change":"2023-10-25T23:36:08.270783+0000","last_active":"2023-10-25T23:44:32.414939+0000","last_peered":"2023-10-25T23:44:32.414939+0000","last_clean":"2023-10-25T23:44:32.414939+0000","last_became_active":"2023-10-25T23:36:08.269896+0000","last_became_peered":"2023-10-25T23:36:08.269896+0000","last_unstale":"2023-10-25T23:44:32.414939+0000","last_undegraded":"2023-10-25T23:44:32.414939+0000","last_fullsized":"2023-10-25T23:44:32.414939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":446,"num_write_kb":94912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"38'2027","reported_seq":4641,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.483964+0000","last_change":"2023-10-25T23:44:32.490756+0000","last_active":"2023-10-25T23:44:32.483964+0000","last_peered":"2023-10-25T23:44:32.483964+0000","last_clean":"2023-10-25T23:44:32.483964+0000","last_became_active":"2023-10-25T23:36:09.278967+0000","last_became_peered":"2023-10-25T23:36:09.278967+0000","last_unstale":"2023-10-25T23:44:32.483964+0000","last_undegraded":"2023-10-25T23:44:32.483964+0000","last_fullsized":"2023-10-25T23:44:32.483964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2027,"log_dups_size":0,"ondisk_log_size":2027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:55:37.816244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070850333000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":3903,"num_write":1243,"num_write_kb":26062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.6","version":"37'363","reported_seq":395,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.150970+0000","last_change":"2023-10-25T23:36:08.279363+0000","last_active":"2023-10-25T23:44:32.150970+0000","last_peered":"2023-10-25T23:44:32.150970+0000","last_clean":"2023-10-25T23:44:32.150970+0000","last_became_active":"2023-10-25T23:36:08.279082+0000","last_became_peered":"2023-10-25T23:36:08.279082+0000","last_unstale":"2023-10-25T23:44:32.150970+0000","last_undegraded":"2023-10-25T23:44:32.150970+0000","last_fullsized":"2023-10-25T23:44:32.150970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":463,"num_write_kb":81485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"38'1958","reported_seq":4546,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.579608+0000","last_change":"2023-10-25T23:44:32.589792+0000","last_active":"2023-10-25T23:44:32.579608+0000","last_peered":"2023-10-25T23:44:32.579608+0000","last_clean":"2023-10-25T23:44:32.579608+0000","last_became_active":"2023-10-25T23:36:09.289751+0000","last_became_peered":"2023-10-25T23:36:09.289751+0000","last_unstale":"2023-10-25T23:44:32.579608+0000","last_undegraded":"2023-10-25T23:44:32.579608+0000","last_fullsized":"2023-10-25T23:44:32.579608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1958,"log_dups_size":0,"ondisk_log_size":1958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:25:10.694319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.180222046,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":4389,"num_write":1130,"num_write_kb":12211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.7","version":"38'408","reported_seq":442,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.947700+0000","last_change":"2023-10-25T23:36:08.274349+0000","last_active":"2023-10-25T23:44:37.947700+0000","last_peered":"2023-10-25T23:44:37.947700+0000","last_clean":"2023-10-25T23:44:37.947700+0000","last_became_active":"2023-10-25T23:36:08.273029+0000","last_became_peered":"2023-10-25T23:36:08.273029+0000","last_unstale":"2023-10-25T23:44:37.947700+0000","last_undegraded":"2023-10-25T23:44:37.947700+0000","last_fullsized":"2023-10-25T23:44:37.947700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":396,"num_write_kb":80384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"37'1987","reported_seq":4591,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.546622+0000","last_change":"2023-10-25T23:44:32.561359+0000","last_active":"2023-10-25T23:44:32.546622+0000","last_peered":"2023-10-25T23:44:32.546622+0000","last_clean":"2023-10-25T23:44:32.546622+0000","last_became_active":"2023-10-25T23:36:09.287532+0000","last_became_peered":"2023-10-25T23:36:09.287532+0000","last_unstale":"2023-10-25T23:44:32.546622+0000","last_undegraded":"2023-10-25T23:44:32.546622+0000","last_fullsized":"2023-10-25T23:44:32.546622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:48:17.801733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14756345200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":4941,"num_write":1181,"num_write_kb":9554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.8","version":"36'238","reported_seq":270,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:27.995191+0000","last_change":"2023-10-25T23:36:08.266963+0000","last_active":"2023-10-25T23:44:27.995191+0000","last_peered":"2023-10-25T23:44:27.995191+0000","last_clean":"2023-10-25T23:44:27.995191+0000","last_became_active":"2023-10-25T23:36:08.266648+0000","last_became_peered":"2023-10-25T23:36:08.266648+0000","last_unstale":"2023-10-25T23:44:27.995191+0000","last_undegraded":"2023-10-25T23:44:27.995191+0000","last_fullsized":"2023-10-25T23:44:27.995191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:31.130445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":194,"num_write_kb":95518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"38'2105","reported_seq":4726,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.938764+0000","last_change":"2023-10-25T23:44:38.947498+0000","last_active":"2023-10-25T23:44:38.938764+0000","last_peered":"2023-10-25T23:44:38.938764+0000","last_clean":"2023-10-25T23:44:38.938764+0000","last_became_active":"2023-10-25T23:36:09.284666+0000","last_became_peered":"2023-10-25T23:36:09.284666+0000","last_unstale":"2023-10-25T23:44:38.938764+0000","last_undegraded":"2023-10-25T23:44:38.938764+0000","last_fullsized":"2023-10-25T23:44:38.938764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2105,"log_dups_size":0,"ondisk_log_size":2105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:12:30.838027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.075073965000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":4417,"num_write":1270,"num_write_kb":29307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.9","version":"36'390","reported_seq":422,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.138646+0000","last_change":"2023-10-25T23:36:08.278162+0000","last_active":"2023-10-25T23:44:28.138646+0000","last_peered":"2023-10-25T23:44:28.138646+0000","last_clean":"2023-10-25T23:44:28.138646+0000","last_became_active":"2023-10-25T23:36:08.277873+0000","last_became_peered":"2023-10-25T23:36:08.277873+0000","last_unstale":"2023-10-25T23:44:28.138646+0000","last_undegraded":"2023-10-25T23:44:28.138646+0000","last_fullsized":"2023-10-25T23:44:28.138646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":385,"num_write_kb":96608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"38'2131","reported_seq":4728,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.533964+0000","last_change":"2023-10-25T23:44:32.544755+0000","last_active":"2023-10-25T23:44:32.533964+0000","last_peered":"2023-10-25T23:44:32.533964+0000","last_clean":"2023-10-25T23:44:32.533964+0000","last_became_active":"2023-10-25T23:36:09.289320+0000","last_became_peered":"2023-10-25T23:36:09.289320+0000","last_unstale":"2023-10-25T23:44:32.533964+0000","last_undegraded":"2023-10-25T23:44:32.533964+0000","last_fullsized":"2023-10-25T23:44:32.533964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2131,"log_dups_size":0,"ondisk_log_size":2131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:58:54.338525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.135709307,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":230,"num_read_kb":4443,"num_write":1269,"num_write_kb":26048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.a","version":"36'618","reported_seq":650,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.138363+0000","last_change":"2023-10-25T23:36:08.278921+0000","last_active":"2023-10-25T23:44:28.138363+0000","last_peered":"2023-10-25T23:44:28.138363+0000","last_clean":"2023-10-25T23:44:28.138363+0000","last_became_active":"2023-10-25T23:36:08.278656+0000","last_became_peered":"2023-10-25T23:36:08.278656+0000","last_unstale":"2023-10-25T23:44:28.138363+0000","last_undegraded":"2023-10-25T23:44:28.138363+0000","last_fullsized":"2023-10-25T23:44:28.138363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":598,"num_write_kb":115954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"38'2104","reported_seq":4678,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.559006+0000","last_change":"2023-10-25T23:44:32.569480+0000","last_active":"2023-10-25T23:44:32.559006+0000","last_peered":"2023-10-25T23:44:32.559006+0000","last_clean":"2023-10-25T23:44:32.559006+0000","last_became_active":"2023-10-25T23:36:09.292345+0000","last_became_peered":"2023-10-25T23:36:09.292345+0000","last_unstale":"2023-10-25T23:44:32.559006+0000","last_undegraded":"2023-10-25T23:44:32.559006+0000","last_fullsized":"2023-10-25T23:44:32.559006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2104,"log_dups_size":0,"ondisk_log_size":2104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:58:37.312724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15989214199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":8471,"num_write":1242,"num_write_kb":22974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.b","version":"38'416","reported_seq":448,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.411010+0000","last_change":"2023-10-25T23:36:08.270589+0000","last_active":"2023-10-25T23:44:32.411010+0000","last_peered":"2023-10-25T23:44:32.411010+0000","last_clean":"2023-10-25T23:44:32.411010+0000","last_became_active":"2023-10-25T23:36:08.268753+0000","last_became_peered":"2023-10-25T23:36:08.268753+0000","last_unstale":"2023-10-25T23:44:32.411010+0000","last_undegraded":"2023-10-25T23:44:32.411010+0000","last_fullsized":"2023-10-25T23:44:32.411010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":415,"num_write_kb":99792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"37'2024","reported_seq":4651,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.507668+0000","last_change":"2023-10-25T23:44:39.510909+0000","last_active":"2023-10-25T23:44:39.507668+0000","last_peered":"2023-10-25T23:44:39.507668+0000","last_clean":"2023-10-25T23:44:39.507668+0000","last_became_active":"2023-10-25T23:36:09.290151+0000","last_became_peered":"2023-10-25T23:36:09.290151+0000","last_unstale":"2023-10-25T23:44:39.507668+0000","last_undegraded":"2023-10-25T23:44:39.507668+0000","last_fullsized":"2023-10-25T23:44:39.507668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2024,"log_dups_size":0,"ondisk_log_size":2024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:56:59.222424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047955154,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":5633,"num_write":1198,"num_write_kb":13442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.c","version":"37'230","reported_seq":264,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.871765+0000","last_change":"2023-10-25T23:36:08.272161+0000","last_active":"2023-10-25T23:44:37.871765+0000","last_peered":"2023-10-25T23:44:37.871765+0000","last_clean":"2023-10-25T23:44:37.871765+0000","last_became_active":"2023-10-25T23:36:08.271846+0000","last_became_peered":"2023-10-25T23:36:08.271846+0000","last_unstale":"2023-10-25T23:44:37.871765+0000","last_undegraded":"2023-10-25T23:44:37.871765+0000","last_fullsized":"2023-10-25T23:44:37.871765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:39.512919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":195,"num_write_kb":98810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"38'2024","reported_seq":4615,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.534494+0000","last_change":"2023-10-25T23:44:32.543725+0000","last_active":"2023-10-25T23:44:32.534494+0000","last_peered":"2023-10-25T23:44:32.534494+0000","last_clean":"2023-10-25T23:44:32.534494+0000","last_became_active":"2023-10-25T23:36:09.295635+0000","last_became_peered":"2023-10-25T23:36:09.295635+0000","last_unstale":"2023-10-25T23:44:32.534494+0000","last_undegraded":"2023-10-25T23:44:32.534494+0000","last_fullsized":"2023-10-25T23:44:32.534494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2024,"log_dups_size":0,"ondisk_log_size":2024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:58:54.338525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12892921700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":10038,"num_write":1186,"num_write_kb":32237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.d","version":"36'444","reported_seq":476,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.138558+0000","last_change":"2023-10-25T23:36:08.277618+0000","last_active":"2023-10-25T23:44:28.138558+0000","last_peered":"2023-10-25T23:44:28.138558+0000","last_clean":"2023-10-25T23:44:28.138558+0000","last_became_active":"2023-10-25T23:36:08.277344+0000","last_became_peered":"2023-10-25T23:36:08.277344+0000","last_unstale":"2023-10-25T23:44:28.138558+0000","last_undegraded":"2023-10-25T23:44:28.138558+0000","last_fullsized":"2023-10-25T23:44:28.138558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:21:29.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25170780,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":452,"num_write_kb":113081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"38'2036","reported_seq":4641,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.467108+0000","last_change":"2023-10-25T23:44:32.477913+0000","last_active":"2023-10-25T23:44:32.467108+0000","last_peered":"2023-10-25T23:44:32.467108+0000","last_clean":"2023-10-25T23:44:32.467108+0000","last_became_active":"2023-10-25T23:36:09.299234+0000","last_became_peered":"2023-10-25T23:36:09.299234+0000","last_unstale":"2023-10-25T23:44:32.467108+0000","last_undegraded":"2023-10-25T23:44:32.467108+0000","last_fullsized":"2023-10-25T23:44:32.467108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:07:23.792926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.083041489999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":4213,"num_write":1231,"num_write_kb":8559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.e","version":"36'466","reported_seq":500,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.871997+0000","last_change":"2023-10-25T23:36:08.269389+0000","last_active":"2023-10-25T23:44:37.871997+0000","last_peered":"2023-10-25T23:44:37.871997+0000","last_clean":"2023-10-25T23:44:37.871997+0000","last_became_active":"2023-10-25T23:36:08.269065+0000","last_became_peered":"2023-10-25T23:36:08.269065+0000","last_unstale":"2023-10-25T23:44:37.871997+0000","last_undegraded":"2023-10-25T23:44:37.871997+0000","last_fullsized":"2023-10-25T23:44:37.871997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":460,"num_write_kb":103224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"38'2026","reported_seq":4636,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.534598+0000","last_change":"2023-10-25T23:44:32.543717+0000","last_active":"2023-10-25T23:44:32.534598+0000","last_peered":"2023-10-25T23:44:32.534598+0000","last_clean":"2023-10-25T23:44:32.534598+0000","last_became_active":"2023-10-25T23:36:09.294494+0000","last_became_peered":"2023-10-25T23:36:09.294494+0000","last_unstale":"2023-10-25T23:44:32.534598+0000","last_undegraded":"2023-10-25T23:44:32.534598+0000","last_fullsized":"2023-10-25T23:44:32.534598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:47:48.760379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12874353299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":9037,"num_write":1232,"num_write_kb":21545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.20","version":"38'2048","reported_seq":4692,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.507611+0000","last_change":"2023-10-25T23:44:39.510985+0000","last_active":"2023-10-25T23:44:39.507611+0000","last_peered":"2023-10-25T23:44:39.507611+0000","last_clean":"2023-10-25T23:44:39.507611+0000","last_became_active":"2023-10-25T23:36:09.291665+0000","last_became_peered":"2023-10-25T23:36:09.291665+0000","last_unstale":"2023-10-25T23:44:39.507611+0000","last_undegraded":"2023-10-25T23:44:39.507611+0000","last_fullsized":"2023-10-25T23:44:39.507611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2048,"log_dups_size":0,"ondisk_log_size":2048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:23:16.256254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048033508000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":23343,"num_write":1242,"num_write_kb":29102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.21","version":"38'2167","reported_seq":4771,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.906315+0000","last_change":"2023-10-25T23:44:38.911392+0000","last_active":"2023-10-25T23:44:38.906315+0000","last_peered":"2023-10-25T23:44:38.906315+0000","last_clean":"2023-10-25T23:44:38.906315+0000","last_became_active":"2023-10-25T23:36:09.295817+0000","last_became_peered":"2023-10-25T23:36:09.295817+0000","last_unstale":"2023-10-25T23:44:38.906315+0000","last_undegraded":"2023-10-25T23:44:38.906315+0000","last_fullsized":"2023-10-25T23:44:38.906315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2167,"log_dups_size":0,"ondisk_log_size":2167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:45:10.022688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038422899000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":12397,"num_write":1283,"num_write_kb":33443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.22","version":"37'2070","reported_seq":4665,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.477977+0000","last_change":"2023-10-25T23:44:32.488844+0000","last_active":"2023-10-25T23:44:32.477977+0000","last_peered":"2023-10-25T23:44:32.477977+0000","last_clean":"2023-10-25T23:44:32.477977+0000","last_became_active":"2023-10-25T23:36:09.299024+0000","last_became_peered":"2023-10-25T23:36:09.299024+0000","last_unstale":"2023-10-25T23:44:32.477977+0000","last_undegraded":"2023-10-25T23:44:32.477977+0000","last_fullsized":"2023-10-25T23:44:32.477977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:10:34.048013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.093943498,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":4357,"num_write":1220,"num_write_kb":7384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.23","version":"37'2232","reported_seq":4786,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.547769+0000","last_change":"2023-10-25T23:44:32.561360+0000","last_active":"2023-10-25T23:44:32.547769+0000","last_peered":"2023-10-25T23:44:32.547769+0000","last_clean":"2023-10-25T23:44:32.547769+0000","last_became_active":"2023-10-25T23:36:09.292344+0000","last_became_peered":"2023-10-25T23:36:09.292344+0000","last_unstale":"2023-10-25T23:44:32.547769+0000","last_undegraded":"2023-10-25T23:44:32.547769+0000","last_fullsized":"2023-10-25T23:44:32.547769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2232,"log_dups_size":0,"ondisk_log_size":2232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:09.563199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.147721039,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":3547,"num_write":1298,"num_write_kb":27693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.24","version":"38'2016","reported_seq":4597,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.569503+0000","last_change":"2023-10-25T23:44:32.579537+0000","last_active":"2023-10-25T23:44:32.569503+0000","last_peered":"2023-10-25T23:44:32.569503+0000","last_clean":"2023-10-25T23:44:32.569503+0000","last_became_active":"2023-10-25T23:36:09.297202+0000","last_became_peered":"2023-10-25T23:36:09.297202+0000","last_unstale":"2023-10-25T23:44:32.569503+0000","last_undegraded":"2023-10-25T23:44:32.569503+0000","last_fullsized":"2023-10-25T23:44:32.569503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:15:03.433377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16961031800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":7838,"num_write":1164,"num_write_kb":15586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.25","version":"37'2020","reported_seq":4707,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.474663+0000","last_change":"2023-10-25T23:44:32.483496+0000","last_active":"2023-10-25T23:44:32.474663+0000","last_peered":"2023-10-25T23:44:32.474663+0000","last_clean":"2023-10-25T23:44:32.474663+0000","last_became_active":"2023-10-25T23:36:09.293157+0000","last_became_peered":"2023-10-25T23:36:09.293157+0000","last_unstale":"2023-10-25T23:44:32.474663+0000","last_undegraded":"2023-10-25T23:44:32.474663+0000","last_fullsized":"2023-10-25T23:44:32.474663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2020,"log_dups_size":0,"ondisk_log_size":2020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:35:16.290832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063886599000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":301,"num_read_kb":22462,"num_write":1198,"num_write_kb":27011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.26","version":"38'2156","reported_seq":4757,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.516218+0000","last_change":"2023-10-25T23:44:39.519493+0000","last_active":"2023-10-25T23:44:39.516218+0000","last_peered":"2023-10-25T23:44:39.516218+0000","last_clean":"2023-10-25T23:44:39.516218+0000","last_became_active":"2023-10-25T23:36:09.288127+0000","last_became_peered":"2023-10-25T23:36:09.288127+0000","last_unstale":"2023-10-25T23:44:39.516218+0000","last_undegraded":"2023-10-25T23:44:39.516218+0000","last_fullsized":"2023-10-25T23:44:39.516218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2156,"log_dups_size":0,"ondisk_log_size":2156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:42.350798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055712415000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":4655,"num_write":1304,"num_write_kb":14899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.27","version":"38'1996","reported_seq":4603,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.559063+0000","last_change":"2023-10-25T23:44:32.569447+0000","last_active":"2023-10-25T23:44:32.559063+0000","last_peered":"2023-10-25T23:44:32.559063+0000","last_clean":"2023-10-25T23:44:32.559063+0000","last_became_active":"2023-10-25T23:36:09.290160+0000","last_became_peered":"2023-10-25T23:36:09.290160+0000","last_unstale":"2023-10-25T23:44:32.559063+0000","last_undegraded":"2023-10-25T23:44:32.559063+0000","last_fullsized":"2023-10-25T23:44:32.559063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1996,"log_dups_size":0,"ondisk_log_size":1996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:22:15.481808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15980784200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":16054,"num_write":1171,"num_write_kb":30881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.28","version":"38'2009","reported_seq":4618,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.465470+0000","last_change":"2023-10-25T23:44:32.465470+0000","last_active":"2023-10-25T23:44:32.465470+0000","last_peered":"2023-10-25T23:44:32.465470+0000","last_clean":"2023-10-25T23:44:32.465470+0000","last_became_active":"2023-10-25T23:36:09.298637+0000","last_became_peered":"2023-10-25T23:36:09.298637+0000","last_unstale":"2023-10-25T23:44:32.465470+0000","last_undegraded":"2023-10-25T23:44:32.465470+0000","last_fullsized":"2023-10-25T23:44:32.465470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:30:25.067286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070832067999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":3413,"num_write":1198,"num_write_kb":11362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.29","version":"37'1982","reported_seq":4595,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.533912+0000","last_change":"2023-10-25T23:44:32.544759+0000","last_active":"2023-10-25T23:44:32.533912+0000","last_peered":"2023-10-25T23:44:32.533912+0000","last_clean":"2023-10-25T23:44:32.533912+0000","last_became_active":"2023-10-25T23:36:09.290546+0000","last_became_peered":"2023-10-25T23:36:09.290546+0000","last_unstale":"2023-10-25T23:44:32.533912+0000","last_undegraded":"2023-10-25T23:44:32.533912+0000","last_fullsized":"2023-10-25T23:44:32.533912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1982,"log_dups_size":0,"ondisk_log_size":1982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:07:23.792926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.135788095,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":7180,"num_write":1206,"num_write_kb":23829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.2a","version":"37'2160","reported_seq":4722,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.483906+0000","last_change":"2023-10-25T23:44:32.490753+0000","last_active":"2023-10-25T23:44:32.483906+0000","last_peered":"2023-10-25T23:44:32.483906+0000","last_clean":"2023-10-25T23:44:32.483906+0000","last_became_active":"2023-10-25T23:36:50.102780+0000","last_became_peered":"2023-10-25T23:36:50.102780+0000","last_unstale":"2023-10-25T23:44:32.483906+0000","last_undegraded":"2023-10-25T23:44:32.483906+0000","last_fullsized":"2023-10-25T23:44:32.483906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2160,"log_dups_size":0,"ondisk_log_size":2160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:06:05.306853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071023269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":4977,"num_write":1244,"num_write_kb":20718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.2b","version":"38'2071","reported_seq":4667,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.535990+0000","last_change":"2023-10-25T23:44:32.547709+0000","last_active":"2023-10-25T23:44:32.535990+0000","last_peered":"2023-10-25T23:44:32.535990+0000","last_clean":"2023-10-25T23:44:32.535990+0000","last_became_active":"2023-10-25T23:36:09.285610+0000","last_became_peered":"2023-10-25T23:36:09.285610+0000","last_unstale":"2023-10-25T23:44:32.535990+0000","last_undegraded":"2023-10-25T23:44:32.535990+0000","last_fullsized":"2023-10-25T23:44:32.535990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:39:45.667730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.134268367,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":4129,"num_write":1211,"num_write_kb":11664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.2c","version":"38'2126","reported_seq":4746,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.510974+0000","last_change":"2023-10-25T23:44:39.516069+0000","last_active":"2023-10-25T23:44:39.510974+0000","last_peered":"2023-10-25T23:44:39.510974+0000","last_clean":"2023-10-25T23:44:39.510974+0000","last_became_active":"2023-10-25T23:36:09.291566+0000","last_became_peered":"2023-10-25T23:36:09.291566+0000","last_unstale":"2023-10-25T23:44:39.510974+0000","last_undegraded":"2023-10-25T23:44:39.510974+0000","last_fullsized":"2023-10-25T23:44:39.510974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2126,"log_dups_size":0,"ondisk_log_size":2126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:10.561911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052820837000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":9012,"num_write":1282,"num_write_kb":25857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13917,"num_read_kb":527622,"num_write":78506,"num_write_kb":1459524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132701,"ondisk_log_size":132701,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":883576319,"num_objects":563,"num_object_clones":0,"num_object_copies":1126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":563,"num_whiteouts":0,"num_read":737,"num_read_kb":4867,"num_write":13233,"num_write_kb":3081677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":344,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1768792064,"data_stored":1768728153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13665,"ondisk_log_size":13665,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574957,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":431156,"kb_used_data":295912,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":93940684,"statfs":{"total":96636764160,"available":96195260416,"internally_reserved":0,"allocated":303013888,"data_stored":302765950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":138475979},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.72999999999999998,"15min":0.59599999999999997},"min":{"1min":0.26800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.67100000000000004,"5min":34.116999999999997,"15min":34.116999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.50600000000000001},"min":{"1min":0.317,"5min":0.222,"15min":0.222},"max":{"1min":0.73899999999999999,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.65400000000000003}]},{"osd":1,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.76400000000000001,"15min":0.61399999999999999},"min":{"1min":0.29599999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65200000000000002,"5min":34.424999999999997,"15min":34.424999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.77300000000000002,"15min":0.62},"min":{"1min":0.35099999999999998,"5min":0.29599999999999999,"15min":0.28100000000000003},"max":{"1min":0.79900000000000004,"5min":32.781999999999996,"15min":32.781999999999996},"last":0.69799999999999995}]},{"osd":2,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48499999999999999,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60599999999999998,"5min":1.964,"15min":1.964},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.79200000000000004,"15min":0.63900000000000001},"min":{"1min":0.34399999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76600000000000001,"5min":34.066000000000003,"15min":34.066000000000003},"last":0.56999999999999995}]},{"osd":3,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.94899999999999995,"15min":0.68400000000000005},"min":{"1min":0.40699999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.622,"5min":50.606999999999999,"15min":50.606999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.89900000000000002,"15min":0.68899999999999995},"min":{"1min":0.41199999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.89200000000000002,"5min":41.027999999999999,"15min":41.027999999999999},"last":0.58899999999999997}]},{"osd":4,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.72999999999999998,"15min":0.55500000000000005},"min":{"1min":0.33400000000000002,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.82499999999999996,"5min":28,"15min":28},"last":0.437},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.76000000000000001,"15min":0.59799999999999998},"min":{"1min":0.46899999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.177,"5min":28.25,"15min":28.25},"last":0.45600000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.84499999999999997,"15min":0.63400000000000001},"min":{"1min":0.437,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.79200000000000004,"5min":34.393000000000001,"15min":34.393000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64200000000000002,"15min":0.58299999999999996},"min":{"1min":0.40500000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84499999999999997,"5min":10.099,"15min":10.099},"last":0.374}]},{"osd":6,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.72999999999999998,"15min":0.621},"min":{"1min":0.45100000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.97999999999999998,"5min":18.271999999999998,"15min":18.271999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.98599999999999999,"15min":0.71599999999999997},"min":{"1min":0.53200000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.369,"5min":47.531999999999996,"15min":47.531999999999996},"last":0.41899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574956,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":357980,"kb_used_data":246356,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94013860,"statfs":{"total":96636764160,"available":96270192640,"internally_reserved":0,"allocated":252268544,"data_stored":252003915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":114293191},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45000000000000001,"15min":0.51200000000000001},"min":{"1min":0.26400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.623,"5min":3.3140000000000001,"15min":3.3140000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.35499999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56599999999999995,"5min":11.619,"15min":11.619},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.5,"15min":0.53600000000000003},"min":{"1min":0.27500000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68899999999999995,"5min":3.468,"15min":3.468},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.56000000000000005},"min":{"1min":0.30599999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.64600000000000002,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.61199999999999999,"15min":0.57399999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":6.327,"5min":11.683999999999999,"15min":11.683999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.58899999999999997,"15min":0.55800000000000005},"min":{"1min":0.32800000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81399999999999995,"5min":11.784000000000001,"15min":11.784000000000001},"last":0.58399999999999996}]},{"osd":3,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":1.071,"15min":0.77300000000000002},"min":{"1min":0.33900000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84499999999999997,"5min":61.121000000000002,"15min":61.121000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.36499999999999999},"max":{"1min":0.80000000000000004,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.60199999999999998}]},{"osd":4,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60299999999999998,"15min":0.54400000000000004},"min":{"1min":0.35099999999999998,"5min":0.27600000000000002,"15min":0.23200000000000001},"max":{"1min":0.91900000000000004,"5min":12.169,"15min":12.169},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.623,"15min":0.57699999999999996},"min":{"1min":0.44700000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85699999999999998,"5min":11.554,"15min":11.554},"last":0.628}]},{"osd":5,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.62,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.26100000000000001,"15min":0.245},"max":{"1min":0.77600000000000002,"5min":11.755000000000001,"15min":11.755000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.40300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.89000000000000001,"5min":3.2879999999999998,"15min":3.2879999999999998},"last":0.65200000000000002}]},{"osd":7,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.96099999999999997,"15min":0.71599999999999997},"min":{"1min":0.48099999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89500000000000002,"5min":29.977,"15min":29.977},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.97299999999999998,"15min":0.71599999999999997},"min":{"1min":0.42399999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.874,"5min":29.925000000000001,"15min":29.925000000000001},"last":0.63800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361852,"kb_used_data":254384,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94009988,"statfs":{"total":96636764160,"available":96266227712,"internally_reserved":0,"allocated":260489216,"data_stored":260237011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.378,"15min":0.36699999999999999},"min":{"1min":0.17799999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.44600000000000001,"5min":4.2839999999999998,"15min":6.9370000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.94999999999999996,"15min":0.54900000000000004},"min":{"1min":0.22,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.48199999999999998,"5min":66.522000000000006,"15min":66.522000000000006},"last":0.28399999999999997}]},{"osd":2,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35299999999999998,"15min":0.34799999999999998},"min":{"1min":0.23999999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53200000000000003,"5min":4.9180000000000001,"15min":4.9180000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41199999999999998,"15min":0.39000000000000001},"min":{"1min":0.247,"5min":0.186,"15min":0.186},"max":{"1min":0.54900000000000004,"5min":4.2060000000000004,"15min":4.2060000000000004},"last":0.25900000000000001}]},{"osd":3,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.60399999999999998,"15min":0.46800000000000003},"min":{"1min":0.26900000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.56999999999999995,"5min":21.943000000000001,"15min":21.943000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.60199999999999998,"15min":0.47699999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.55800000000000005,"5min":23.300999999999998,"15min":23.300999999999998},"last":0.39400000000000002}]},{"osd":4,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.67700000000000005,"15min":0.57899999999999996},"min":{"1min":0.35099999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.94999999999999996,"5min":14.066000000000001,"15min":14.066000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.622,"15min":0.58199999999999996},"min":{"1min":0.44,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.89700000000000002,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":0.46400000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.33300000000000002},"max":{"1min":0.90500000000000003,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.39700000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82499999999999996,"5min":4.9960000000000004,"15min":9.7650000000000006},"last":0.44600000000000001}]},{"osd":6,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64600000000000002,"15min":0.60799999999999998},"min":{"1min":0.46999999999999997,"5min":0.313,"15min":0.313},"max":{"1min":0.83699999999999997,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.78200000000000003,"15min":0.65100000000000002},"min":{"1min":0.438,"5min":0.38400000000000001,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":21.876000000000001,"15min":21.876000000000001},"last":0.56899999999999995}]},{"osd":7,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93200000000000005,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.76100000000000001,"15min":0.65200000000000002},"min":{"1min":0.44,"5min":0.371,"15min":0.36399999999999999},"max":{"1min":1.6850000000000001,"5min":18.754999999999999,"15min":18.754999999999999},"last":0.505}]}]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":373948,"kb_used_data":230384,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":93997892,"statfs":{"total":96636764160,"available":96253841408,"internally_reserved":0,"allocated":235913216,"data_stored":235657142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.375,"15min":0.35899999999999999},"min":{"1min":0.26900000000000002,"5min":0.20200000000000001,"15min":0.17899999999999999},"max":{"1min":1.365,"5min":4.649,"15min":4.649},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39000000000000001,"15min":0.36399999999999999},"min":{"1min":0.23699999999999999,"5min":0.20499999999999999,"15min":0.19400000000000001},"max":{"1min":1.641,"5min":5.1589999999999998,"15min":5.1589999999999998},"last":0.51600000000000001}]},{"osd":2,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38200000000000001},"min":{"1min":0.23699999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.423,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.42899999999999999,"15min":0.40600000000000003},"min":{"1min":0.251,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53700000000000003,"5min":7.6870000000000003,"15min":7.6870000000000003},"last":0.57699999999999996}]},{"osd":3,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.435,"15min":0.39300000000000002},"min":{"1min":0.28000000000000003,"5min":0.23999999999999999,"15min":0.23899999999999999},"max":{"1min":2.0819999999999999,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.47299999999999998,"15min":0.442},"min":{"1min":0.313,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.954,"5min":5.0750000000000002,"15min":5.0750000000000002},"last":0.61799999999999999}]},{"osd":4,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.58099999999999996},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67100000000000004,"5min":5.9729999999999999,"15min":5.9729999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.62,"15min":0.58799999999999997},"min":{"1min":0.35299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.3769999999999998,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.77300000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63400000000000001,"15min":0.63200000000000001},"min":{"1min":0.438,"5min":0.375,"15min":0.32300000000000001},"max":{"1min":1.3939999999999999,"5min":5.1120000000000001,"15min":8.5169999999999995},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65000000000000002,"15min":0.60399999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.84199999999999997,"5min":6.0199999999999996,"15min":6.0199999999999996},"last":0.84699999999999998}]},{"osd":6,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.624,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.4369999999999998,"5min":4.9850000000000003,"15min":4.9850000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.32200000000000001},"max":{"1min":1.4510000000000001,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.79400000000000004}]},{"osd":7,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66200000000000003,"15min":0.66300000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84899999999999998,"5min":6.0720000000000001,"15min":8.4979999999999993},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.65100000000000002,"15min":0.60699999999999998},"min":{"1min":0.47499999999999998,"5min":0.374,"15min":0.374},"max":{"1min":2.411,"5min":4.883,"15min":4.883},"last":0.70199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574959,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188100,"kb_used_data":102840,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94183740,"statfs":{"total":96636764160,"available":96444149760,"internally_reserved":0,"allocated":105308160,"data_stored":105055525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.32600000000000001,"15min":0.82799999999999996},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.79600000000000004,"5min":2.7269999999999999,"15min":18.052},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.371},"min":{"1min":0.222,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.0389999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.311}]},{"osd":1,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33900000000000002,"15min":0.85199999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.82899999999999996,"5min":1.03,"15min":18.175000000000001},"last":0.247},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.64500000000000002},"min":{"1min":0.251,"5min":0.22900000000000001,"15min":0.22700000000000001},"max":{"1min":0.49299999999999999,"5min":0.50800000000000001,"15min":10.23},"last":0.35599999999999998}]},{"osd":3,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.35999999999999999,"15min":0.89200000000000002},"min":{"1min":0.24099999999999999,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":0.84699999999999998,"5min":0.97999999999999998,"15min":18.236000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.42499999999999999,"15min":0.92300000000000004},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":18.004999999999999},"last":0.34300000000000003}]},{"osd":4,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54600000000000004,"15min":0.76900000000000002},"min":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.32100000000000001},"max":{"1min":0.75700000000000001,"5min":1.2589999999999999,"15min":8.1839999999999993},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55500000000000005,"15min":0.58499999999999996},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.518,"5min":1.518,"15min":2.4580000000000002},"last":0.53500000000000003}]},{"osd":5,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54200000000000004,"15min":0.58799999999999997},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.31900000000000001},"max":{"1min":0.80200000000000005,"5min":0.85099999999999998,"15min":8.3520000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":1.075},"min":{"1min":0.38300000000000001,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.81100000000000005,"5min":1.4419999999999999,"15min":18.143999999999998},"last":0.69899999999999995}]},{"osd":6,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":1.1000000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.316},"max":{"1min":0.78100000000000003,"5min":1.012,"15min":18.206},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.77600000000000002},"min":{"1min":0.44,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86899999999999999,"5min":1.3240000000000001,"15min":7.0060000000000002},"last":0.70899999999999996}]},{"osd":7,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.84799999999999998,"5min":0.88100000000000001,"15min":2.3900000000000001},"last":0.747},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68700000000000006,"15min":1.145},"min":{"1min":0.41799999999999998,"5min":0.40500000000000003,"15min":0.39500000000000002},"max":{"1min":2.0339999999999998,"5min":7.9850000000000003,"15min":18.109999999999999},"last":0.75600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574957,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312500,"kb_used_data":182824,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94059340,"statfs":{"total":96636764160,"available":96316764160,"internally_reserved":0,"allocated":187211776,"data_stored":186956203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":132774344},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.435,"15min":0.376},"min":{"1min":0.23999999999999999,"5min":0.17899999999999999,"15min":0.17799999999999999},"max":{"1min":0.65400000000000003,"5min":5.9560000000000004,"15min":5.9560000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.311,"5min":0.89400000000000002,"15min":0.54200000000000004},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.65400000000000003,"5min":55.152999999999999,"15min":55.152999999999999},"last":0.47899999999999998}]},{"osd":1,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.36599999999999999},"min":{"1min":0.217,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.294,"5min":2.323,"15min":2.323},"last":0.501},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.52200000000000002,"15min":0.438},"min":{"1min":0.33800000000000002,"5min":0.245,"15min":0.24399999999999999},"max":{"1min":0.624,"5min":6.0609999999999999,"15min":6.0609999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.46500000000000002,"15min":0.44},"min":{"1min":0.31900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59999999999999998,"5min":4.6840000000000002,"15min":4.6840000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.83699999999999997,"15min":0.55100000000000005},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.3260000000000001,"5min":40.789000000000001,"15min":40.789000000000001},"last":0.55000000000000004}]},{"osd":4,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.1319999999999999,"15min":0.77700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33000000000000002},"max":{"1min":1.1719999999999999,"5min":58.180999999999997,"15min":58.180999999999997},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.629,"15min":0.58199999999999996},"min":{"1min":0.39200000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.94799999999999995,"5min":4.6509999999999998,"15min":4.6509999999999998},"last":0.69999999999999996}]},{"osd":5,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":1.1990000000000001,"15min":0.80000000000000004},"min":{"1min":0.38500000000000001,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":1.21,"5min":60.893999999999998,"15min":60.893999999999998},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66800000000000004,"15min":0.61299999999999999},"min":{"1min":0.43099999999999999,"5min":0.38300000000000001,"15min":0.378},"max":{"1min":1.3540000000000001,"5min":4.2489999999999997,"15min":4.2489999999999997},"last":0.76700000000000002}]},{"osd":6,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.385,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.71399999999999997,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.91800000000000004,"5min":6.1790000000000003,"15min":6.1790000000000003},"last":0.79900000000000004}]},{"osd":7,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.98699999999999999,"15min":0.74299999999999999},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88,"5min":33.006999999999998,"15min":33.006999999999998},"last":0.748},{"interface":"front","average":{"1min":0.60899999999999999,"5min":1.175,"15min":0.80600000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":1.2509999999999999,"5min":56.667999999999999,"15min":56.667999999999999},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574957,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":343192,"kb_used_data":209352,"kb_used_omap":1,"kb_used_meta":133822,"kb_avail":94028648,"statfs":{"total":96636764160,"available":96285335552,"internally_reserved":0,"allocated":214376448,"data_stored":214112441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":137034182},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.495,"15min":0.89600000000000002},"min":{"1min":0.28799999999999998,"5min":0.26300000000000001,"15min":0.23999999999999999},"max":{"1min":3.0310000000000001,"5min":3.306,"15min":32.487000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45300000000000001,"15min":0.51300000000000001},"min":{"1min":0.24399999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.65500000000000003,"5min":1.05,"15min":6.0670000000000002},"last":0.53700000000000003}]},{"osd":1,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.73399999999999999,"15min":0.71499999999999997},"min":{"1min":0.27400000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.66800000000000004,"5min":23.579000000000001,"15min":32.417000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.83099999999999996,"15min":0.96399999999999997},"min":{"1min":0.33100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.70399999999999996,"5min":22.800000000000001,"15min":22.800000000000001},"last":0.36699999999999999}]},{"osd":2,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.60199999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":0.745,"5min":2.6779999999999999,"15min":14.757999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.72199999999999998,"15min":0.65900000000000003},"min":{"1min":0.35299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.72399999999999998,"5min":18.042999999999999,"15min":18.042999999999999},"last":0.56799999999999995}]},{"osd":3,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57699999999999996,"15min":0.73399999999999999},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66900000000000004,"5min":6.1360000000000001,"15min":55.222000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57399999999999995,"15min":0.64000000000000001},"min":{"1min":0.39100000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80600000000000005,"5min":6.3220000000000001,"15min":14.869999999999999},"last":0.39500000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.50800000000000001,"15min":0.56899999999999995},"min":{"1min":0.33300000000000002,"5min":0.26600000000000001,"15min":0.23699999999999999},"max":{"1min":0.77500000000000002,"5min":1.466,"15min":6.508},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.62},"min":{"1min":0.40799999999999997,"5min":0.26500000000000001,"15min":0.24199999999999999},"max":{"1min":0.72899999999999998,"5min":2.403,"15min":6.5270000000000001},"last":0.498}]},{"osd":6,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.497,"15min":0.60399999999999998},"min":{"1min":0.36699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83599999999999997,"5min":0.89100000000000001,"15min":14.805999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.52000000000000002,"15min":0.58799999999999997},"min":{"1min":0.45600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48399999999999999}]},{"osd":7,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.67600000000000005,"15min":0.63500000000000001},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.79100000000000004,"5min":12.135999999999999,"15min":12.135999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.81299999999999994,"15min":0.74099999999999999},"min":{"1min":0.45700000000000002,"5min":0.33300000000000002,"15min":0.29699999999999999},"max":{"1min":0.86199999999999999,"5min":21.465,"15min":21.465},"last":0.58099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574957,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339528,"kb_used_data":209852,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94032312,"statfs":{"total":96636764160,"available":96289087488,"internally_reserved":0,"allocated":214888448,"data_stored":214639791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132774342},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.88900000000000001,"15min":0.65900000000000003},"min":{"1min":0.30499999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.63600000000000001,"5min":48.045999999999999,"15min":48.045999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48599999999999999,"15min":0.52400000000000002},"min":{"1min":0.28899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60199999999999998,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.64700000000000002}]},{"osd":1,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65100000000000002,"5min":3.8959999999999999,"15min":3.8959999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.501,"5min":0.47499999999999998,"15min":0.54900000000000004},"min":{"1min":0.28999999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.755},"last":0.80600000000000005}]},{"osd":2,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.58499999999999996,"15min":0.56399999999999995},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59199999999999997,"5min":13.271000000000001,"15min":13.271000000000001},"last":0.749},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.35899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63500000000000001,"5min":7.141,"15min":7.141},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.93000000000000005,"15min":0.68999999999999995},"min":{"1min":0.33600000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.78200000000000003,"5min":47.875999999999998,"15min":47.875999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.66500000000000004,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.71199999999999997}]},{"osd":4,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51300000000000001,"15min":0.498},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66700000000000004,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.38200000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.74199999999999999,"5min":2.657,"15min":2.657},"last":0.52600000000000002}]},{"osd":6,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57699999999999996,"15min":0.54100000000000004},"min":{"1min":0.374,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82299999999999995,"5min":6.9050000000000002,"15min":6.9050000000000002},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59199999999999997,"15min":0.55400000000000005},"min":{"1min":0.442,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70699999999999996,"5min":5.9770000000000003,"15min":5.9770000000000003},"last":0.61299999999999999}]},{"osd":7,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56899999999999995,"15min":0.55800000000000005},"min":{"1min":0.44700000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80200000000000005,"5min":3.8530000000000002,"15min":3.8530000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.49399999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76700000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.79200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":234893312,"data_stored":234881662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":260059136,"data_stored":260051894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":104857600,"data_stored":104857600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":186781696,"data_stored":186771086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":213925888,"data_stored":213914516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":214462464,"data_stored":214454679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":251817984,"data_stored":251806246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":301993984,"data_stored":301990470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-25T23:44:41.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T23:44:41.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.902+0000 7f26ba9dc700 1 -- 172.21.15.81:0/3684738158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f269c004d90 msgr2=0x7f269c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:41.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.902+0000 7f26ba9dc700 1 --2- 172.21.15.81:0/3684738158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f269c004d90 0x7f269c005210 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00c680 tx=0x7f269c005880 comp rx=0 tx=0).stop 2023-10-25T23:44:41.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.902+0000 7f26b8f79700 1 -- 172.21.15.81:0/3684738158 reap_dead start 2023-10-25T23:44:41.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.902+0000 7f26ba9dc700 1 -- 172.21.15.81:0/3684738158 shutdown_connections 2023-10-25T23:44:41.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.902+0000 7f26ba9dc700 1 -- 172.21.15.81:0/3684738158 >> 172.21.15.81:0/3684738158 conn(0x7f26b40c0a40 msgr2=0x7f26b40c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:41.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.903+0000 7f26ba9dc700 1 -- 172.21.15.81:0/3684738158 shutdown_connections 2023-10-25T23:44:41.907 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.903+0000 7f26ba9dc700 1 -- 172.21.15.81:0/3684738158 wait complete. 2023-10-25T23:44:41.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.904+0000 7f26ba9dc700 1 Processor -- start 2023-10-25T23:44:41.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.904+0000 7f26ba9dc700 1 -- start start 2023-10-25T23:44:41.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.904+0000 7f26ba9dc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26b414dbe0 0x7f26b41e1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:41.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.904+0000 7f26ba9dc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b41489a0 0x7f26b40ba160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:41.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.904+0000 7f26ba9dc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26b40ba6a0 0x7f26b4130d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:41.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.904+0000 7f26ba9dc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b41d6500 con 0x7f26b41489a0 2023-10-25T23:44:41.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.904+0000 7f26ba9dc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b41e5150 con 0x7f26b414dbe0 2023-10-25T23:44:41.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.904+0000 7f26ba9dc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b41e1330 con 0x7f26b40ba6a0 2023-10-25T23:44:41.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.905+0000 7f26b37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b41489a0 0x7f26b40ba160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:41.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.905+0000 7f26b37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b41489a0 0x7f26b40ba160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37072/0 (socket says 172.21.15.81:37072) 2023-10-25T23:44:41.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.905+0000 7f26b37fe700 1 -- 172.21.15.81:0/2174669473 learned_addr learned my addr 172.21.15.81:0/2174669473 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:41.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.905+0000 7f26b3fff700 1 --2- 172.21.15.81:0/2174669473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26b414dbe0 0x7f26b41e1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:41.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.905+0000 7f26b8f79700 1 --2- 172.21.15.81:0/2174669473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26b40ba6a0 0x7f26b4130d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:41.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.905+0000 7f26b37fe700 1 -- 172.21.15.81:0/2174669473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26b40ba6a0 msgr2=0x7f26b4130d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:41.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.905+0000 7f26b37fe700 1 --2- 172.21.15.81:0/2174669473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26b40ba6a0 0x7f26b4130d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:41.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.905+0000 7f26b37fe700 1 -- 172.21.15.81:0/2174669473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26b414dbe0 msgr2=0x7f26b41e1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:41.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.905+0000 7f26b37fe700 1 --2- 172.21.15.81:0/2174669473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26b414dbe0 0x7f26b41e1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:41.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.905+0000 7f26b37fe700 1 -- 172.21.15.81:0/2174669473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b41e5340 con 0x7f26b41489a0 2023-10-25T23:44:41.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.905+0000 7f26b37fe700 1 --2- 172.21.15.81:0/2174669473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b41489a0 0x7f26b40ba160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f26a4005d90 tx=0x7f26a400e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.905+0000 7f26b0ff9700 1 -- 172.21.15.81:0/2174669473 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4016070 con 0x7f26b41489a0 2023-10-25T23:44:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.905+0000 7f26b0ff9700 1 -- 172.21.15.81:0/2174669473 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f26a401a410 con 0x7f26b41489a0 2023-10-25T23:44:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.905+0000 7f26ba9dc700 1 -- 172.21.15.81:0/2174669473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b41d5fa0 con 0x7f26b41489a0 2023-10-25T23:44:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.905+0000 7f26b0ff9700 1 -- 172.21.15.81:0/2174669473 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a401a820 con 0x7f26b41489a0 2023-10-25T23:44:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.905+0000 7f26ba9dc700 1 -- 172.21.15.81:0/2174669473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b40b8f90 con 0x7f26b41489a0 2023-10-25T23:44:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.906+0000 7f26ba9dc700 1 -- 172.21.15.81:0/2174669473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b41e1810 con 0x7f26b41489a0 2023-10-25T23:44:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.907+0000 7f26b0ff9700 1 -- 172.21.15.81:0/2174669473 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f26a401a980 con 0x7f26b41489a0 2023-10-25T23:44:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.907+0000 7f26b0ff9700 1 --2- 172.21.15.81:0/2174669473 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f26a006af00 0x7f26a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.907+0000 7f26b0ff9700 1 -- 172.21.15.81:0/2174669473 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f26a408bf40 con 0x7f26b41489a0 2023-10-25T23:44:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.907+0000 7f26b3fff700 1 --2- 172.21.15.81:0/2174669473 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f26a006af00 0x7f26a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:41.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.908+0000 7f26b3fff700 1 --2- 172.21.15.81:0/2174669473 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f26a006af00 0x7f26a006d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f26a8009d60 tx=0x7f26a8009260 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:41.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:41.912+0000 7f26b0ff9700 1 -- 172.21.15.81:0/2174669473 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f26b41e1810 con 0x7f26b41489a0 2023-10-25T23:44:42.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.096+0000 7f26ba9dc700 1 -- 172.21.15.81:0/2174669473 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26b414f160 con 0x7f26a006af00 2023-10-25T23:44:42.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.105+0000 7f26b0ff9700 1 -- 172.21.15.81:0/2174669473 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+294571 (secure 0 0 0) 0x7f26a80099b0 con 0x7f26a006af00 2023-10-25T23:44:42.110 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:44:42.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.108+0000 7f26ba9dc700 1 -- 172.21.15.81:0/2174669473 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f26a006af00 msgr2=0x7f26a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:42.113 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.108+0000 7f26ba9dc700 1 --2- 172.21.15.81:0/2174669473 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f26a006af00 0x7f26a006d3c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f26a8009d60 tx=0x7f26a8009260 comp rx=0 tx=0).stop 2023-10-25T23:44:42.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.108+0000 7f26ba9dc700 1 -- 172.21.15.81:0/2174669473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b41489a0 msgr2=0x7f26b40ba160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:42.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.108+0000 7f26ba9dc700 1 --2- 172.21.15.81:0/2174669473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b41489a0 0x7f26b40ba160 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f26a4005d90 tx=0x7f26a400e690 comp rx=0 tx=0).stop 2023-10-25T23:44:42.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.108+0000 7f26ba9dc700 1 -- 172.21.15.81:0/2174669473 shutdown_connections 2023-10-25T23:44:42.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.108+0000 7f26ba9dc700 1 --2- 172.21.15.81:0/2174669473 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f26b40ba6a0 0x7f26b4130d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.108+0000 7f26ba9dc700 1 --2- 172.21.15.81:0/2174669473 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f26a006af00 0x7f26a006d3c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.108+0000 7f26ba9dc700 1 --2- 172.21.15.81:0/2174669473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26b414dbe0 0x7f26b41e1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.108+0000 7f26ba9dc700 1 --2- 172.21.15.81:0/2174669473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b41489a0 0x7f26b40ba160 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.108+0000 7f26ba9dc700 1 -- 172.21.15.81:0/2174669473 >> 172.21.15.81:0/2174669473 conn(0x7f26b40c0a40 msgr2=0x7f26b4133630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:42.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.108+0000 7f26ba9dc700 1 -- 172.21.15.81:0/2174669473 shutdown_connections 2023-10-25T23:44:42.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.108+0000 7f26ba9dc700 1 -- 172.21.15.81:0/2174669473 wait complete. 2023-10-25T23:44:42.116 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-25T23:44:42.122 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2023-10-25T23:44:41.119193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":884166692,"num_objects":566,"num_object_clones":0,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":566,"num_whiteouts":0,"num_read":14770,"num_read_kb":532589,"num_write":91898,"num_write_kb":4543617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":344,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146483,"ondisk_log_size":146483,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2708256,"kb_used_data":1731904,"kb_used_omap":12,"kb_used_meta":976243,"kb_avail":752266464,"statfs":{"total":773094113280,"available":770320859136,"internally_reserved":0,"allocated":1773469696,"data_stored":1771427978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":999673400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":860297,"num_objects":-95,"num_object_clones":-1,"num_object_copies":-190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-95,"num_whiteouts":0,"num_read":6,"num_read_kb":11,"num_write":141,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002745"},"pg_stats":[{"pgid":"3.3f","version":"38'1937","reported_seq":4535,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.553058+0000","last_change":"2023-10-25T23:44:32.561696+0000","last_active":"2023-10-25T23:44:32.553058+0000","last_peered":"2023-10-25T23:44:32.553058+0000","last_clean":"2023-10-25T23:44:32.553058+0000","last_became_active":"2023-10-25T23:36:09.292007+0000","last_became_peered":"2023-10-25T23:36:09.292007+0000","last_unstale":"2023-10-25T23:44:32.553058+0000","last_undegraded":"2023-10-25T23:44:32.553058+0000","last_fullsized":"2023-10-25T23:44:32.553058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1937,"log_dups_size":0,"ondisk_log_size":1937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:57:06.053396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14653339800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":3053,"num_write":1182,"num_write_kb":17288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.3e","version":"38'1934","reported_seq":4549,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.490809+0000","last_change":"2023-10-25T23:44:32.496598+0000","last_active":"2023-10-25T23:44:32.490809+0000","last_peered":"2023-10-25T23:44:32.490809+0000","last_clean":"2023-10-25T23:44:32.490809+0000","last_became_active":"2023-10-25T23:36:09.281890+0000","last_became_peered":"2023-10-25T23:36:09.281890+0000","last_unstale":"2023-10-25T23:44:32.490809+0000","last_undegraded":"2023-10-25T23:44:32.490809+0000","last_fullsized":"2023-10-25T23:44:32.490809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1934,"log_dups_size":0,"ondisk_log_size":1934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:22:19.658935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069104454999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":12821,"num_write":1152,"num_write_kb":16010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.3d","version":"38'2031","reported_seq":4609,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.561421+0000","last_change":"2023-10-25T23:44:32.578547+0000","last_active":"2023-10-25T23:44:32.561421+0000","last_peered":"2023-10-25T23:44:32.561421+0000","last_clean":"2023-10-25T23:44:32.561421+0000","last_became_active":"2023-10-25T23:36:09.284066+0000","last_became_peered":"2023-10-25T23:36:09.284066+0000","last_unstale":"2023-10-25T23:44:32.561421+0000","last_undegraded":"2023-10-25T23:44:32.561421+0000","last_fullsized":"2023-10-25T23:44:32.561421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:55:32.290039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.164461575,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":12209,"num_write":1200,"num_write_kb":24347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.3c","version":"38'2078","reported_seq":4756,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.488901+0000","last_change":"2023-10-25T23:44:32.499536+0000","last_active":"2023-10-25T23:44:32.488901+0000","last_peered":"2023-10-25T23:44:32.488901+0000","last_clean":"2023-10-25T23:44:32.488901+0000","last_became_active":"2023-10-25T23:36:09.299585+0000","last_became_peered":"2023-10-25T23:36:09.299585+0000","last_unstale":"2023-10-25T23:44:32.488901+0000","last_undegraded":"2023-10-25T23:44:32.488901+0000","last_fullsized":"2023-10-25T23:44:32.488901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2078,"log_dups_size":0,"ondisk_log_size":2078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:20:50.930557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104514565,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":4442,"num_write":1222,"num_write_kb":17071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.3b","version":"37'2218","reported_seq":4794,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.498046+0000","last_change":"2023-10-25T23:44:32.507952+0000","last_active":"2023-10-25T23:44:32.498046+0000","last_peered":"2023-10-25T23:44:32.498046+0000","last_clean":"2023-10-25T23:44:32.498046+0000","last_became_active":"2023-10-25T23:36:09.287403+0000","last_became_peered":"2023-10-25T23:36:09.287403+0000","last_unstale":"2023-10-25T23:44:32.498046+0000","last_undegraded":"2023-10-25T23:44:32.498046+0000","last_fullsized":"2023-10-25T23:44:32.498046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2218,"log_dups_size":0,"ondisk_log_size":2218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:10:34.048013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.096586196999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":4323,"num_write":1325,"num_write_kb":21852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.3a","version":"38'1924","reported_seq":4534,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.465554+0000","last_change":"2023-10-25T23:44:32.477919+0000","last_active":"2023-10-25T23:44:32.465554+0000","last_peered":"2023-10-25T23:44:32.465554+0000","last_clean":"2023-10-25T23:44:32.465554+0000","last_became_active":"2023-10-25T23:36:09.301305+0000","last_became_peered":"2023-10-25T23:36:09.301305+0000","last_unstale":"2023-10-25T23:44:32.465554+0000","last_undegraded":"2023-10-25T23:44:32.465554+0000","last_fullsized":"2023-10-25T23:44:32.465554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1924,"log_dups_size":0,"ondisk_log_size":1924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:31:23.915991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.083247637999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":4600,"num_write":1162,"num_write_kb":16604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.39","version":"37'2100","reported_seq":4681,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.543812+0000","last_change":"2023-10-25T23:44:32.553007+0000","last_active":"2023-10-25T23:44:32.543812+0000","last_peered":"2023-10-25T23:44:32.543812+0000","last_clean":"2023-10-25T23:44:32.543812+0000","last_became_active":"2023-10-25T23:36:09.293173+0000","last_became_peered":"2023-10-25T23:36:09.293173+0000","last_unstale":"2023-10-25T23:44:32.543812+0000","last_undegraded":"2023-10-25T23:44:32.543812+0000","last_fullsized":"2023-10-25T23:44:32.543812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:07:11.314981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.141433051,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":4028,"num_write":1252,"num_write_kb":24067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.38","version":"37'1943","reported_seq":4557,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.523048+0000","last_change":"2023-10-25T23:44:32.533836+0000","last_active":"2023-10-25T23:44:32.523048+0000","last_peered":"2023-10-25T23:44:32.523048+0000","last_clean":"2023-10-25T23:44:32.523048+0000","last_became_active":"2023-10-25T23:36:09.295518+0000","last_became_peered":"2023-10-25T23:36:09.295518+0000","last_unstale":"2023-10-25T23:44:32.523048+0000","last_undegraded":"2023-10-25T23:44:32.523048+0000","last_fullsized":"2023-10-25T23:44:32.523048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:31:23.915991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12500524399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":4005,"num_write":1156,"num_write_kb":40374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.37","version":"38'2130","reported_seq":4731,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.543773+0000","last_change":"2023-10-25T23:44:32.552979+0000","last_active":"2023-10-25T23:44:32.543773+0000","last_peered":"2023-10-25T23:44:32.543773+0000","last_clean":"2023-10-25T23:44:32.543773+0000","last_became_active":"2023-10-25T23:36:09.297036+0000","last_became_peered":"2023-10-25T23:36:09.297036+0000","last_unstale":"2023-10-25T23:44:32.543773+0000","last_undegraded":"2023-10-25T23:44:32.543773+0000","last_fullsized":"2023-10-25T23:44:32.543773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2130,"log_dups_size":0,"ondisk_log_size":2130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:09:03.392402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13789567699999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":8236,"num_write":1280,"num_write_kb":21230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.36","version":"38'1975","reported_seq":4589,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.511036+0000","last_change":"2023-10-25T23:44:39.516062+0000","last_active":"2023-10-25T23:44:39.511036+0000","last_peered":"2023-10-25T23:44:39.511036+0000","last_clean":"2023-10-25T23:44:39.511036+0000","last_became_active":"2023-10-25T23:36:09.297713+0000","last_became_peered":"2023-10-25T23:36:09.297713+0000","last_unstale":"2023-10-25T23:44:39.511036+0000","last_undegraded":"2023-10-25T23:44:39.511036+0000","last_fullsized":"2023-10-25T23:44:39.511036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:15:18.383242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052261503000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":4128,"num_write":1151,"num_write_kb":8179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.35","version":"38'2156","reported_seq":4751,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.516150+0000","last_change":"2023-10-25T23:44:39.519698+0000","last_active":"2023-10-25T23:44:39.516150+0000","last_peered":"2023-10-25T23:44:39.516150+0000","last_clean":"2023-10-25T23:44:39.516150+0000","last_became_active":"2023-10-25T23:36:50.071605+0000","last_became_peered":"2023-10-25T23:36:50.071605+0000","last_unstale":"2023-10-25T23:44:39.516150+0000","last_undegraded":"2023-10-25T23:44:39.516150+0000","last_fullsized":"2023-10-25T23:44:39.516150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2156,"log_dups_size":0,"ondisk_log_size":2156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:06.976880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056199102000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":4889,"num_write":1231,"num_write_kb":19417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.34","version":"38'2098","reported_seq":4702,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.965924+0000","last_change":"2023-10-25T23:44:38.977002+0000","last_active":"2023-10-25T23:44:38.965924+0000","last_peered":"2023-10-25T23:44:38.965924+0000","last_clean":"2023-10-25T23:44:38.965924+0000","last_became_active":"2023-10-25T23:36:09.291351+0000","last_became_peered":"2023-10-25T23:36:09.291351+0000","last_unstale":"2023-10-25T23:44:38.965924+0000","last_undegraded":"2023-10-25T23:44:38.965924+0000","last_fullsized":"2023-10-25T23:44:38.965924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2098,"log_dups_size":0,"ondisk_log_size":2098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:56:29.776633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104157445,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":4997,"num_write":1220,"num_write_kb":33278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.33","version":"38'2031","reported_seq":4624,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.544814+0000","last_change":"2023-10-25T23:44:32.558944+0000","last_active":"2023-10-25T23:44:32.544814+0000","last_peered":"2023-10-25T23:44:32.544814+0000","last_clean":"2023-10-25T23:44:32.544814+0000","last_became_active":"2023-10-25T23:36:09.289895+0000","last_became_peered":"2023-10-25T23:36:09.289895+0000","last_unstale":"2023-10-25T23:44:32.544814+0000","last_undegraded":"2023-10-25T23:44:32.544814+0000","last_fullsized":"2023-10-25T23:44:32.544814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:10:34.048013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14974707600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":8364,"num_write":1160,"num_write_kb":24700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.32","version":"38'2055","reported_seq":4664,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.535407+0000","last_change":"2023-10-25T23:44:32.546559+0000","last_active":"2023-10-25T23:44:32.535407+0000","last_peered":"2023-10-25T23:44:32.535407+0000","last_clean":"2023-10-25T23:44:32.535407+0000","last_became_active":"2023-10-25T23:36:09.283250+0000","last_became_peered":"2023-10-25T23:36:09.283250+0000","last_unstale":"2023-10-25T23:44:32.535407+0000","last_undegraded":"2023-10-25T23:44:32.535407+0000","last_fullsized":"2023-10-25T23:44:32.535407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:56:24.250407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13307770899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":4523,"num_write":1222,"num_write_kb":24181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.31","version":"37'2096","reported_seq":4691,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.466308+0000","last_change":"2023-10-25T23:44:32.474468+0000","last_active":"2023-10-25T23:44:32.466308+0000","last_peered":"2023-10-25T23:44:32.466308+0000","last_clean":"2023-10-25T23:44:32.466308+0000","last_became_active":"2023-10-25T23:36:09.286191+0000","last_became_peered":"2023-10-25T23:36:09.286191+0000","last_unstale":"2023-10-25T23:44:32.466308+0000","last_undegraded":"2023-10-25T23:44:32.466308+0000","last_fullsized":"2023-10-25T23:44:32.466308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2096,"log_dups_size":0,"ondisk_log_size":2096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:44:40.385223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055128609000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":4088,"num_write":1280,"num_write_kb":29409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.30","version":"38'2065","reported_seq":4671,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.467034+0000","last_change":"2023-10-25T23:44:32.467034+0000","last_active":"2023-10-25T23:44:32.467034+0000","last_peered":"2023-10-25T23:44:32.467034+0000","last_clean":"2023-10-25T23:44:32.467034+0000","last_became_active":"2023-10-25T23:36:09.301040+0000","last_became_peered":"2023-10-25T23:36:09.301040+0000","last_unstale":"2023-10-25T23:44:32.467034+0000","last_undegraded":"2023-10-25T23:44:32.467034+0000","last_fullsized":"2023-10-25T23:44:32.467034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:14:14.520328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072495613,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":14548,"num_write":1224,"num_write_kb":47800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.2f","version":"38'2110","reported_seq":4750,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.901148+0000","last_change":"2023-10-25T23:44:38.906227+0000","last_active":"2023-10-25T23:44:38.901148+0000","last_peered":"2023-10-25T23:44:38.901148+0000","last_clean":"2023-10-25T23:44:38.901148+0000","last_became_active":"2023-10-25T23:36:50.103220+0000","last_became_peered":"2023-10-25T23:36:50.103220+0000","last_unstale":"2023-10-25T23:44:38.901148+0000","last_undegraded":"2023-10-25T23:44:38.901148+0000","last_fullsized":"2023-10-25T23:44:38.901148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2110,"log_dups_size":0,"ondisk_log_size":2110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:48:12.956766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033066291999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":8493,"num_write":1280,"num_write_kb":14868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.2e","version":"37'1999","reported_seq":4610,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.902731+0000","last_change":"2023-10-25T23:44:38.907165+0000","last_active":"2023-10-25T23:44:38.902731+0000","last_peered":"2023-10-25T23:44:38.902731+0000","last_clean":"2023-10-25T23:44:38.902731+0000","last_became_active":"2023-10-25T23:36:09.282282+0000","last_became_peered":"2023-10-25T23:36:09.282282+0000","last_unstale":"2023-10-25T23:44:38.902731+0000","last_undegraded":"2023-10-25T23:44:38.902731+0000","last_fullsized":"2023-10-25T23:44:38.902731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1999,"log_dups_size":0,"ondisk_log_size":1999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:37:04.361378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033856860000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":3064,"num_write":1152,"num_write_kb":24838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.2d","version":"38'2186","reported_seq":4774,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.508072+0000","last_change":"2023-10-25T23:44:32.524616+0000","last_active":"2023-10-25T23:44:32.508072+0000","last_peered":"2023-10-25T23:44:32.508072+0000","last_clean":"2023-10-25T23:44:32.508072+0000","last_became_active":"2023-10-25T23:36:09.289457+0000","last_became_peered":"2023-10-25T23:36:09.289457+0000","last_unstale":"2023-10-25T23:44:32.508072+0000","last_undegraded":"2023-10-25T23:44:32.508072+0000","last_fullsized":"2023-10-25T23:44:32.508072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2186,"log_dups_size":0,"ondisk_log_size":2186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:22:15.481808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.110731284,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":8808,"num_write":1334,"num_write_kb":38138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.1f","version":"38'365","reported_seq":398,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.416028+0000","last_change":"2023-10-25T23:36:08.271164+0000","last_active":"2023-10-25T23:44:32.416028+0000","last_peered":"2023-10-25T23:44:32.416028+0000","last_clean":"2023-10-25T23:44:32.416028+0000","last_became_active":"2023-10-25T23:36:08.270911+0000","last_became_peered":"2023-10-25T23:36:08.270911+0000","last_unstale":"2023-10-25T23:44:32.416028+0000","last_undegraded":"2023-10-25T23:44:32.416028+0000","last_fullsized":"2023-10-25T23:44:32.416028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33555014,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":323,"num_write_kb":78531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"37'1980","reported_seq":4553,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.544866+0000","last_change":"2023-10-25T23:44:32.558952+0000","last_active":"2023-10-25T23:44:32.544866+0000","last_peered":"2023-10-25T23:44:32.544866+0000","last_clean":"2023-10-25T23:44:32.544866+0000","last_became_active":"2023-10-25T23:36:09.290260+0000","last_became_peered":"2023-10-25T23:36:09.290260+0000","last_unstale":"2023-10-25T23:44:32.544866+0000","last_undegraded":"2023-10-25T23:44:32.544866+0000","last_fullsized":"2023-10-25T23:44:32.544866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:20:50.930557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14940374000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":3083,"num_write":1169,"num_write_kb":11022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.1e","version":"34'636","reported_seq":669,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:27.867853+0000","last_change":"2023-10-25T23:36:08.269993+0000","last_active":"2023-10-25T23:44:27.867853+0000","last_peered":"2023-10-25T23:44:27.867853+0000","last_clean":"2023-10-25T23:44:27.867853+0000","last_became_active":"2023-10-25T23:36:08.269443+0000","last_became_peered":"2023-10-25T23:36:08.269443+0000","last_unstale":"2023-10-25T23:44:27.867853+0000","last_undegraded":"2023-10-25T23:44:27.867853+0000","last_fullsized":"2023-10-25T23:44:27.867853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":598,"num_write_kb":86544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"38'1958","reported_seq":4573,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.561470+0000","last_change":"2023-10-25T23:44:32.578618+0000","last_active":"2023-10-25T23:44:32.561470+0000","last_peered":"2023-10-25T23:44:32.561470+0000","last_clean":"2023-10-25T23:44:32.561470+0000","last_became_active":"2023-10-25T23:36:09.299738+0000","last_became_peered":"2023-10-25T23:36:09.299738+0000","last_unstale":"2023-10-25T23:44:32.561470+0000","last_undegraded":"2023-10-25T23:44:32.561470+0000","last_fullsized":"2023-10-25T23:44:32.561470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1958,"log_dups_size":0,"ondisk_log_size":1958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:57:05.654538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.162662744,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":3695,"num_write":1175,"num_write_kb":20733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.1d","version":"36'607","reported_seq":639,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:27.996233+0000","last_change":"2023-10-25T23:36:08.273879+0000","last_active":"2023-10-25T23:44:27.996233+0000","last_peered":"2023-10-25T23:44:27.996233+0000","last_clean":"2023-10-25T23:44:27.996233+0000","last_became_active":"2023-10-25T23:36:08.273574+0000","last_became_peered":"2023-10-25T23:36:08.273574+0000","last_unstale":"2023-10-25T23:44:27.996233+0000","last_undegraded":"2023-10-25T23:44:27.996233+0000","last_fullsized":"2023-10-25T23:44:27.996233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:27.340205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":582,"num_write_kb":140942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"38'2150","reported_seq":4731,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.488850+0000","last_change":"2023-10-25T23:44:32.488850+0000","last_active":"2023-10-25T23:44:32.488850+0000","last_peered":"2023-10-25T23:44:32.488850+0000","last_clean":"2023-10-25T23:44:32.488850+0000","last_became_active":"2023-10-25T23:36:09.299916+0000","last_became_peered":"2023-10-25T23:36:09.299916+0000","last_unstale":"2023-10-25T23:44:32.488850+0000","last_undegraded":"2023-10-25T23:44:32.488850+0000","last_fullsized":"2023-10-25T23:44:32.488850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2150,"log_dups_size":0,"ondisk_log_size":2150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:43:16.830999+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.094041616999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":4255,"num_write":1272,"num_write_kb":13349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.1c","version":"36'393","reported_seq":425,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:27.995399+0000","last_change":"2023-10-25T23:36:08.271714+0000","last_active":"2023-10-25T23:44:27.995399+0000","last_peered":"2023-10-25T23:44:27.995399+0000","last_clean":"2023-10-25T23:44:27.995399+0000","last_became_active":"2023-10-25T23:36:08.271442+0000","last_became_peered":"2023-10-25T23:36:08.271442+0000","last_unstale":"2023-10-25T23:44:27.995399+0000","last_undegraded":"2023-10-25T23:44:27.995399+0000","last_fullsized":"2023-10-25T23:44:27.995399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":379,"num_write_kb":83039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"38'2004","reported_seq":4614,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.488957+0000","last_change":"2023-10-25T23:44:32.499523+0000","last_active":"2023-10-25T23:44:32.488957+0000","last_peered":"2023-10-25T23:44:32.488957+0000","last_clean":"2023-10-25T23:44:32.488957+0000","last_became_active":"2023-10-25T23:36:09.299130+0000","last_became_peered":"2023-10-25T23:36:09.299130+0000","last_unstale":"2023-10-25T23:44:32.488957+0000","last_undegraded":"2023-10-25T23:44:32.488957+0000","last_fullsized":"2023-10-25T23:44:32.488957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2004,"log_dups_size":0,"ondisk_log_size":2004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:58:37.312724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104430467,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":3649,"num_write":1196,"num_write_kb":32686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.1b","version":"37'452","reported_seq":484,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.487083+0000","last_change":"2023-10-25T23:36:08.271119+0000","last_active":"2023-10-25T23:44:28.487083+0000","last_peered":"2023-10-25T23:44:28.487083+0000","last_clean":"2023-10-25T23:44:28.487083+0000","last_became_active":"2023-10-25T23:36:08.270138+0000","last_became_peered":"2023-10-25T23:36:08.270138+0000","last_unstale":"2023-10-25T23:44:28.487083+0000","last_undegraded":"2023-10-25T23:44:28.487083+0000","last_fullsized":"2023-10-25T23:44:28.487083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":475,"num_write_kb":111638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"38'2147","reported_seq":4757,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.956082+0000","last_change":"2023-10-25T23:44:38.965871+0000","last_active":"2023-10-25T23:44:38.956082+0000","last_peered":"2023-10-25T23:44:38.956082+0000","last_clean":"2023-10-25T23:44:38.956082+0000","last_became_active":"2023-10-25T23:36:09.287455+0000","last_became_peered":"2023-10-25T23:36:09.287455+0000","last_unstale":"2023-10-25T23:44:38.956082+0000","last_undegraded":"2023-10-25T23:44:38.956082+0000","last_fullsized":"2023-10-25T23:44:38.956082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2147,"log_dups_size":0,"ondisk_log_size":2147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:18.862050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.093404585999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":5171,"num_write":1282,"num_write_kb":34019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.1a","version":"37'538","reported_seq":572,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.948030+0000","last_change":"2023-10-25T23:36:08.272686+0000","last_active":"2023-10-25T23:44:37.948030+0000","last_peered":"2023-10-25T23:44:37.948030+0000","last_clean":"2023-10-25T23:44:37.948030+0000","last_became_active":"2023-10-25T23:36:08.271974+0000","last_became_peered":"2023-10-25T23:36:08.271974+0000","last_unstale":"2023-10-25T23:44:37.948030+0000","last_undegraded":"2023-10-25T23:44:37.948030+0000","last_fullsized":"2023-10-25T23:44:37.948030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":503,"num_write_kb":90640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"38'2093","reported_seq":4662,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.578662+0000","last_change":"2023-10-25T23:44:32.588835+0000","last_active":"2023-10-25T23:44:32.578662+0000","last_peered":"2023-10-25T23:44:32.578662+0000","last_clean":"2023-10-25T23:44:32.578662+0000","last_became_active":"2023-10-25T23:36:09.294176+0000","last_became_peered":"2023-10-25T23:36:09.294176+0000","last_unstale":"2023-10-25T23:44:32.578662+0000","last_undegraded":"2023-10-25T23:44:32.578662+0000","last_fullsized":"2023-10-25T23:44:32.578662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2093,"log_dups_size":0,"ondisk_log_size":2093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:15:01.855063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17501277800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":27232,"num_write":1210,"num_write_kb":20727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.19","version":"37'246","reported_seq":278,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.178636+0000","last_change":"2023-10-25T23:36:08.273513+0000","last_active":"2023-10-25T23:44:32.178636+0000","last_peered":"2023-10-25T23:44:32.178636+0000","last_clean":"2023-10-25T23:44:32.178636+0000","last_became_active":"2023-10-25T23:36:08.273035+0000","last_became_peered":"2023-10-25T23:36:08.273035+0000","last_unstale":"2023-10-25T23:44:32.178636+0000","last_undegraded":"2023-10-25T23:44:32.178636+0000","last_fullsized":"2023-10-25T23:44:32.178636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:21:29.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18998254,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":221,"num_write_kb":78125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"38'2316","reported_seq":4888,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.522977+0000","last_change":"2023-10-25T23:44:32.533846+0000","last_active":"2023-10-25T23:44:32.522977+0000","last_peered":"2023-10-25T23:44:32.522977+0000","last_clean":"2023-10-25T23:44:32.522977+0000","last_became_active":"2023-10-25T23:36:09.292546+0000","last_became_peered":"2023-10-25T23:36:09.292546+0000","last_unstale":"2023-10-25T23:44:32.522977+0000","last_undegraded":"2023-10-25T23:44:32.522977+0000","last_fullsized":"2023-10-25T23:44:32.522977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2316,"log_dups_size":0,"ondisk_log_size":2316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:43:16.830999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12497243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":23958,"num_write":1360,"num_write_kb":38473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.18","version":"36'1017","reported_seq":1049,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.139975+0000","last_change":"2023-10-25T23:36:08.277462+0000","last_active":"2023-10-25T23:44:28.139975+0000","last_peered":"2023-10-25T23:44:28.139975+0000","last_clean":"2023-10-25T23:44:28.139975+0000","last_became_active":"2023-10-25T23:36:08.277138+0000","last_became_peered":"2023-10-25T23:36:08.277138+0000","last_unstale":"2023-10-25T23:44:28.139975+0000","last_undegraded":"2023-10-25T23:44:28.139975+0000","last_fullsized":"2023-10-25T23:44:28.139975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:48:32.291671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":989,"num_write_kb":120913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"37'2057","reported_seq":4644,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.474714+0000","last_change":"2023-10-25T23:44:32.483491+0000","last_active":"2023-10-25T23:44:32.474714+0000","last_peered":"2023-10-25T23:44:32.474714+0000","last_clean":"2023-10-25T23:44:32.474714+0000","last_became_active":"2023-10-25T23:36:09.290456+0000","last_became_peered":"2023-10-25T23:36:09.290456+0000","last_unstale":"2023-10-25T23:44:32.474714+0000","last_undegraded":"2023-10-25T23:44:32.474714+0000","last_fullsized":"2023-10-25T23:44:32.474714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2057,"log_dups_size":0,"ondisk_log_size":2057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:58:04.342558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063862070000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":31667,"num_write":1204,"num_write_kb":33454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.17","version":"38'354","reported_seq":463,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.948090+0000","last_change":"2023-10-25T23:36:08.272869+0000","last_active":"2023-10-25T23:44:37.948090+0000","last_peered":"2023-10-25T23:44:37.948090+0000","last_clean":"2023-10-25T23:44:37.948090+0000","last_became_active":"2023-10-25T23:36:08.272120+0000","last_became_peered":"2023-10-25T23:36:08.272120+0000","last_unstale":"2023-10-25T23:44:37.948090+0000","last_undegraded":"2023-10-25T23:44:37.948090+0000","last_fullsized":"2023-10-25T23:44:37.948090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21516605,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":83,"num_read_kb":580,"num_write":347,"num_write_kb":84046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"38'2003","reported_seq":4594,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.499624+0000","last_change":"2023-10-25T23:44:32.509416+0000","last_active":"2023-10-25T23:44:32.499624+0000","last_peered":"2023-10-25T23:44:32.499624+0000","last_clean":"2023-10-25T23:44:32.499624+0000","last_became_active":"2023-10-25T23:36:09.293132+0000","last_became_peered":"2023-10-25T23:36:09.293132+0000","last_unstale":"2023-10-25T23:44:32.499624+0000","last_undegraded":"2023-10-25T23:44:32.499624+0000","last_fullsized":"2023-10-25T23:44:32.499624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2003,"log_dups_size":0,"ondisk_log_size":2003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:15:03.433377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11400234099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":3351,"num_write":1194,"num_write_kb":12593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.16","version":"38'676","reported_seq":708,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.394602+0000","last_change":"2023-10-25T23:36:08.272920+0000","last_active":"2023-10-25T23:44:32.394602+0000","last_peered":"2023-10-25T23:44:32.394602+0000","last_clean":"2023-10-25T23:44:32.394602+0000","last_became_active":"2023-10-25T23:36:08.272596+0000","last_became_peered":"2023-10-25T23:36:08.272596+0000","last_unstale":"2023-10-25T23:44:32.394602+0000","last_undegraded":"2023-10-25T23:44:32.394602+0000","last_fullsized":"2023-10-25T23:44:32.394602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":681,"num_write_kb":114510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"38'2403","reported_seq":4854,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.578599+0000","last_change":"2023-10-25T23:44:32.588826+0000","last_active":"2023-10-25T23:44:32.578599+0000","last_peered":"2023-10-25T23:44:32.578599+0000","last_clean":"2023-10-25T23:44:32.578599+0000","last_became_active":"2023-10-25T23:36:09.299938+0000","last_became_peered":"2023-10-25T23:36:09.299938+0000","last_unstale":"2023-10-25T23:44:32.578599+0000","last_undegraded":"2023-10-25T23:44:32.578599+0000","last_fullsized":"2023-10-25T23:44:32.578599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2403,"log_dups_size":0,"ondisk_log_size":2403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:18:14.857365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.172680212,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":3949,"num_write":1292,"num_write_kb":20710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.15","version":"38'671","reported_seq":703,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.419765+0000","last_change":"2023-10-25T23:36:08.279751+0000","last_active":"2023-10-25T23:44:32.419765+0000","last_peered":"2023-10-25T23:44:32.419765+0000","last_clean":"2023-10-25T23:44:32.419765+0000","last_became_active":"2023-10-25T23:36:08.279509+0000","last_became_peered":"2023-10-25T23:36:08.279509+0000","last_unstale":"2023-10-25T23:44:32.419765+0000","last_undegraded":"2023-10-25T23:44:32.419765+0000","last_fullsized":"2023-10-25T23:44:32.419765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":674,"num_write_kb":75677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"37'2100","reported_seq":4713,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.956038+0000","last_change":"2023-10-25T23:44:38.965806+0000","last_active":"2023-10-25T23:44:38.956038+0000","last_peered":"2023-10-25T23:44:38.956038+0000","last_clean":"2023-10-25T23:44:38.956038+0000","last_became_active":"2023-10-25T23:36:09.285196+0000","last_became_peered":"2023-10-25T23:36:09.285196+0000","last_unstale":"2023-10-25T23:44:38.956038+0000","last_undegraded":"2023-10-25T23:44:38.956038+0000","last_fullsized":"2023-10-25T23:44:38.956038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:57:33.172851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.093006917999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":5156,"num_write":1232,"num_write_kb":26142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.14","version":"37'525","reported_seq":559,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.948109+0000","last_change":"2023-10-25T23:36:08.272911+0000","last_active":"2023-10-25T23:44:37.948109+0000","last_peered":"2023-10-25T23:44:37.948109+0000","last_clean":"2023-10-25T23:44:37.948109+0000","last_became_active":"2023-10-25T23:36:08.272248+0000","last_became_peered":"2023-10-25T23:36:08.272248+0000","last_unstale":"2023-10-25T23:44:37.948109+0000","last_undegraded":"2023-10-25T23:44:37.948109+0000","last_fullsized":"2023-10-25T23:44:37.948109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166496,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":486,"num_write_kb":123603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"38'2004","reported_seq":4609,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.524715+0000","last_change":"2023-10-25T23:44:32.534402+0000","last_active":"2023-10-25T23:44:32.524715+0000","last_peered":"2023-10-25T23:44:32.524715+0000","last_clean":"2023-10-25T23:44:32.524715+0000","last_became_active":"2023-10-25T23:36:09.292300+0000","last_became_peered":"2023-10-25T23:36:09.292300+0000","last_unstale":"2023-10-25T23:44:32.524715+0000","last_undegraded":"2023-10-25T23:44:32.524715+0000","last_fullsized":"2023-10-25T23:44:32.524715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2004,"log_dups_size":0,"ondisk_log_size":2004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:25:10.694319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11980879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":3691,"num_write":1193,"num_write_kb":20847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.13","version":"36'212","reported_seq":244,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.472556+0000","last_change":"2023-10-25T23:36:08.274407+0000","last_active":"2023-10-25T23:44:28.472556+0000","last_peered":"2023-10-25T23:44:28.472556+0000","last_clean":"2023-10-25T23:44:28.472556+0000","last_became_active":"2023-10-25T23:36:08.274162+0000","last_became_peered":"2023-10-25T23:36:08.274162+0000","last_unstale":"2023-10-25T23:44:28.472556+0000","last_undegraded":"2023-10-25T23:44:28.472556+0000","last_fullsized":"2023-10-25T23:44:28.472556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360162,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":202,"num_write_kb":93162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"38'2303","reported_seq":4780,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.525183+0000","last_change":"2023-10-25T23:44:32.535345+0000","last_active":"2023-10-25T23:44:32.525183+0000","last_peered":"2023-10-25T23:44:32.525183+0000","last_clean":"2023-10-25T23:44:32.525183+0000","last_became_active":"2023-10-25T23:36:09.284386+0000","last_became_peered":"2023-10-25T23:36:09.284386+0000","last_unstale":"2023-10-25T23:44:32.525183+0000","last_undegraded":"2023-10-25T23:44:32.525183+0000","last_fullsized":"2023-10-25T23:44:32.525183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2303,"log_dups_size":0,"ondisk_log_size":2303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:25:24.082691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.122095678,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":8533,"num_write":1240,"num_write_kb":24417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.12","version":"35'180","reported_seq":212,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.140009+0000","last_change":"2023-10-25T23:36:08.271565+0000","last_active":"2023-10-25T23:44:28.140009+0000","last_peered":"2023-10-25T23:44:28.140009+0000","last_clean":"2023-10-25T23:44:28.140009+0000","last_became_active":"2023-10-25T23:36:08.271188+0000","last_became_peered":"2023-10-25T23:36:08.271188+0000","last_unstale":"2023-10-25T23:44:28.140009+0000","last_undegraded":"2023-10-25T23:44:28.140009+0000","last_fullsized":"2023-10-25T23:44:28.140009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:51:48.005011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":160,"num_write_kb":61795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"37'2148","reported_seq":4727,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.508023+0000","last_change":"2023-10-25T23:44:32.524610+0000","last_active":"2023-10-25T23:44:32.508023+0000","last_peered":"2023-10-25T23:44:32.508023+0000","last_clean":"2023-10-25T23:44:32.508023+0000","last_became_active":"2023-10-25T23:36:09.294200+0000","last_became_peered":"2023-10-25T23:36:09.294200+0000","last_unstale":"2023-10-25T23:44:32.508023+0000","last_undegraded":"2023-10-25T23:44:32.508023+0000","last_fullsized":"2023-10-25T23:44:32.508023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2148,"log_dups_size":0,"ondisk_log_size":2148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:58:37.312724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11302248199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":3992,"num_write":1263,"num_write_kb":18428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.11","version":"37'389","reported_seq":423,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.949534+0000","last_change":"2023-10-25T23:36:08.273427+0000","last_active":"2023-10-25T23:44:37.949534+0000","last_peered":"2023-10-25T23:44:37.949534+0000","last_clean":"2023-10-25T23:44:37.949534+0000","last_became_active":"2023-10-25T23:36:08.272301+0000","last_became_peered":"2023-10-25T23:36:08.272301+0000","last_unstale":"2023-10-25T23:44:37.949534+0000","last_undegraded":"2023-10-25T23:44:37.949534+0000","last_fullsized":"2023-10-25T23:44:37.949534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":376,"num_write_kb":99496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"38'2009","reported_seq":4631,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.502533+0000","last_change":"2023-10-25T23:44:39.507532+0000","last_active":"2023-10-25T23:44:39.502533+0000","last_peered":"2023-10-25T23:44:39.502533+0000","last_clean":"2023-10-25T23:44:39.502533+0000","last_became_active":"2023-10-25T23:36:09.291305+0000","last_became_peered":"2023-10-25T23:36:09.291305+0000","last_unstale":"2023-10-25T23:44:39.502533+0000","last_undegraded":"2023-10-25T23:44:39.502533+0000","last_fullsized":"2023-10-25T23:44:39.502533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:35:20.916506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044631746999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":3822,"num_write":1210,"num_write_kb":15603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.10","version":"36'336","reported_seq":370,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.871585+0000","last_change":"2023-10-25T23:36:08.277621+0000","last_active":"2023-10-25T23:44:37.871585+0000","last_peered":"2023-10-25T23:44:37.871585+0000","last_clean":"2023-10-25T23:44:37.871585+0000","last_became_active":"2023-10-25T23:36:08.277327+0000","last_became_peered":"2023-10-25T23:36:08.277327+0000","last_unstale":"2023-10-25T23:44:37.871585+0000","last_undegraded":"2023-10-25T23:44:37.871585+0000","last_fullsized":"2023-10-25T23:44:37.871585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:04.918703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":349,"num_write_kb":89245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"38'2078","reported_seq":4705,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.497526+0000","last_change":"2023-10-25T23:44:32.507949+0000","last_active":"2023-10-25T23:44:32.497526+0000","last_peered":"2023-10-25T23:44:32.497526+0000","last_clean":"2023-10-25T23:44:32.497526+0000","last_became_active":"2023-10-25T23:36:09.295231+0000","last_became_peered":"2023-10-25T23:36:09.295231+0000","last_unstale":"2023-10-25T23:44:32.497526+0000","last_undegraded":"2023-10-25T23:44:32.497526+0000","last_fullsized":"2023-10-25T23:44:32.497526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2078,"log_dups_size":0,"ondisk_log_size":2078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:20:50.930557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.096538947,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":12104,"num_write":1268,"num_write_kb":24673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.f","version":"36'388","reported_seq":422,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.871300+0000","last_change":"2023-10-25T23:36:08.263573+0000","last_active":"2023-10-25T23:44:37.871300+0000","last_peered":"2023-10-25T23:44:37.871300+0000","last_clean":"2023-10-25T23:44:37.871300+0000","last_became_active":"2023-10-25T23:36:08.263264+0000","last_became_peered":"2023-10-25T23:36:08.263264+0000","last_unstale":"2023-10-25T23:44:37.871300+0000","last_undegraded":"2023-10-25T23:44:37.871300+0000","last_fullsized":"2023-10-25T23:44:37.871300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554454,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":368,"num_write_kb":90831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"38'2065","reported_seq":4672,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.524666+0000","last_change":"2023-10-25T23:44:32.534422+0000","last_active":"2023-10-25T23:44:32.524666+0000","last_peered":"2023-10-25T23:44:32.524666+0000","last_clean":"2023-10-25T23:44:32.524666+0000","last_became_active":"2023-10-25T23:36:09.294298+0000","last_became_peered":"2023-10-25T23:36:09.294298+0000","last_unstale":"2023-10-25T23:44:32.524666+0000","last_undegraded":"2023-10-25T23:44:32.524666+0000","last_fullsized":"2023-10-25T23:44:32.524666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:15:03.433377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12011416900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":8972,"num_write":1223,"num_write_kb":21636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.4","version":"37'318","reported_seq":351,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:31.099513+0000","last_change":"2023-10-25T23:36:08.277383+0000","last_active":"2023-10-25T23:44:31.099513+0000","last_peered":"2023-10-25T23:44:31.099513+0000","last_clean":"2023-10-25T23:44:31.099513+0000","last_became_active":"2023-10-25T23:36:08.277087+0000","last_became_peered":"2023-10-25T23:36:08.277087+0000","last_unstale":"2023-10-25T23:44:31.099513+0000","last_undegraded":"2023-10-25T23:44:31.099513+0000","last_fullsized":"2023-10-25T23:44:31.099513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":307,"num_write_kb":115956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"38'2151","reported_seq":4738,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.499581+0000","last_change":"2023-10-25T23:44:32.509417+0000","last_active":"2023-10-25T23:44:32.499581+0000","last_peered":"2023-10-25T23:44:32.499581+0000","last_clean":"2023-10-25T23:44:32.499581+0000","last_became_active":"2023-10-25T23:36:50.069951+0000","last_became_peered":"2023-10-25T23:36:50.069951+0000","last_unstale":"2023-10-25T23:44:32.499581+0000","last_undegraded":"2023-10-25T23:44:32.499581+0000","last_fullsized":"2023-10-25T23:44:32.499581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2151,"log_dups_size":0,"ondisk_log_size":2151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:22:15.481808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.114189366,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":24659,"num_write":1256,"num_write_kb":46504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.2","version":"36'293","reported_seq":326,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:31.105686+0000","last_change":"2023-10-25T23:36:08.279568+0000","last_active":"2023-10-25T23:44:31.105686+0000","last_peered":"2023-10-25T23:44:31.105686+0000","last_clean":"2023-10-25T23:44:31.105686+0000","last_became_active":"2023-10-25T23:36:08.279302+0000","last_became_peered":"2023-10-25T23:36:08.279302+0000","last_unstale":"2023-10-25T23:44:31.105686+0000","last_undegraded":"2023-10-25T23:44:31.105686+0000","last_fullsized":"2023-10-25T23:44:31.105686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:27.340205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":257,"num_write_kb":101207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"37'2033","reported_seq":4663,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.965867+0000","last_change":"2023-10-25T23:44:38.976975+0000","last_active":"2023-10-25T23:44:38.965867+0000","last_peered":"2023-10-25T23:44:38.965867+0000","last_clean":"2023-10-25T23:44:38.965867+0000","last_became_active":"2023-10-25T23:36:09.292670+0000","last_became_peered":"2023-10-25T23:36:09.292670+0000","last_unstale":"2023-10-25T23:44:38.965867+0000","last_undegraded":"2023-10-25T23:44:38.965867+0000","last_fullsized":"2023-10-25T23:44:38.965867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:47:28.005164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104196124,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":4275,"num_write":1236,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.0","version":"37'2110","reported_seq":4697,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.466256+0000","last_change":"2023-10-25T23:44:32.474501+0000","last_active":"2023-10-25T23:44:32.466256+0000","last_peered":"2023-10-25T23:44:32.466256+0000","last_clean":"2023-10-25T23:44:32.466256+0000","last_became_active":"2023-10-25T23:36:09.283766+0000","last_became_peered":"2023-10-25T23:36:09.283766+0000","last_unstale":"2023-10-25T23:44:32.466256+0000","last_undegraded":"2023-10-25T23:44:32.466256+0000","last_fullsized":"2023-10-25T23:44:32.466256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2110,"log_dups_size":0,"ondisk_log_size":2110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:45:53.731749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055185130999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":3969,"num_write":1247,"num_write_kb":17464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.1","version":"36'550","reported_seq":878,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.871700+0000","last_change":"2023-10-25T23:36:08.264050+0000","last_active":"2023-10-25T23:44:37.871700+0000","last_peered":"2023-10-25T23:44:37.871700+0000","last_clean":"2023-10-25T23:44:37.871700+0000","last_became_active":"2023-10-25T23:36:08.263842+0000","last_became_peered":"2023-10-25T23:36:08.263842+0000","last_unstale":"2023-10-25T23:44:37.871700+0000","last_undegraded":"2023-10-25T23:44:37.871700+0000","last_fullsized":"2023-10-25T23:44:37.871700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:31.130445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":301,"num_read_kb":4287,"num_write":520,"num_write_kb":107914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"38'2106","reported_seq":4676,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.569558+0000","last_change":"2023-10-25T23:44:32.579545+0000","last_active":"2023-10-25T23:44:32.569558+0000","last_peered":"2023-10-25T23:44:32.569558+0000","last_clean":"2023-10-25T23:44:32.569558+0000","last_became_active":"2023-10-25T23:36:09.295595+0000","last_became_peered":"2023-10-25T23:36:09.295595+0000","last_unstale":"2023-10-25T23:44:32.569558+0000","last_undegraded":"2023-10-25T23:44:32.569558+0000","last_fullsized":"2023-10-25T23:44:32.569558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2106,"log_dups_size":0,"ondisk_log_size":2106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:47:48.760379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16669458700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":3321,"num_write":1232,"num_write_kb":16686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.3","version":"36'221","reported_seq":254,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:31.105720+0000","last_change":"2023-10-25T23:36:08.272009+0000","last_active":"2023-10-25T23:44:31.105720+0000","last_peered":"2023-10-25T23:44:31.105720+0000","last_clean":"2023-10-25T23:44:31.105720+0000","last_became_active":"2023-10-25T23:36:08.271640+0000","last_became_peered":"2023-10-25T23:36:08.271640+0000","last_unstale":"2023-10-25T23:44:31.105720+0000","last_undegraded":"2023-10-25T23:44:31.105720+0000","last_fullsized":"2023-10-25T23:44:31.105720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:40.023263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":206,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":186,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:27.995191+0000","last_change":"2023-10-25T23:35:58.277542+0000","last_active":"2023-10-25T23:44:27.995191+0000","last_peered":"2023-10-25T23:44:27.995191+0000","last_clean":"2023-10-25T23:44:27.995191+0000","last_became_active":"2023-10-25T23:35:58.276606+0000","last_became_peered":"2023-10-25T23:35:58.276606+0000","last_unstale":"2023-10-25T23:44:27.995191+0000","last_undegraded":"2023-10-25T23:44:27.995191+0000","last_fullsized":"2023-10-25T23:44:27.995191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:35:57.197265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:35:57.197265+0000","last_clean_scrub_stamp":"2023-10-25T23:35:57.197265+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:53:55.116662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"38'1942","reported_seq":4532,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.523005+0000","last_change":"2023-10-25T23:44:32.535944+0000","last_active":"2023-10-25T23:44:32.523005+0000","last_peered":"2023-10-25T23:44:32.523005+0000","last_clean":"2023-10-25T23:44:32.523005+0000","last_became_active":"2023-10-25T23:36:09.291072+0000","last_became_peered":"2023-10-25T23:36:09.291072+0000","last_unstale":"2023-10-25T23:44:32.523005+0000","last_undegraded":"2023-10-25T23:44:32.523005+0000","last_fullsized":"2023-10-25T23:44:32.523005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1942,"log_dups_size":0,"ondisk_log_size":1942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:08:35.964760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.124694893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":28650,"num_write":1164,"num_write_kb":22232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.0","version":"36'240","reported_seq":273,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:27.995297+0000","last_change":"2023-10-25T23:36:08.277937+0000","last_active":"2023-10-25T23:44:27.995297+0000","last_peered":"2023-10-25T23:44:27.995297+0000","last_clean":"2023-10-25T23:44:27.995297+0000","last_became_active":"2023-10-25T23:36:08.277663+0000","last_became_peered":"2023-10-25T23:36:08.277663+0000","last_unstale":"2023-10-25T23:44:27.995297+0000","last_undegraded":"2023-10-25T23:44:27.995297+0000","last_fullsized":"2023-10-25T23:44:27.995297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:04.918703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":226,"num_write_kb":82970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"38'485","reported_seq":518,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.414939+0000","last_change":"2023-10-25T23:36:08.270783+0000","last_active":"2023-10-25T23:44:32.414939+0000","last_peered":"2023-10-25T23:44:32.414939+0000","last_clean":"2023-10-25T23:44:32.414939+0000","last_became_active":"2023-10-25T23:36:08.269896+0000","last_became_peered":"2023-10-25T23:36:08.269896+0000","last_unstale":"2023-10-25T23:44:32.414939+0000","last_undegraded":"2023-10-25T23:44:32.414939+0000","last_fullsized":"2023-10-25T23:44:32.414939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":446,"num_write_kb":94912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"38'2027","reported_seq":4641,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.483964+0000","last_change":"2023-10-25T23:44:32.490756+0000","last_active":"2023-10-25T23:44:32.483964+0000","last_peered":"2023-10-25T23:44:32.483964+0000","last_clean":"2023-10-25T23:44:32.483964+0000","last_became_active":"2023-10-25T23:36:09.278967+0000","last_became_peered":"2023-10-25T23:36:09.278967+0000","last_unstale":"2023-10-25T23:44:32.483964+0000","last_undegraded":"2023-10-25T23:44:32.483964+0000","last_fullsized":"2023-10-25T23:44:32.483964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2027,"log_dups_size":0,"ondisk_log_size":2027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:55:37.816244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070850333000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":3903,"num_write":1243,"num_write_kb":26062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.6","version":"37'363","reported_seq":395,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.150970+0000","last_change":"2023-10-25T23:36:08.279363+0000","last_active":"2023-10-25T23:44:32.150970+0000","last_peered":"2023-10-25T23:44:32.150970+0000","last_clean":"2023-10-25T23:44:32.150970+0000","last_became_active":"2023-10-25T23:36:08.279082+0000","last_became_peered":"2023-10-25T23:36:08.279082+0000","last_unstale":"2023-10-25T23:44:32.150970+0000","last_undegraded":"2023-10-25T23:44:32.150970+0000","last_fullsized":"2023-10-25T23:44:32.150970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":463,"num_write_kb":81485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"38'1958","reported_seq":4546,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.579608+0000","last_change":"2023-10-25T23:44:32.589792+0000","last_active":"2023-10-25T23:44:32.579608+0000","last_peered":"2023-10-25T23:44:32.579608+0000","last_clean":"2023-10-25T23:44:32.579608+0000","last_became_active":"2023-10-25T23:36:09.289751+0000","last_became_peered":"2023-10-25T23:36:09.289751+0000","last_unstale":"2023-10-25T23:44:32.579608+0000","last_undegraded":"2023-10-25T23:44:32.579608+0000","last_fullsized":"2023-10-25T23:44:32.579608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1958,"log_dups_size":0,"ondisk_log_size":1958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:25:10.694319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.180222046,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":4389,"num_write":1130,"num_write_kb":12211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.7","version":"38'408","reported_seq":442,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.947700+0000","last_change":"2023-10-25T23:36:08.274349+0000","last_active":"2023-10-25T23:44:37.947700+0000","last_peered":"2023-10-25T23:44:37.947700+0000","last_clean":"2023-10-25T23:44:37.947700+0000","last_became_active":"2023-10-25T23:36:08.273029+0000","last_became_peered":"2023-10-25T23:36:08.273029+0000","last_unstale":"2023-10-25T23:44:37.947700+0000","last_undegraded":"2023-10-25T23:44:37.947700+0000","last_fullsized":"2023-10-25T23:44:37.947700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":396,"num_write_kb":80384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"37'1987","reported_seq":4591,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.546622+0000","last_change":"2023-10-25T23:44:32.561359+0000","last_active":"2023-10-25T23:44:32.546622+0000","last_peered":"2023-10-25T23:44:32.546622+0000","last_clean":"2023-10-25T23:44:32.546622+0000","last_became_active":"2023-10-25T23:36:09.287532+0000","last_became_peered":"2023-10-25T23:36:09.287532+0000","last_unstale":"2023-10-25T23:44:32.546622+0000","last_undegraded":"2023-10-25T23:44:32.546622+0000","last_fullsized":"2023-10-25T23:44:32.546622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:48:17.801733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14756345200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":4941,"num_write":1181,"num_write_kb":9554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.8","version":"36'238","reported_seq":270,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:27.995191+0000","last_change":"2023-10-25T23:36:08.266963+0000","last_active":"2023-10-25T23:44:27.995191+0000","last_peered":"2023-10-25T23:44:27.995191+0000","last_clean":"2023-10-25T23:44:27.995191+0000","last_became_active":"2023-10-25T23:36:08.266648+0000","last_became_peered":"2023-10-25T23:36:08.266648+0000","last_unstale":"2023-10-25T23:44:27.995191+0000","last_undegraded":"2023-10-25T23:44:27.995191+0000","last_fullsized":"2023-10-25T23:44:27.995191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:31.130445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":194,"num_write_kb":95518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"38'2105","reported_seq":4726,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.938764+0000","last_change":"2023-10-25T23:44:38.947498+0000","last_active":"2023-10-25T23:44:38.938764+0000","last_peered":"2023-10-25T23:44:38.938764+0000","last_clean":"2023-10-25T23:44:38.938764+0000","last_became_active":"2023-10-25T23:36:09.284666+0000","last_became_peered":"2023-10-25T23:36:09.284666+0000","last_unstale":"2023-10-25T23:44:38.938764+0000","last_undegraded":"2023-10-25T23:44:38.938764+0000","last_fullsized":"2023-10-25T23:44:38.938764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2105,"log_dups_size":0,"ondisk_log_size":2105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:12:30.838027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.075073965000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":4417,"num_write":1270,"num_write_kb":29307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.9","version":"36'390","reported_seq":422,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.138646+0000","last_change":"2023-10-25T23:36:08.278162+0000","last_active":"2023-10-25T23:44:28.138646+0000","last_peered":"2023-10-25T23:44:28.138646+0000","last_clean":"2023-10-25T23:44:28.138646+0000","last_became_active":"2023-10-25T23:36:08.277873+0000","last_became_peered":"2023-10-25T23:36:08.277873+0000","last_unstale":"2023-10-25T23:44:28.138646+0000","last_undegraded":"2023-10-25T23:44:28.138646+0000","last_fullsized":"2023-10-25T23:44:28.138646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":385,"num_write_kb":96608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"38'2131","reported_seq":4728,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.533964+0000","last_change":"2023-10-25T23:44:32.544755+0000","last_active":"2023-10-25T23:44:32.533964+0000","last_peered":"2023-10-25T23:44:32.533964+0000","last_clean":"2023-10-25T23:44:32.533964+0000","last_became_active":"2023-10-25T23:36:09.289320+0000","last_became_peered":"2023-10-25T23:36:09.289320+0000","last_unstale":"2023-10-25T23:44:32.533964+0000","last_undegraded":"2023-10-25T23:44:32.533964+0000","last_fullsized":"2023-10-25T23:44:32.533964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2131,"log_dups_size":0,"ondisk_log_size":2131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:58:54.338525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.135709307,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":230,"num_read_kb":4443,"num_write":1269,"num_write_kb":26048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.a","version":"36'618","reported_seq":650,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.138363+0000","last_change":"2023-10-25T23:36:08.278921+0000","last_active":"2023-10-25T23:44:28.138363+0000","last_peered":"2023-10-25T23:44:28.138363+0000","last_clean":"2023-10-25T23:44:28.138363+0000","last_became_active":"2023-10-25T23:36:08.278656+0000","last_became_peered":"2023-10-25T23:36:08.278656+0000","last_unstale":"2023-10-25T23:44:28.138363+0000","last_undegraded":"2023-10-25T23:44:28.138363+0000","last_fullsized":"2023-10-25T23:44:28.138363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":598,"num_write_kb":115954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"38'2104","reported_seq":4678,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.559006+0000","last_change":"2023-10-25T23:44:32.569480+0000","last_active":"2023-10-25T23:44:32.559006+0000","last_peered":"2023-10-25T23:44:32.559006+0000","last_clean":"2023-10-25T23:44:32.559006+0000","last_became_active":"2023-10-25T23:36:09.292345+0000","last_became_peered":"2023-10-25T23:36:09.292345+0000","last_unstale":"2023-10-25T23:44:32.559006+0000","last_undegraded":"2023-10-25T23:44:32.559006+0000","last_fullsized":"2023-10-25T23:44:32.559006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2104,"log_dups_size":0,"ondisk_log_size":2104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:58:37.312724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15989214199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":8471,"num_write":1242,"num_write_kb":22974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.b","version":"38'416","reported_seq":448,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.411010+0000","last_change":"2023-10-25T23:36:08.270589+0000","last_active":"2023-10-25T23:44:32.411010+0000","last_peered":"2023-10-25T23:44:32.411010+0000","last_clean":"2023-10-25T23:44:32.411010+0000","last_became_active":"2023-10-25T23:36:08.268753+0000","last_became_peered":"2023-10-25T23:36:08.268753+0000","last_unstale":"2023-10-25T23:44:32.411010+0000","last_undegraded":"2023-10-25T23:44:32.411010+0000","last_fullsized":"2023-10-25T23:44:32.411010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":415,"num_write_kb":99792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"37'2024","reported_seq":4651,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.507668+0000","last_change":"2023-10-25T23:44:39.510909+0000","last_active":"2023-10-25T23:44:39.507668+0000","last_peered":"2023-10-25T23:44:39.507668+0000","last_clean":"2023-10-25T23:44:39.507668+0000","last_became_active":"2023-10-25T23:36:09.290151+0000","last_became_peered":"2023-10-25T23:36:09.290151+0000","last_unstale":"2023-10-25T23:44:39.507668+0000","last_undegraded":"2023-10-25T23:44:39.507668+0000","last_fullsized":"2023-10-25T23:44:39.507668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2024,"log_dups_size":0,"ondisk_log_size":2024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:56:59.222424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047955154,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":5633,"num_write":1198,"num_write_kb":13442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.c","version":"37'230","reported_seq":264,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.871765+0000","last_change":"2023-10-25T23:36:08.272161+0000","last_active":"2023-10-25T23:44:37.871765+0000","last_peered":"2023-10-25T23:44:37.871765+0000","last_clean":"2023-10-25T23:44:37.871765+0000","last_became_active":"2023-10-25T23:36:08.271846+0000","last_became_peered":"2023-10-25T23:36:08.271846+0000","last_unstale":"2023-10-25T23:44:37.871765+0000","last_undegraded":"2023-10-25T23:44:37.871765+0000","last_fullsized":"2023-10-25T23:44:37.871765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:39.512919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":195,"num_write_kb":98810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"38'2024","reported_seq":4615,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.534494+0000","last_change":"2023-10-25T23:44:32.543725+0000","last_active":"2023-10-25T23:44:32.534494+0000","last_peered":"2023-10-25T23:44:32.534494+0000","last_clean":"2023-10-25T23:44:32.534494+0000","last_became_active":"2023-10-25T23:36:09.295635+0000","last_became_peered":"2023-10-25T23:36:09.295635+0000","last_unstale":"2023-10-25T23:44:32.534494+0000","last_undegraded":"2023-10-25T23:44:32.534494+0000","last_fullsized":"2023-10-25T23:44:32.534494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2024,"log_dups_size":0,"ondisk_log_size":2024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:58:54.338525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12892921700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":10038,"num_write":1186,"num_write_kb":32237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.d","version":"36'444","reported_seq":476,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.138558+0000","last_change":"2023-10-25T23:36:08.277618+0000","last_active":"2023-10-25T23:44:28.138558+0000","last_peered":"2023-10-25T23:44:28.138558+0000","last_clean":"2023-10-25T23:44:28.138558+0000","last_became_active":"2023-10-25T23:36:08.277344+0000","last_became_peered":"2023-10-25T23:36:08.277344+0000","last_unstale":"2023-10-25T23:44:28.138558+0000","last_undegraded":"2023-10-25T23:44:28.138558+0000","last_fullsized":"2023-10-25T23:44:28.138558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:21:29.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25170780,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":452,"num_write_kb":113081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"38'2036","reported_seq":4641,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.467108+0000","last_change":"2023-10-25T23:44:32.477913+0000","last_active":"2023-10-25T23:44:32.467108+0000","last_peered":"2023-10-25T23:44:32.467108+0000","last_clean":"2023-10-25T23:44:32.467108+0000","last_became_active":"2023-10-25T23:36:09.299234+0000","last_became_peered":"2023-10-25T23:36:09.299234+0000","last_unstale":"2023-10-25T23:44:32.467108+0000","last_undegraded":"2023-10-25T23:44:32.467108+0000","last_fullsized":"2023-10-25T23:44:32.467108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:07:23.792926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.083041489999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":4213,"num_write":1231,"num_write_kb":8559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.e","version":"36'466","reported_seq":500,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.871997+0000","last_change":"2023-10-25T23:36:08.269389+0000","last_active":"2023-10-25T23:44:37.871997+0000","last_peered":"2023-10-25T23:44:37.871997+0000","last_clean":"2023-10-25T23:44:37.871997+0000","last_became_active":"2023-10-25T23:36:08.269065+0000","last_became_peered":"2023-10-25T23:36:08.269065+0000","last_unstale":"2023-10-25T23:44:37.871997+0000","last_undegraded":"2023-10-25T23:44:37.871997+0000","last_fullsized":"2023-10-25T23:44:37.871997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":460,"num_write_kb":103224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"38'2026","reported_seq":4636,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.534598+0000","last_change":"2023-10-25T23:44:32.543717+0000","last_active":"2023-10-25T23:44:32.534598+0000","last_peered":"2023-10-25T23:44:32.534598+0000","last_clean":"2023-10-25T23:44:32.534598+0000","last_became_active":"2023-10-25T23:36:09.294494+0000","last_became_peered":"2023-10-25T23:36:09.294494+0000","last_unstale":"2023-10-25T23:44:32.534598+0000","last_undegraded":"2023-10-25T23:44:32.534598+0000","last_fullsized":"2023-10-25T23:44:32.534598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:47:48.760379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12874353299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":9037,"num_write":1232,"num_write_kb":21545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.20","version":"38'2048","reported_seq":4692,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.507611+0000","last_change":"2023-10-25T23:44:39.510985+0000","last_active":"2023-10-25T23:44:39.507611+0000","last_peered":"2023-10-25T23:44:39.507611+0000","last_clean":"2023-10-25T23:44:39.507611+0000","last_became_active":"2023-10-25T23:36:09.291665+0000","last_became_peered":"2023-10-25T23:36:09.291665+0000","last_unstale":"2023-10-25T23:44:39.507611+0000","last_undegraded":"2023-10-25T23:44:39.507611+0000","last_fullsized":"2023-10-25T23:44:39.507611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2048,"log_dups_size":0,"ondisk_log_size":2048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:23:16.256254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048033508000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":23343,"num_write":1242,"num_write_kb":29102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.21","version":"38'2167","reported_seq":4771,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.906315+0000","last_change":"2023-10-25T23:44:38.911392+0000","last_active":"2023-10-25T23:44:38.906315+0000","last_peered":"2023-10-25T23:44:38.906315+0000","last_clean":"2023-10-25T23:44:38.906315+0000","last_became_active":"2023-10-25T23:36:09.295817+0000","last_became_peered":"2023-10-25T23:36:09.295817+0000","last_unstale":"2023-10-25T23:44:38.906315+0000","last_undegraded":"2023-10-25T23:44:38.906315+0000","last_fullsized":"2023-10-25T23:44:38.906315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2167,"log_dups_size":0,"ondisk_log_size":2167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:45:10.022688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038422899000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":12397,"num_write":1283,"num_write_kb":33443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.22","version":"37'2070","reported_seq":4665,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.477977+0000","last_change":"2023-10-25T23:44:32.488844+0000","last_active":"2023-10-25T23:44:32.477977+0000","last_peered":"2023-10-25T23:44:32.477977+0000","last_clean":"2023-10-25T23:44:32.477977+0000","last_became_active":"2023-10-25T23:36:09.299024+0000","last_became_peered":"2023-10-25T23:36:09.299024+0000","last_unstale":"2023-10-25T23:44:32.477977+0000","last_undegraded":"2023-10-25T23:44:32.477977+0000","last_fullsized":"2023-10-25T23:44:32.477977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:10:34.048013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.093943498,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":4357,"num_write":1220,"num_write_kb":7384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.23","version":"37'2232","reported_seq":4786,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.547769+0000","last_change":"2023-10-25T23:44:32.561360+0000","last_active":"2023-10-25T23:44:32.547769+0000","last_peered":"2023-10-25T23:44:32.547769+0000","last_clean":"2023-10-25T23:44:32.547769+0000","last_became_active":"2023-10-25T23:36:09.292344+0000","last_became_peered":"2023-10-25T23:36:09.292344+0000","last_unstale":"2023-10-25T23:44:32.547769+0000","last_undegraded":"2023-10-25T23:44:32.547769+0000","last_fullsized":"2023-10-25T23:44:32.547769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2232,"log_dups_size":0,"ondisk_log_size":2232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:09.563199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.147721039,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":3547,"num_write":1298,"num_write_kb":27693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.24","version":"38'2016","reported_seq":4597,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.569503+0000","last_change":"2023-10-25T23:44:32.579537+0000","last_active":"2023-10-25T23:44:32.569503+0000","last_peered":"2023-10-25T23:44:32.569503+0000","last_clean":"2023-10-25T23:44:32.569503+0000","last_became_active":"2023-10-25T23:36:09.297202+0000","last_became_peered":"2023-10-25T23:36:09.297202+0000","last_unstale":"2023-10-25T23:44:32.569503+0000","last_undegraded":"2023-10-25T23:44:32.569503+0000","last_fullsized":"2023-10-25T23:44:32.569503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:15:03.433377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16961031800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":7838,"num_write":1164,"num_write_kb":15586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.25","version":"37'2020","reported_seq":4707,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.474663+0000","last_change":"2023-10-25T23:44:32.483496+0000","last_active":"2023-10-25T23:44:32.474663+0000","last_peered":"2023-10-25T23:44:32.474663+0000","last_clean":"2023-10-25T23:44:32.474663+0000","last_became_active":"2023-10-25T23:36:09.293157+0000","last_became_peered":"2023-10-25T23:36:09.293157+0000","last_unstale":"2023-10-25T23:44:32.474663+0000","last_undegraded":"2023-10-25T23:44:32.474663+0000","last_fullsized":"2023-10-25T23:44:32.474663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2020,"log_dups_size":0,"ondisk_log_size":2020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:35:16.290832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063886599000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":301,"num_read_kb":22462,"num_write":1198,"num_write_kb":27011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.26","version":"38'2156","reported_seq":4757,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.516218+0000","last_change":"2023-10-25T23:44:39.519493+0000","last_active":"2023-10-25T23:44:39.516218+0000","last_peered":"2023-10-25T23:44:39.516218+0000","last_clean":"2023-10-25T23:44:39.516218+0000","last_became_active":"2023-10-25T23:36:09.288127+0000","last_became_peered":"2023-10-25T23:36:09.288127+0000","last_unstale":"2023-10-25T23:44:39.516218+0000","last_undegraded":"2023-10-25T23:44:39.516218+0000","last_fullsized":"2023-10-25T23:44:39.516218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2156,"log_dups_size":0,"ondisk_log_size":2156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:42.350798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055712415000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":4655,"num_write":1304,"num_write_kb":14899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.27","version":"38'1996","reported_seq":4603,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.559063+0000","last_change":"2023-10-25T23:44:32.569447+0000","last_active":"2023-10-25T23:44:32.559063+0000","last_peered":"2023-10-25T23:44:32.559063+0000","last_clean":"2023-10-25T23:44:32.559063+0000","last_became_active":"2023-10-25T23:36:09.290160+0000","last_became_peered":"2023-10-25T23:36:09.290160+0000","last_unstale":"2023-10-25T23:44:32.559063+0000","last_undegraded":"2023-10-25T23:44:32.559063+0000","last_fullsized":"2023-10-25T23:44:32.559063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1996,"log_dups_size":0,"ondisk_log_size":1996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:22:15.481808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15980784200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":16054,"num_write":1171,"num_write_kb":30881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.28","version":"38'2009","reported_seq":4618,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.465470+0000","last_change":"2023-10-25T23:44:32.465470+0000","last_active":"2023-10-25T23:44:32.465470+0000","last_peered":"2023-10-25T23:44:32.465470+0000","last_clean":"2023-10-25T23:44:32.465470+0000","last_became_active":"2023-10-25T23:36:09.298637+0000","last_became_peered":"2023-10-25T23:36:09.298637+0000","last_unstale":"2023-10-25T23:44:32.465470+0000","last_undegraded":"2023-10-25T23:44:32.465470+0000","last_fullsized":"2023-10-25T23:44:32.465470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:30:25.067286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070832067999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":3413,"num_write":1198,"num_write_kb":11362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.29","version":"37'1982","reported_seq":4595,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.533912+0000","last_change":"2023-10-25T23:44:32.544759+0000","last_active":"2023-10-25T23:44:32.533912+0000","last_peered":"2023-10-25T23:44:32.533912+0000","last_clean":"2023-10-25T23:44:32.533912+0000","last_became_active":"2023-10-25T23:36:09.290546+0000","last_became_peered":"2023-10-25T23:36:09.290546+0000","last_unstale":"2023-10-25T23:44:32.533912+0000","last_undegraded":"2023-10-25T23:44:32.533912+0000","last_fullsized":"2023-10-25T23:44:32.533912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1982,"log_dups_size":0,"ondisk_log_size":1982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:07:23.792926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.135788095,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":7180,"num_write":1206,"num_write_kb":23829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.2a","version":"37'2160","reported_seq":4722,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.483906+0000","last_change":"2023-10-25T23:44:32.490753+0000","last_active":"2023-10-25T23:44:32.483906+0000","last_peered":"2023-10-25T23:44:32.483906+0000","last_clean":"2023-10-25T23:44:32.483906+0000","last_became_active":"2023-10-25T23:36:50.102780+0000","last_became_peered":"2023-10-25T23:36:50.102780+0000","last_unstale":"2023-10-25T23:44:32.483906+0000","last_undegraded":"2023-10-25T23:44:32.483906+0000","last_fullsized":"2023-10-25T23:44:32.483906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2160,"log_dups_size":0,"ondisk_log_size":2160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:06:05.306853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071023269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":4977,"num_write":1244,"num_write_kb":20718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.2b","version":"38'2071","reported_seq":4667,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.535990+0000","last_change":"2023-10-25T23:44:32.547709+0000","last_active":"2023-10-25T23:44:32.535990+0000","last_peered":"2023-10-25T23:44:32.535990+0000","last_clean":"2023-10-25T23:44:32.535990+0000","last_became_active":"2023-10-25T23:36:09.285610+0000","last_became_peered":"2023-10-25T23:36:09.285610+0000","last_unstale":"2023-10-25T23:44:32.535990+0000","last_undegraded":"2023-10-25T23:44:32.535990+0000","last_fullsized":"2023-10-25T23:44:32.535990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:39:45.667730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.134268367,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":4129,"num_write":1211,"num_write_kb":11664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.2c","version":"38'2126","reported_seq":4746,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.510974+0000","last_change":"2023-10-25T23:44:39.516069+0000","last_active":"2023-10-25T23:44:39.510974+0000","last_peered":"2023-10-25T23:44:39.510974+0000","last_clean":"2023-10-25T23:44:39.510974+0000","last_became_active":"2023-10-25T23:36:09.291566+0000","last_became_peered":"2023-10-25T23:36:09.291566+0000","last_unstale":"2023-10-25T23:44:39.510974+0000","last_undegraded":"2023-10-25T23:44:39.510974+0000","last_fullsized":"2023-10-25T23:44:39.510974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2126,"log_dups_size":0,"ondisk_log_size":2126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:10.561911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052820837000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":9012,"num_write":1282,"num_write_kb":25857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13917,"num_read_kb":527622,"num_write":78506,"num_write_kb":1459524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132701,"ondisk_log_size":132701,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":883576319,"num_objects":563,"num_object_clones":0,"num_object_copies":1126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":563,"num_whiteouts":0,"num_read":737,"num_read_kb":4867,"num_write":13233,"num_write_kb":3081677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":344,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1768792064,"data_stored":1768728153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13665,"ondisk_log_size":13665,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574957,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":431156,"kb_used_data":295912,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":93940684,"statfs":{"total":96636764160,"available":96195260416,"internally_reserved":0,"allocated":303013888,"data_stored":302765950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":138475979},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.72999999999999998,"15min":0.59599999999999997},"min":{"1min":0.26800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.67100000000000004,"5min":34.116999999999997,"15min":34.116999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.50600000000000001},"min":{"1min":0.317,"5min":0.222,"15min":0.222},"max":{"1min":0.73899999999999999,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.65400000000000003}]},{"osd":1,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.76400000000000001,"15min":0.61399999999999999},"min":{"1min":0.29599999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65200000000000002,"5min":34.424999999999997,"15min":34.424999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.77300000000000002,"15min":0.62},"min":{"1min":0.35099999999999998,"5min":0.29599999999999999,"15min":0.28100000000000003},"max":{"1min":0.79900000000000004,"5min":32.781999999999996,"15min":32.781999999999996},"last":0.69799999999999995}]},{"osd":2,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48499999999999999,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60599999999999998,"5min":1.964,"15min":1.964},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.79200000000000004,"15min":0.63900000000000001},"min":{"1min":0.34399999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76600000000000001,"5min":34.066000000000003,"15min":34.066000000000003},"last":0.56999999999999995}]},{"osd":3,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.94899999999999995,"15min":0.68400000000000005},"min":{"1min":0.40699999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.622,"5min":50.606999999999999,"15min":50.606999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.89900000000000002,"15min":0.68899999999999995},"min":{"1min":0.41199999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.89200000000000002,"5min":41.027999999999999,"15min":41.027999999999999},"last":0.58899999999999997}]},{"osd":4,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.72999999999999998,"15min":0.55500000000000005},"min":{"1min":0.33400000000000002,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.82499999999999996,"5min":28,"15min":28},"last":0.437},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.76000000000000001,"15min":0.59799999999999998},"min":{"1min":0.46899999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.177,"5min":28.25,"15min":28.25},"last":0.45600000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.84499999999999997,"15min":0.63400000000000001},"min":{"1min":0.437,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.79200000000000004,"5min":34.393000000000001,"15min":34.393000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64200000000000002,"15min":0.58299999999999996},"min":{"1min":0.40500000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84499999999999997,"5min":10.099,"15min":10.099},"last":0.374}]},{"osd":6,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.72999999999999998,"15min":0.621},"min":{"1min":0.45100000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.97999999999999998,"5min":18.271999999999998,"15min":18.271999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.98599999999999999,"15min":0.71599999999999997},"min":{"1min":0.53200000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.369,"5min":47.531999999999996,"15min":47.531999999999996},"last":0.41899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574956,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":357980,"kb_used_data":246356,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94013860,"statfs":{"total":96636764160,"available":96270192640,"internally_reserved":0,"allocated":252268544,"data_stored":252003915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":114293191},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45000000000000001,"15min":0.51200000000000001},"min":{"1min":0.26400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.623,"5min":3.3140000000000001,"15min":3.3140000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.35499999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56599999999999995,"5min":11.619,"15min":11.619},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.5,"15min":0.53600000000000003},"min":{"1min":0.27500000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68899999999999995,"5min":3.468,"15min":3.468},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.56000000000000005},"min":{"1min":0.30599999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.64600000000000002,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.61199999999999999,"15min":0.57399999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":6.327,"5min":11.683999999999999,"15min":11.683999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.58899999999999997,"15min":0.55800000000000005},"min":{"1min":0.32800000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81399999999999995,"5min":11.784000000000001,"15min":11.784000000000001},"last":0.58399999999999996}]},{"osd":3,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":1.071,"15min":0.77300000000000002},"min":{"1min":0.33900000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84499999999999997,"5min":61.121000000000002,"15min":61.121000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.36499999999999999},"max":{"1min":0.80000000000000004,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.60199999999999998}]},{"osd":4,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60299999999999998,"15min":0.54400000000000004},"min":{"1min":0.35099999999999998,"5min":0.27600000000000002,"15min":0.23200000000000001},"max":{"1min":0.91900000000000004,"5min":12.169,"15min":12.169},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.623,"15min":0.57699999999999996},"min":{"1min":0.44700000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85699999999999998,"5min":11.554,"15min":11.554},"last":0.628}]},{"osd":5,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.62,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.26100000000000001,"15min":0.245},"max":{"1min":0.77600000000000002,"5min":11.755000000000001,"15min":11.755000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.40300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.89000000000000001,"5min":3.2879999999999998,"15min":3.2879999999999998},"last":0.65200000000000002}]},{"osd":7,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.96099999999999997,"15min":0.71599999999999997},"min":{"1min":0.48099999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89500000000000002,"5min":29.977,"15min":29.977},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.97299999999999998,"15min":0.71599999999999997},"min":{"1min":0.42399999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.874,"5min":29.925000000000001,"15min":29.925000000000001},"last":0.63800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361852,"kb_used_data":254384,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94009988,"statfs":{"total":96636764160,"available":96266227712,"internally_reserved":0,"allocated":260489216,"data_stored":260237011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.378,"15min":0.36699999999999999},"min":{"1min":0.17799999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.44600000000000001,"5min":4.2839999999999998,"15min":6.9370000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.94999999999999996,"15min":0.54900000000000004},"min":{"1min":0.22,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.48199999999999998,"5min":66.522000000000006,"15min":66.522000000000006},"last":0.28399999999999997}]},{"osd":2,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35299999999999998,"15min":0.34799999999999998},"min":{"1min":0.23999999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53200000000000003,"5min":4.9180000000000001,"15min":4.9180000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41199999999999998,"15min":0.39000000000000001},"min":{"1min":0.247,"5min":0.186,"15min":0.186},"max":{"1min":0.54900000000000004,"5min":4.2060000000000004,"15min":4.2060000000000004},"last":0.25900000000000001}]},{"osd":3,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.60399999999999998,"15min":0.46800000000000003},"min":{"1min":0.26900000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.56999999999999995,"5min":21.943000000000001,"15min":21.943000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.60199999999999998,"15min":0.47699999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.55800000000000005,"5min":23.300999999999998,"15min":23.300999999999998},"last":0.39400000000000002}]},{"osd":4,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.67700000000000005,"15min":0.57899999999999996},"min":{"1min":0.35099999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.94999999999999996,"5min":14.066000000000001,"15min":14.066000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.622,"15min":0.58199999999999996},"min":{"1min":0.44,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.89700000000000002,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":0.46400000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.33300000000000002},"max":{"1min":0.90500000000000003,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.39700000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82499999999999996,"5min":4.9960000000000004,"15min":9.7650000000000006},"last":0.44600000000000001}]},{"osd":6,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64600000000000002,"15min":0.60799999999999998},"min":{"1min":0.46999999999999997,"5min":0.313,"15min":0.313},"max":{"1min":0.83699999999999997,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.78200000000000003,"15min":0.65100000000000002},"min":{"1min":0.438,"5min":0.38400000000000001,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":21.876000000000001,"15min":21.876000000000001},"last":0.56899999999999995}]},{"osd":7,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93200000000000005,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.76100000000000001,"15min":0.65200000000000002},"min":{"1min":0.44,"5min":0.371,"15min":0.36399999999999999},"max":{"1min":1.6850000000000001,"5min":18.754999999999999,"15min":18.754999999999999},"last":0.505}]}]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":373948,"kb_used_data":230384,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":93997892,"statfs":{"total":96636764160,"available":96253841408,"internally_reserved":0,"allocated":235913216,"data_stored":235657142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.375,"15min":0.35899999999999999},"min":{"1min":0.26900000000000002,"5min":0.20200000000000001,"15min":0.17899999999999999},"max":{"1min":1.365,"5min":4.649,"15min":4.649},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39000000000000001,"15min":0.36399999999999999},"min":{"1min":0.23699999999999999,"5min":0.20499999999999999,"15min":0.19400000000000001},"max":{"1min":1.641,"5min":5.1589999999999998,"15min":5.1589999999999998},"last":0.51600000000000001}]},{"osd":2,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38200000000000001},"min":{"1min":0.23699999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.423,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.42899999999999999,"15min":0.40600000000000003},"min":{"1min":0.251,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53700000000000003,"5min":7.6870000000000003,"15min":7.6870000000000003},"last":0.57699999999999996}]},{"osd":3,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.435,"15min":0.39300000000000002},"min":{"1min":0.28000000000000003,"5min":0.23999999999999999,"15min":0.23899999999999999},"max":{"1min":2.0819999999999999,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.47299999999999998,"15min":0.442},"min":{"1min":0.313,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.954,"5min":5.0750000000000002,"15min":5.0750000000000002},"last":0.61799999999999999}]},{"osd":4,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.58099999999999996},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67100000000000004,"5min":5.9729999999999999,"15min":5.9729999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.62,"15min":0.58799999999999997},"min":{"1min":0.35299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.3769999999999998,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.77300000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63400000000000001,"15min":0.63200000000000001},"min":{"1min":0.438,"5min":0.375,"15min":0.32300000000000001},"max":{"1min":1.3939999999999999,"5min":5.1120000000000001,"15min":8.5169999999999995},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65000000000000002,"15min":0.60399999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.84199999999999997,"5min":6.0199999999999996,"15min":6.0199999999999996},"last":0.84699999999999998}]},{"osd":6,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.624,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.4369999999999998,"5min":4.9850000000000003,"15min":4.9850000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.32200000000000001},"max":{"1min":1.4510000000000001,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.79400000000000004}]},{"osd":7,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66200000000000003,"15min":0.66300000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84899999999999998,"5min":6.0720000000000001,"15min":8.4979999999999993},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.65100000000000002,"15min":0.60699999999999998},"min":{"1min":0.47499999999999998,"5min":0.374,"15min":0.374},"max":{"1min":2.411,"5min":4.883,"15min":4.883},"last":0.70199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574959,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188100,"kb_used_data":102840,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94183740,"statfs":{"total":96636764160,"available":96444149760,"internally_reserved":0,"allocated":105308160,"data_stored":105055525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.32600000000000001,"15min":0.82799999999999996},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.79600000000000004,"5min":2.7269999999999999,"15min":18.052},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.371},"min":{"1min":0.222,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.0389999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.311}]},{"osd":1,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33900000000000002,"15min":0.85199999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.82899999999999996,"5min":1.03,"15min":18.175000000000001},"last":0.247},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.64500000000000002},"min":{"1min":0.251,"5min":0.22900000000000001,"15min":0.22700000000000001},"max":{"1min":0.49299999999999999,"5min":0.50800000000000001,"15min":10.23},"last":0.35599999999999998}]},{"osd":3,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.35999999999999999,"15min":0.89200000000000002},"min":{"1min":0.24099999999999999,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":0.84699999999999998,"5min":0.97999999999999998,"15min":18.236000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.42499999999999999,"15min":0.92300000000000004},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":18.004999999999999},"last":0.34300000000000003}]},{"osd":4,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54600000000000004,"15min":0.76900000000000002},"min":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.32100000000000001},"max":{"1min":0.75700000000000001,"5min":1.2589999999999999,"15min":8.1839999999999993},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55500000000000005,"15min":0.58499999999999996},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.518,"5min":1.518,"15min":2.4580000000000002},"last":0.53500000000000003}]},{"osd":5,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54200000000000004,"15min":0.58799999999999997},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.31900000000000001},"max":{"1min":0.80200000000000005,"5min":0.85099999999999998,"15min":8.3520000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":1.075},"min":{"1min":0.38300000000000001,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.81100000000000005,"5min":1.4419999999999999,"15min":18.143999999999998},"last":0.69899999999999995}]},{"osd":6,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":1.1000000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.316},"max":{"1min":0.78100000000000003,"5min":1.012,"15min":18.206},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.77600000000000002},"min":{"1min":0.44,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86899999999999999,"5min":1.3240000000000001,"15min":7.0060000000000002},"last":0.70899999999999996}]},{"osd":7,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.84799999999999998,"5min":0.88100000000000001,"15min":2.3900000000000001},"last":0.747},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68700000000000006,"15min":1.145},"min":{"1min":0.41799999999999998,"5min":0.40500000000000003,"15min":0.39500000000000002},"max":{"1min":2.0339999999999998,"5min":7.9850000000000003,"15min":18.109999999999999},"last":0.75600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574957,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312500,"kb_used_data":182824,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94059340,"statfs":{"total":96636764160,"available":96316764160,"internally_reserved":0,"allocated":187211776,"data_stored":186956203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":132774344},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.435,"15min":0.376},"min":{"1min":0.23999999999999999,"5min":0.17899999999999999,"15min":0.17799999999999999},"max":{"1min":0.65400000000000003,"5min":5.9560000000000004,"15min":5.9560000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.311,"5min":0.89400000000000002,"15min":0.54200000000000004},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.65400000000000003,"5min":55.152999999999999,"15min":55.152999999999999},"last":0.47899999999999998}]},{"osd":1,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.36599999999999999},"min":{"1min":0.217,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.294,"5min":2.323,"15min":2.323},"last":0.501},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.52200000000000002,"15min":0.438},"min":{"1min":0.33800000000000002,"5min":0.245,"15min":0.24399999999999999},"max":{"1min":0.624,"5min":6.0609999999999999,"15min":6.0609999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.46500000000000002,"15min":0.44},"min":{"1min":0.31900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59999999999999998,"5min":4.6840000000000002,"15min":4.6840000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.83699999999999997,"15min":0.55100000000000005},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.3260000000000001,"5min":40.789000000000001,"15min":40.789000000000001},"last":0.55000000000000004}]},{"osd":4,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.1319999999999999,"15min":0.77700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33000000000000002},"max":{"1min":1.1719999999999999,"5min":58.180999999999997,"15min":58.180999999999997},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.629,"15min":0.58199999999999996},"min":{"1min":0.39200000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.94799999999999995,"5min":4.6509999999999998,"15min":4.6509999999999998},"last":0.69999999999999996}]},{"osd":5,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":1.1990000000000001,"15min":0.80000000000000004},"min":{"1min":0.38500000000000001,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":1.21,"5min":60.893999999999998,"15min":60.893999999999998},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66800000000000004,"15min":0.61299999999999999},"min":{"1min":0.43099999999999999,"5min":0.38300000000000001,"15min":0.378},"max":{"1min":1.3540000000000001,"5min":4.2489999999999997,"15min":4.2489999999999997},"last":0.76700000000000002}]},{"osd":6,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.385,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.71399999999999997,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.91800000000000004,"5min":6.1790000000000003,"15min":6.1790000000000003},"last":0.79900000000000004}]},{"osd":7,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.98699999999999999,"15min":0.74299999999999999},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88,"5min":33.006999999999998,"15min":33.006999999999998},"last":0.748},{"interface":"front","average":{"1min":0.60899999999999999,"5min":1.175,"15min":0.80600000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":1.2509999999999999,"5min":56.667999999999999,"15min":56.667999999999999},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574957,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":343192,"kb_used_data":209352,"kb_used_omap":1,"kb_used_meta":133822,"kb_avail":94028648,"statfs":{"total":96636764160,"available":96285335552,"internally_reserved":0,"allocated":214376448,"data_stored":214112441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":137034182},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.495,"15min":0.89600000000000002},"min":{"1min":0.28799999999999998,"5min":0.26300000000000001,"15min":0.23999999999999999},"max":{"1min":3.0310000000000001,"5min":3.306,"15min":32.487000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45300000000000001,"15min":0.51300000000000001},"min":{"1min":0.24399999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.65500000000000003,"5min":1.05,"15min":6.0670000000000002},"last":0.53700000000000003}]},{"osd":1,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.73399999999999999,"15min":0.71499999999999997},"min":{"1min":0.27400000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.66800000000000004,"5min":23.579000000000001,"15min":32.417000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.83099999999999996,"15min":0.96399999999999997},"min":{"1min":0.33100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.70399999999999996,"5min":22.800000000000001,"15min":22.800000000000001},"last":0.36699999999999999}]},{"osd":2,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.60199999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":0.745,"5min":2.6779999999999999,"15min":14.757999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.72199999999999998,"15min":0.65900000000000003},"min":{"1min":0.35299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.72399999999999998,"5min":18.042999999999999,"15min":18.042999999999999},"last":0.56799999999999995}]},{"osd":3,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57699999999999996,"15min":0.73399999999999999},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66900000000000004,"5min":6.1360000000000001,"15min":55.222000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57399999999999995,"15min":0.64000000000000001},"min":{"1min":0.39100000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80600000000000005,"5min":6.3220000000000001,"15min":14.869999999999999},"last":0.39500000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.50800000000000001,"15min":0.56899999999999995},"min":{"1min":0.33300000000000002,"5min":0.26600000000000001,"15min":0.23699999999999999},"max":{"1min":0.77500000000000002,"5min":1.466,"15min":6.508},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.62},"min":{"1min":0.40799999999999997,"5min":0.26500000000000001,"15min":0.24199999999999999},"max":{"1min":0.72899999999999998,"5min":2.403,"15min":6.5270000000000001},"last":0.498}]},{"osd":6,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.497,"15min":0.60399999999999998},"min":{"1min":0.36699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83599999999999997,"5min":0.89100000000000001,"15min":14.805999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.52000000000000002,"15min":0.58799999999999997},"min":{"1min":0.45600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48399999999999999}]},{"osd":7,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.67600000000000005,"15min":0.63500000000000001},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.79100000000000004,"5min":12.135999999999999,"15min":12.135999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.81299999999999994,"15min":0.74099999999999999},"min":{"1min":0.45700000000000002,"5min":0.33300000000000002,"15min":0.29699999999999999},"max":{"1min":0.86199999999999999,"5min":21.465,"15min":21.465},"last":0.58099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574957,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339528,"kb_used_data":209852,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94032312,"statfs":{"total":96636764160,"available":96289087488,"internally_reserved":0,"allocated":214888448,"data_stored":214639791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132774342},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.88900000000000001,"15min":0.65900000000000003},"min":{"1min":0.30499999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.63600000000000001,"5min":48.045999999999999,"15min":48.045999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48599999999999999,"15min":0.52400000000000002},"min":{"1min":0.28899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60199999999999998,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.64700000000000002}]},{"osd":1,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65100000000000002,"5min":3.8959999999999999,"15min":3.8959999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.501,"5min":0.47499999999999998,"15min":0.54900000000000004},"min":{"1min":0.28999999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.755},"last":0.80600000000000005}]},{"osd":2,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.58499999999999996,"15min":0.56399999999999995},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59199999999999997,"5min":13.271000000000001,"15min":13.271000000000001},"last":0.749},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.35899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63500000000000001,"5min":7.141,"15min":7.141},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.93000000000000005,"15min":0.68999999999999995},"min":{"1min":0.33600000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.78200000000000003,"5min":47.875999999999998,"15min":47.875999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.66500000000000004,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.71199999999999997}]},{"osd":4,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51300000000000001,"15min":0.498},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66700000000000004,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.38200000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.74199999999999999,"5min":2.657,"15min":2.657},"last":0.52600000000000002}]},{"osd":6,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57699999999999996,"15min":0.54100000000000004},"min":{"1min":0.374,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82299999999999995,"5min":6.9050000000000002,"15min":6.9050000000000002},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59199999999999997,"15min":0.55400000000000005},"min":{"1min":0.442,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70699999999999996,"5min":5.9770000000000003,"15min":5.9770000000000003},"last":0.61299999999999999}]},{"osd":7,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56899999999999995,"15min":0.55800000000000005},"min":{"1min":0.44700000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80200000000000005,"5min":3.8530000000000002,"15min":3.8530000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.49399999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76700000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.79200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":234893312,"data_stored":234881662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":260059136,"data_stored":260051894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":104857600,"data_stored":104857600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":186781696,"data_stored":186771086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":213925888,"data_stored":213914516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":214462464,"data_stored":214454679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":251817984,"data_stored":251806246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":301993984,"data_stored":301990470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-25T23:44:42.129 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-25T23:44:42.129 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T23:44:42.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.284+0000 7f9a5ced0700 1 -- 172.21.15.81:0/4023068382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a581454f0 msgr2=0x7f9a5814ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:42.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.284+0000 7f9a5ced0700 1 --2- 172.21.15.81:0/4023068382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a581454f0 0x7f9a5814ec20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9a50009fd0 tx=0x7f9a5000b380 comp rx=0 tx=0).stop 2023-10-25T23:44:42.287 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.285+0000 7f9a5ced0700 1 -- 172.21.15.81:0/4023068382 shutdown_connections 2023-10-25T23:44:42.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.285+0000 7f9a5ced0700 1 --2- 172.21.15.81:0/4023068382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a581454f0 0x7f9a5814ec20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.285+0000 7f9a5ced0700 1 --2- 172.21.15.81:0/4023068382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a5806cd80 0x7f9a5814f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.288 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.285+0000 7f9a5ced0700 1 -- 172.21.15.81:0/4023068382 >> 172.21.15.81:0/4023068382 conn(0x7f9a580c0a40 msgr2=0x7f9a580c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:42.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.285+0000 7f9a5ced0700 1 -- 172.21.15.81:0/4023068382 shutdown_connections 2023-10-25T23:44:42.289 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.285+0000 7f9a5ced0700 1 -- 172.21.15.81:0/4023068382 wait complete. 2023-10-25T23:44:42.291 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.286+0000 7f9a5ced0700 1 Processor -- start 2023-10-25T23:44:42.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.286+0000 7f9a5ced0700 1 -- start start 2023-10-25T23:44:42.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.286+0000 7f9a5ced0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5806cd80 0x7f9a58148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:42.292 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.286+0000 7f9a5ced0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a581454f0 0x7f9a5814d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:42.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a5ced0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a5814b220 0x7f9a581e1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:42.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a5ced0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a581e45c0 con 0x7f9a5806cd80 2023-10-25T23:44:42.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a5ced0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a581e4e20 con 0x7f9a5814b220 2023-10-25T23:44:42.293 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a5ced0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5814dec0 con 0x7f9a581454f0 2023-10-25T23:44:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a5659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5806cd80 0x7f9a58148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a5659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5806cd80 0x7f9a58148370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37084/0 (socket says 172.21.15.81:37084) 2023-10-25T23:44:42.294 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a5659c700 1 -- 172.21.15.81:0/3967787854 learned_addr learned my addr 172.21.15.81:0/3967787854 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:42.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a56d9d700 1 --2- 172.21.15.81:0/3967787854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a5814b220 0x7f9a581e1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:42.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a5659c700 1 -- 172.21.15.81:0/3967787854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a581454f0 msgr2=0x7f9a5814d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:42.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a5659c700 1 --2- 172.21.15.81:0/3967787854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a581454f0 0x7f9a5814d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.295 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a5659c700 1 -- 172.21.15.81:0/3967787854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a5814b220 msgr2=0x7f9a581e1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:42.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a5659c700 1 --2- 172.21.15.81:0/3967787854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a5814b220 0x7f9a581e1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a5659c700 1 -- 172.21.15.81:0/3967787854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a50009d00 con 0x7f9a5806cd80 2023-10-25T23:44:42.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a5659c700 1 --2- 172.21.15.81:0/3967787854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5806cd80 0x7f9a58148370 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9a50007b70 tx=0x7f9a50007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:42.296 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a4effd700 1 -- 172.21.15.81:0/3967787854 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5000e040 con 0x7f9a5806cd80 2023-10-25T23:44:42.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a4effd700 1 -- 172.21.15.81:0/3967787854 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9a5001d890 con 0x7f9a5806cd80 2023-10-25T23:44:42.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a5ced0700 1 -- 172.21.15.81:0/3967787854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a58148a20 con 0x7f9a5806cd80 2023-10-25T23:44:42.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a4effd700 1 -- 172.21.15.81:0/3967787854 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5001dca0 con 0x7f9a5806cd80 2023-10-25T23:44:42.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.287+0000 7f9a5ced0700 1 -- 172.21.15.81:0/3967787854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a581e4ab0 con 0x7f9a5806cd80 2023-10-25T23:44:42.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.288+0000 7f9a5ced0700 1 -- 172.21.15.81:0/3967787854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a581e4c40 con 0x7f9a5806cd80 2023-10-25T23:44:42.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.289+0000 7f9a4effd700 1 -- 172.21.15.81:0/3967787854 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9a5001b450 con 0x7f9a5806cd80 2023-10-25T23:44:42.298 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.289+0000 7f9a4effd700 1 --2- 172.21.15.81:0/3967787854 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9a3806aed0 0x7f9a3806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:42.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.289+0000 7f9a4effd700 1 -- 172.21.15.81:0/3967787854 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f9a5008b650 con 0x7f9a5806cd80 2023-10-25T23:44:42.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.289+0000 7f9a55d9b700 1 --2- 172.21.15.81:0/3967787854 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9a3806aed0 0x7f9a3806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:42.299 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.289+0000 7f9a55d9b700 1 --2- 172.21.15.81:0/3967787854 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9a3806aed0 0x7f9a3806d390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9a40005950 tx=0x7f9a400058e0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:42.300 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.293+0000 7f9a4effd700 1 -- 172.21.15.81:0/3967787854 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9a500566e0 con 0x7f9a5806cd80 2023-10-25T23:44:42.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.479+0000 7f9a5ced0700 1 -- 172.21.15.81:0/3967787854 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a58155b00 con 0x7f9a3806aed0 2023-10-25T23:44:42.489 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.488+0000 7f9a4effd700 1 -- 172.21.15.81:0/3967787854 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+294571 (secure 0 0 0) 0x7f9a400097e0 con 0x7f9a3806aed0 2023-10-25T23:44:42.494 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:44:42.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.491+0000 7f9a5ced0700 1 -- 172.21.15.81:0/3967787854 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9a3806aed0 msgr2=0x7f9a3806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:42.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.491+0000 7f9a5ced0700 1 --2- 172.21.15.81:0/3967787854 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9a3806aed0 0x7f9a3806d390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9a40005950 tx=0x7f9a400058e0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.491+0000 7f9a5ced0700 1 -- 172.21.15.81:0/3967787854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5806cd80 msgr2=0x7f9a58148370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:42.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.491+0000 7f9a5ced0700 1 --2- 172.21.15.81:0/3967787854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5806cd80 0x7f9a58148370 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9a50007b70 tx=0x7f9a50007c50 comp rx=0 tx=0).stop 2023-10-25T23:44:42.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.491+0000 7f9a5ced0700 1 -- 172.21.15.81:0/3967787854 shutdown_connections 2023-10-25T23:44:42.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.491+0000 7f9a5ced0700 1 --2- 172.21.15.81:0/3967787854 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f9a3806aed0 0x7f9a3806d390 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.491+0000 7f9a5ced0700 1 --2- 172.21.15.81:0/3967787854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a5814b220 0x7f9a581e1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.491+0000 7f9a5ced0700 1 --2- 172.21.15.81:0/3967787854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5806cd80 0x7f9a58148370 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.501 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.491+0000 7f9a5ced0700 1 --2- 172.21.15.81:0/3967787854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a581454f0 0x7f9a5814d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.491+0000 7f9a5ced0700 1 -- 172.21.15.81:0/3967787854 >> 172.21.15.81:0/3967787854 conn(0x7f9a580c0a40 msgr2=0x7f9a580bb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:42.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.491+0000 7f9a5ced0700 1 -- 172.21.15.81:0/3967787854 shutdown_connections 2023-10-25T23:44:42.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.491+0000 7f9a5ced0700 1 -- 172.21.15.81:0/3967787854 wait complete. 2023-10-25T23:44:42.503 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-25T23:44:42.505 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2023-10-25T23:44:41.119193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":884166692,"num_objects":566,"num_object_clones":0,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":566,"num_whiteouts":0,"num_read":14770,"num_read_kb":532589,"num_write":91898,"num_write_kb":4543617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":344,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":146483,"ondisk_log_size":146483,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2708256,"kb_used_data":1731904,"kb_used_omap":12,"kb_used_meta":976243,"kb_avail":752266464,"statfs":{"total":773094113280,"available":770320859136,"internally_reserved":0,"allocated":1773469696,"data_stored":1771427978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":999673400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":860297,"num_objects":-95,"num_object_clones":-1,"num_object_copies":-190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-95,"num_whiteouts":0,"num_read":6,"num_read_kb":11,"num_write":141,"num_write_kb":1026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002745"},"pg_stats":[{"pgid":"3.3f","version":"38'1937","reported_seq":4535,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.553058+0000","last_change":"2023-10-25T23:44:32.561696+0000","last_active":"2023-10-25T23:44:32.553058+0000","last_peered":"2023-10-25T23:44:32.553058+0000","last_clean":"2023-10-25T23:44:32.553058+0000","last_became_active":"2023-10-25T23:36:09.292007+0000","last_became_peered":"2023-10-25T23:36:09.292007+0000","last_unstale":"2023-10-25T23:44:32.553058+0000","last_undegraded":"2023-10-25T23:44:32.553058+0000","last_fullsized":"2023-10-25T23:44:32.553058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1937,"log_dups_size":0,"ondisk_log_size":1937,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:57:06.053396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14653339800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":3053,"num_write":1182,"num_write_kb":17288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.3e","version":"38'1934","reported_seq":4549,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.490809+0000","last_change":"2023-10-25T23:44:32.496598+0000","last_active":"2023-10-25T23:44:32.490809+0000","last_peered":"2023-10-25T23:44:32.490809+0000","last_clean":"2023-10-25T23:44:32.490809+0000","last_became_active":"2023-10-25T23:36:09.281890+0000","last_became_peered":"2023-10-25T23:36:09.281890+0000","last_unstale":"2023-10-25T23:44:32.490809+0000","last_undegraded":"2023-10-25T23:44:32.490809+0000","last_fullsized":"2023-10-25T23:44:32.490809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1934,"log_dups_size":0,"ondisk_log_size":1934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:22:19.658935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069104454999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":12821,"num_write":1152,"num_write_kb":16010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.3d","version":"38'2031","reported_seq":4609,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.561421+0000","last_change":"2023-10-25T23:44:32.578547+0000","last_active":"2023-10-25T23:44:32.561421+0000","last_peered":"2023-10-25T23:44:32.561421+0000","last_clean":"2023-10-25T23:44:32.561421+0000","last_became_active":"2023-10-25T23:36:09.284066+0000","last_became_peered":"2023-10-25T23:36:09.284066+0000","last_unstale":"2023-10-25T23:44:32.561421+0000","last_undegraded":"2023-10-25T23:44:32.561421+0000","last_fullsized":"2023-10-25T23:44:32.561421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:55:32.290039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.164461575,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":12209,"num_write":1200,"num_write_kb":24347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.3c","version":"38'2078","reported_seq":4756,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.488901+0000","last_change":"2023-10-25T23:44:32.499536+0000","last_active":"2023-10-25T23:44:32.488901+0000","last_peered":"2023-10-25T23:44:32.488901+0000","last_clean":"2023-10-25T23:44:32.488901+0000","last_became_active":"2023-10-25T23:36:09.299585+0000","last_became_peered":"2023-10-25T23:36:09.299585+0000","last_unstale":"2023-10-25T23:44:32.488901+0000","last_undegraded":"2023-10-25T23:44:32.488901+0000","last_fullsized":"2023-10-25T23:44:32.488901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2078,"log_dups_size":0,"ondisk_log_size":2078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:20:50.930557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104514565,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":4442,"num_write":1222,"num_write_kb":17071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.3b","version":"37'2218","reported_seq":4794,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.498046+0000","last_change":"2023-10-25T23:44:32.507952+0000","last_active":"2023-10-25T23:44:32.498046+0000","last_peered":"2023-10-25T23:44:32.498046+0000","last_clean":"2023-10-25T23:44:32.498046+0000","last_became_active":"2023-10-25T23:36:09.287403+0000","last_became_peered":"2023-10-25T23:36:09.287403+0000","last_unstale":"2023-10-25T23:44:32.498046+0000","last_undegraded":"2023-10-25T23:44:32.498046+0000","last_fullsized":"2023-10-25T23:44:32.498046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2218,"log_dups_size":0,"ondisk_log_size":2218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:10:34.048013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.096586196999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":4323,"num_write":1325,"num_write_kb":21852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.3a","version":"38'1924","reported_seq":4534,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.465554+0000","last_change":"2023-10-25T23:44:32.477919+0000","last_active":"2023-10-25T23:44:32.465554+0000","last_peered":"2023-10-25T23:44:32.465554+0000","last_clean":"2023-10-25T23:44:32.465554+0000","last_became_active":"2023-10-25T23:36:09.301305+0000","last_became_peered":"2023-10-25T23:36:09.301305+0000","last_unstale":"2023-10-25T23:44:32.465554+0000","last_undegraded":"2023-10-25T23:44:32.465554+0000","last_fullsized":"2023-10-25T23:44:32.465554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1924,"log_dups_size":0,"ondisk_log_size":1924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:31:23.915991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.083247637999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":4600,"num_write":1162,"num_write_kb":16604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.39","version":"37'2100","reported_seq":4681,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.543812+0000","last_change":"2023-10-25T23:44:32.553007+0000","last_active":"2023-10-25T23:44:32.543812+0000","last_peered":"2023-10-25T23:44:32.543812+0000","last_clean":"2023-10-25T23:44:32.543812+0000","last_became_active":"2023-10-25T23:36:09.293173+0000","last_became_peered":"2023-10-25T23:36:09.293173+0000","last_unstale":"2023-10-25T23:44:32.543812+0000","last_undegraded":"2023-10-25T23:44:32.543812+0000","last_fullsized":"2023-10-25T23:44:32.543812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:07:11.314981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.141433051,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":4028,"num_write":1252,"num_write_kb":24067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.38","version":"37'1943","reported_seq":4557,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.523048+0000","last_change":"2023-10-25T23:44:32.533836+0000","last_active":"2023-10-25T23:44:32.523048+0000","last_peered":"2023-10-25T23:44:32.523048+0000","last_clean":"2023-10-25T23:44:32.523048+0000","last_became_active":"2023-10-25T23:36:09.295518+0000","last_became_peered":"2023-10-25T23:36:09.295518+0000","last_unstale":"2023-10-25T23:44:32.523048+0000","last_undegraded":"2023-10-25T23:44:32.523048+0000","last_fullsized":"2023-10-25T23:44:32.523048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:31:23.915991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12500524399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":4005,"num_write":1156,"num_write_kb":40374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.37","version":"38'2130","reported_seq":4731,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.543773+0000","last_change":"2023-10-25T23:44:32.552979+0000","last_active":"2023-10-25T23:44:32.543773+0000","last_peered":"2023-10-25T23:44:32.543773+0000","last_clean":"2023-10-25T23:44:32.543773+0000","last_became_active":"2023-10-25T23:36:09.297036+0000","last_became_peered":"2023-10-25T23:36:09.297036+0000","last_unstale":"2023-10-25T23:44:32.543773+0000","last_undegraded":"2023-10-25T23:44:32.543773+0000","last_fullsized":"2023-10-25T23:44:32.543773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2130,"log_dups_size":0,"ondisk_log_size":2130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:09:03.392402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13789567699999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":8236,"num_write":1280,"num_write_kb":21230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.36","version":"38'1975","reported_seq":4589,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.511036+0000","last_change":"2023-10-25T23:44:39.516062+0000","last_active":"2023-10-25T23:44:39.511036+0000","last_peered":"2023-10-25T23:44:39.511036+0000","last_clean":"2023-10-25T23:44:39.511036+0000","last_became_active":"2023-10-25T23:36:09.297713+0000","last_became_peered":"2023-10-25T23:36:09.297713+0000","last_unstale":"2023-10-25T23:44:39.511036+0000","last_undegraded":"2023-10-25T23:44:39.511036+0000","last_fullsized":"2023-10-25T23:44:39.511036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:15:18.383242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052261503000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":4128,"num_write":1151,"num_write_kb":8179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.35","version":"38'2156","reported_seq":4751,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.516150+0000","last_change":"2023-10-25T23:44:39.519698+0000","last_active":"2023-10-25T23:44:39.516150+0000","last_peered":"2023-10-25T23:44:39.516150+0000","last_clean":"2023-10-25T23:44:39.516150+0000","last_became_active":"2023-10-25T23:36:50.071605+0000","last_became_peered":"2023-10-25T23:36:50.071605+0000","last_unstale":"2023-10-25T23:44:39.516150+0000","last_undegraded":"2023-10-25T23:44:39.516150+0000","last_fullsized":"2023-10-25T23:44:39.516150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2156,"log_dups_size":0,"ondisk_log_size":2156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:06.976880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056199102000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":4889,"num_write":1231,"num_write_kb":19417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.34","version":"38'2098","reported_seq":4702,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.965924+0000","last_change":"2023-10-25T23:44:38.977002+0000","last_active":"2023-10-25T23:44:38.965924+0000","last_peered":"2023-10-25T23:44:38.965924+0000","last_clean":"2023-10-25T23:44:38.965924+0000","last_became_active":"2023-10-25T23:36:09.291351+0000","last_became_peered":"2023-10-25T23:36:09.291351+0000","last_unstale":"2023-10-25T23:44:38.965924+0000","last_undegraded":"2023-10-25T23:44:38.965924+0000","last_fullsized":"2023-10-25T23:44:38.965924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2098,"log_dups_size":0,"ondisk_log_size":2098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:56:29.776633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104157445,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":4997,"num_write":1220,"num_write_kb":33278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.33","version":"38'2031","reported_seq":4624,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.544814+0000","last_change":"2023-10-25T23:44:32.558944+0000","last_active":"2023-10-25T23:44:32.544814+0000","last_peered":"2023-10-25T23:44:32.544814+0000","last_clean":"2023-10-25T23:44:32.544814+0000","last_became_active":"2023-10-25T23:36:09.289895+0000","last_became_peered":"2023-10-25T23:36:09.289895+0000","last_unstale":"2023-10-25T23:44:32.544814+0000","last_undegraded":"2023-10-25T23:44:32.544814+0000","last_fullsized":"2023-10-25T23:44:32.544814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:10:34.048013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14974707600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":8364,"num_write":1160,"num_write_kb":24700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.32","version":"38'2055","reported_seq":4664,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.535407+0000","last_change":"2023-10-25T23:44:32.546559+0000","last_active":"2023-10-25T23:44:32.535407+0000","last_peered":"2023-10-25T23:44:32.535407+0000","last_clean":"2023-10-25T23:44:32.535407+0000","last_became_active":"2023-10-25T23:36:09.283250+0000","last_became_peered":"2023-10-25T23:36:09.283250+0000","last_unstale":"2023-10-25T23:44:32.535407+0000","last_undegraded":"2023-10-25T23:44:32.535407+0000","last_fullsized":"2023-10-25T23:44:32.535407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2055,"log_dups_size":0,"ondisk_log_size":2055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:56:24.250407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13307770899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":4523,"num_write":1222,"num_write_kb":24181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.31","version":"37'2096","reported_seq":4691,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.466308+0000","last_change":"2023-10-25T23:44:32.474468+0000","last_active":"2023-10-25T23:44:32.466308+0000","last_peered":"2023-10-25T23:44:32.466308+0000","last_clean":"2023-10-25T23:44:32.466308+0000","last_became_active":"2023-10-25T23:36:09.286191+0000","last_became_peered":"2023-10-25T23:36:09.286191+0000","last_unstale":"2023-10-25T23:44:32.466308+0000","last_undegraded":"2023-10-25T23:44:32.466308+0000","last_fullsized":"2023-10-25T23:44:32.466308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2096,"log_dups_size":0,"ondisk_log_size":2096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:44:40.385223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055128609000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":4088,"num_write":1280,"num_write_kb":29409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.30","version":"38'2065","reported_seq":4671,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.467034+0000","last_change":"2023-10-25T23:44:32.467034+0000","last_active":"2023-10-25T23:44:32.467034+0000","last_peered":"2023-10-25T23:44:32.467034+0000","last_clean":"2023-10-25T23:44:32.467034+0000","last_became_active":"2023-10-25T23:36:09.301040+0000","last_became_peered":"2023-10-25T23:36:09.301040+0000","last_unstale":"2023-10-25T23:44:32.467034+0000","last_undegraded":"2023-10-25T23:44:32.467034+0000","last_fullsized":"2023-10-25T23:44:32.467034+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:14:14.520328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.072495613,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":14548,"num_write":1224,"num_write_kb":47800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.2f","version":"38'2110","reported_seq":4750,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.901148+0000","last_change":"2023-10-25T23:44:38.906227+0000","last_active":"2023-10-25T23:44:38.901148+0000","last_peered":"2023-10-25T23:44:38.901148+0000","last_clean":"2023-10-25T23:44:38.901148+0000","last_became_active":"2023-10-25T23:36:50.103220+0000","last_became_peered":"2023-10-25T23:36:50.103220+0000","last_unstale":"2023-10-25T23:44:38.901148+0000","last_undegraded":"2023-10-25T23:44:38.901148+0000","last_fullsized":"2023-10-25T23:44:38.901148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2110,"log_dups_size":0,"ondisk_log_size":2110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:48:12.956766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033066291999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":8493,"num_write":1280,"num_write_kb":14868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.2e","version":"37'1999","reported_seq":4610,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.902731+0000","last_change":"2023-10-25T23:44:38.907165+0000","last_active":"2023-10-25T23:44:38.902731+0000","last_peered":"2023-10-25T23:44:38.902731+0000","last_clean":"2023-10-25T23:44:38.902731+0000","last_became_active":"2023-10-25T23:36:09.282282+0000","last_became_peered":"2023-10-25T23:36:09.282282+0000","last_unstale":"2023-10-25T23:44:38.902731+0000","last_undegraded":"2023-10-25T23:44:38.902731+0000","last_fullsized":"2023-10-25T23:44:38.902731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1999,"log_dups_size":0,"ondisk_log_size":1999,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:37:04.361378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033856860000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":3064,"num_write":1152,"num_write_kb":24838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.2d","version":"38'2186","reported_seq":4774,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.508072+0000","last_change":"2023-10-25T23:44:32.524616+0000","last_active":"2023-10-25T23:44:32.508072+0000","last_peered":"2023-10-25T23:44:32.508072+0000","last_clean":"2023-10-25T23:44:32.508072+0000","last_became_active":"2023-10-25T23:36:09.289457+0000","last_became_peered":"2023-10-25T23:36:09.289457+0000","last_unstale":"2023-10-25T23:44:32.508072+0000","last_undegraded":"2023-10-25T23:44:32.508072+0000","last_fullsized":"2023-10-25T23:44:32.508072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2186,"log_dups_size":0,"ondisk_log_size":2186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:22:15.481808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.110731284,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":8808,"num_write":1334,"num_write_kb":38138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.1f","version":"38'365","reported_seq":398,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.416028+0000","last_change":"2023-10-25T23:36:08.271164+0000","last_active":"2023-10-25T23:44:32.416028+0000","last_peered":"2023-10-25T23:44:32.416028+0000","last_clean":"2023-10-25T23:44:32.416028+0000","last_became_active":"2023-10-25T23:36:08.270911+0000","last_became_peered":"2023-10-25T23:36:08.270911+0000","last_unstale":"2023-10-25T23:44:32.416028+0000","last_undegraded":"2023-10-25T23:44:32.416028+0000","last_fullsized":"2023-10-25T23:44:32.416028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33555014,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":323,"num_write_kb":78531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"37'1980","reported_seq":4553,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.544866+0000","last_change":"2023-10-25T23:44:32.558952+0000","last_active":"2023-10-25T23:44:32.544866+0000","last_peered":"2023-10-25T23:44:32.544866+0000","last_clean":"2023-10-25T23:44:32.544866+0000","last_became_active":"2023-10-25T23:36:09.290260+0000","last_became_peered":"2023-10-25T23:36:09.290260+0000","last_unstale":"2023-10-25T23:44:32.544866+0000","last_undegraded":"2023-10-25T23:44:32.544866+0000","last_fullsized":"2023-10-25T23:44:32.544866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:20:50.930557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14940374000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":3083,"num_write":1169,"num_write_kb":11022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.1e","version":"34'636","reported_seq":669,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:27.867853+0000","last_change":"2023-10-25T23:36:08.269993+0000","last_active":"2023-10-25T23:44:27.867853+0000","last_peered":"2023-10-25T23:44:27.867853+0000","last_clean":"2023-10-25T23:44:27.867853+0000","last_became_active":"2023-10-25T23:36:08.269443+0000","last_became_peered":"2023-10-25T23:36:08.269443+0000","last_unstale":"2023-10-25T23:44:27.867853+0000","last_undegraded":"2023-10-25T23:44:27.867853+0000","last_fullsized":"2023-10-25T23:44:27.867853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":598,"num_write_kb":86544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"38'1958","reported_seq":4573,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.561470+0000","last_change":"2023-10-25T23:44:32.578618+0000","last_active":"2023-10-25T23:44:32.561470+0000","last_peered":"2023-10-25T23:44:32.561470+0000","last_clean":"2023-10-25T23:44:32.561470+0000","last_became_active":"2023-10-25T23:36:09.299738+0000","last_became_peered":"2023-10-25T23:36:09.299738+0000","last_unstale":"2023-10-25T23:44:32.561470+0000","last_undegraded":"2023-10-25T23:44:32.561470+0000","last_fullsized":"2023-10-25T23:44:32.561470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1958,"log_dups_size":0,"ondisk_log_size":1958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:57:05.654538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.162662744,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":3695,"num_write":1175,"num_write_kb":20733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.1d","version":"36'607","reported_seq":639,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:27.996233+0000","last_change":"2023-10-25T23:36:08.273879+0000","last_active":"2023-10-25T23:44:27.996233+0000","last_peered":"2023-10-25T23:44:27.996233+0000","last_clean":"2023-10-25T23:44:27.996233+0000","last_became_active":"2023-10-25T23:36:08.273574+0000","last_became_peered":"2023-10-25T23:36:08.273574+0000","last_unstale":"2023-10-25T23:44:27.996233+0000","last_undegraded":"2023-10-25T23:44:27.996233+0000","last_fullsized":"2023-10-25T23:44:27.996233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:27.340205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":582,"num_write_kb":140942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"38'2150","reported_seq":4731,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.488850+0000","last_change":"2023-10-25T23:44:32.488850+0000","last_active":"2023-10-25T23:44:32.488850+0000","last_peered":"2023-10-25T23:44:32.488850+0000","last_clean":"2023-10-25T23:44:32.488850+0000","last_became_active":"2023-10-25T23:36:09.299916+0000","last_became_peered":"2023-10-25T23:36:09.299916+0000","last_unstale":"2023-10-25T23:44:32.488850+0000","last_undegraded":"2023-10-25T23:44:32.488850+0000","last_fullsized":"2023-10-25T23:44:32.488850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2150,"log_dups_size":0,"ondisk_log_size":2150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:43:16.830999+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.094041616999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":4255,"num_write":1272,"num_write_kb":13349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.1c","version":"36'393","reported_seq":425,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:27.995399+0000","last_change":"2023-10-25T23:36:08.271714+0000","last_active":"2023-10-25T23:44:27.995399+0000","last_peered":"2023-10-25T23:44:27.995399+0000","last_clean":"2023-10-25T23:44:27.995399+0000","last_became_active":"2023-10-25T23:36:08.271442+0000","last_became_peered":"2023-10-25T23:36:08.271442+0000","last_unstale":"2023-10-25T23:44:27.995399+0000","last_undegraded":"2023-10-25T23:44:27.995399+0000","last_fullsized":"2023-10-25T23:44:27.995399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":379,"num_write_kb":83039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"38'2004","reported_seq":4614,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.488957+0000","last_change":"2023-10-25T23:44:32.499523+0000","last_active":"2023-10-25T23:44:32.488957+0000","last_peered":"2023-10-25T23:44:32.488957+0000","last_clean":"2023-10-25T23:44:32.488957+0000","last_became_active":"2023-10-25T23:36:09.299130+0000","last_became_peered":"2023-10-25T23:36:09.299130+0000","last_unstale":"2023-10-25T23:44:32.488957+0000","last_undegraded":"2023-10-25T23:44:32.488957+0000","last_fullsized":"2023-10-25T23:44:32.488957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2004,"log_dups_size":0,"ondisk_log_size":2004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:58:37.312724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104430467,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":3649,"num_write":1196,"num_write_kb":32686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.1b","version":"37'452","reported_seq":484,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.487083+0000","last_change":"2023-10-25T23:36:08.271119+0000","last_active":"2023-10-25T23:44:28.487083+0000","last_peered":"2023-10-25T23:44:28.487083+0000","last_clean":"2023-10-25T23:44:28.487083+0000","last_became_active":"2023-10-25T23:36:08.270138+0000","last_became_peered":"2023-10-25T23:36:08.270138+0000","last_unstale":"2023-10-25T23:44:28.487083+0000","last_undegraded":"2023-10-25T23:44:28.487083+0000","last_fullsized":"2023-10-25T23:44:28.487083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":475,"num_write_kb":111638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"38'2147","reported_seq":4757,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.956082+0000","last_change":"2023-10-25T23:44:38.965871+0000","last_active":"2023-10-25T23:44:38.956082+0000","last_peered":"2023-10-25T23:44:38.956082+0000","last_clean":"2023-10-25T23:44:38.956082+0000","last_became_active":"2023-10-25T23:36:09.287455+0000","last_became_peered":"2023-10-25T23:36:09.287455+0000","last_unstale":"2023-10-25T23:44:38.956082+0000","last_undegraded":"2023-10-25T23:44:38.956082+0000","last_fullsized":"2023-10-25T23:44:38.956082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2147,"log_dups_size":0,"ondisk_log_size":2147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:18.862050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.093404585999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":5171,"num_write":1282,"num_write_kb":34019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.1a","version":"37'538","reported_seq":572,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.948030+0000","last_change":"2023-10-25T23:36:08.272686+0000","last_active":"2023-10-25T23:44:37.948030+0000","last_peered":"2023-10-25T23:44:37.948030+0000","last_clean":"2023-10-25T23:44:37.948030+0000","last_became_active":"2023-10-25T23:36:08.271974+0000","last_became_peered":"2023-10-25T23:36:08.271974+0000","last_unstale":"2023-10-25T23:44:37.948030+0000","last_undegraded":"2023-10-25T23:44:37.948030+0000","last_fullsized":"2023-10-25T23:44:37.948030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":503,"num_write_kb":90640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"38'2093","reported_seq":4662,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.578662+0000","last_change":"2023-10-25T23:44:32.588835+0000","last_active":"2023-10-25T23:44:32.578662+0000","last_peered":"2023-10-25T23:44:32.578662+0000","last_clean":"2023-10-25T23:44:32.578662+0000","last_became_active":"2023-10-25T23:36:09.294176+0000","last_became_peered":"2023-10-25T23:36:09.294176+0000","last_unstale":"2023-10-25T23:44:32.578662+0000","last_undegraded":"2023-10-25T23:44:32.578662+0000","last_fullsized":"2023-10-25T23:44:32.578662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2093,"log_dups_size":0,"ondisk_log_size":2093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:15:01.855063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17501277800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":27232,"num_write":1210,"num_write_kb":20727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.19","version":"37'246","reported_seq":278,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.178636+0000","last_change":"2023-10-25T23:36:08.273513+0000","last_active":"2023-10-25T23:44:32.178636+0000","last_peered":"2023-10-25T23:44:32.178636+0000","last_clean":"2023-10-25T23:44:32.178636+0000","last_became_active":"2023-10-25T23:36:08.273035+0000","last_became_peered":"2023-10-25T23:36:08.273035+0000","last_unstale":"2023-10-25T23:44:32.178636+0000","last_undegraded":"2023-10-25T23:44:32.178636+0000","last_fullsized":"2023-10-25T23:44:32.178636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:21:29.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18998254,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":221,"num_write_kb":78125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"38'2316","reported_seq":4888,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.522977+0000","last_change":"2023-10-25T23:44:32.533846+0000","last_active":"2023-10-25T23:44:32.522977+0000","last_peered":"2023-10-25T23:44:32.522977+0000","last_clean":"2023-10-25T23:44:32.522977+0000","last_became_active":"2023-10-25T23:36:09.292546+0000","last_became_peered":"2023-10-25T23:36:09.292546+0000","last_unstale":"2023-10-25T23:44:32.522977+0000","last_undegraded":"2023-10-25T23:44:32.522977+0000","last_fullsized":"2023-10-25T23:44:32.522977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2316,"log_dups_size":0,"ondisk_log_size":2316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:43:16.830999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12497243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":23958,"num_write":1360,"num_write_kb":38473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.18","version":"36'1017","reported_seq":1049,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.139975+0000","last_change":"2023-10-25T23:36:08.277462+0000","last_active":"2023-10-25T23:44:28.139975+0000","last_peered":"2023-10-25T23:44:28.139975+0000","last_clean":"2023-10-25T23:44:28.139975+0000","last_became_active":"2023-10-25T23:36:08.277138+0000","last_became_peered":"2023-10-25T23:36:08.277138+0000","last_unstale":"2023-10-25T23:44:28.139975+0000","last_undegraded":"2023-10-25T23:44:28.139975+0000","last_fullsized":"2023-10-25T23:44:28.139975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:48:32.291671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":989,"num_write_kb":120913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"37'2057","reported_seq":4644,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.474714+0000","last_change":"2023-10-25T23:44:32.483491+0000","last_active":"2023-10-25T23:44:32.474714+0000","last_peered":"2023-10-25T23:44:32.474714+0000","last_clean":"2023-10-25T23:44:32.474714+0000","last_became_active":"2023-10-25T23:36:09.290456+0000","last_became_peered":"2023-10-25T23:36:09.290456+0000","last_unstale":"2023-10-25T23:44:32.474714+0000","last_undegraded":"2023-10-25T23:44:32.474714+0000","last_fullsized":"2023-10-25T23:44:32.474714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2057,"log_dups_size":0,"ondisk_log_size":2057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:58:04.342558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063862070000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":31667,"num_write":1204,"num_write_kb":33454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.17","version":"38'354","reported_seq":463,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.948090+0000","last_change":"2023-10-25T23:36:08.272869+0000","last_active":"2023-10-25T23:44:37.948090+0000","last_peered":"2023-10-25T23:44:37.948090+0000","last_clean":"2023-10-25T23:44:37.948090+0000","last_became_active":"2023-10-25T23:36:08.272120+0000","last_became_peered":"2023-10-25T23:36:08.272120+0000","last_unstale":"2023-10-25T23:44:37.948090+0000","last_undegraded":"2023-10-25T23:44:37.948090+0000","last_fullsized":"2023-10-25T23:44:37.948090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21516605,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":83,"num_read_kb":580,"num_write":347,"num_write_kb":84046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"38'2003","reported_seq":4594,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.499624+0000","last_change":"2023-10-25T23:44:32.509416+0000","last_active":"2023-10-25T23:44:32.499624+0000","last_peered":"2023-10-25T23:44:32.499624+0000","last_clean":"2023-10-25T23:44:32.499624+0000","last_became_active":"2023-10-25T23:36:09.293132+0000","last_became_peered":"2023-10-25T23:36:09.293132+0000","last_unstale":"2023-10-25T23:44:32.499624+0000","last_undegraded":"2023-10-25T23:44:32.499624+0000","last_fullsized":"2023-10-25T23:44:32.499624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2003,"log_dups_size":0,"ondisk_log_size":2003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:15:03.433377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11400234099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":3351,"num_write":1194,"num_write_kb":12593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.16","version":"38'676","reported_seq":708,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.394602+0000","last_change":"2023-10-25T23:36:08.272920+0000","last_active":"2023-10-25T23:44:32.394602+0000","last_peered":"2023-10-25T23:44:32.394602+0000","last_clean":"2023-10-25T23:44:32.394602+0000","last_became_active":"2023-10-25T23:36:08.272596+0000","last_became_peered":"2023-10-25T23:36:08.272596+0000","last_unstale":"2023-10-25T23:44:32.394602+0000","last_undegraded":"2023-10-25T23:44:32.394602+0000","last_fullsized":"2023-10-25T23:44:32.394602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":681,"num_write_kb":114510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"38'2403","reported_seq":4854,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.578599+0000","last_change":"2023-10-25T23:44:32.588826+0000","last_active":"2023-10-25T23:44:32.578599+0000","last_peered":"2023-10-25T23:44:32.578599+0000","last_clean":"2023-10-25T23:44:32.578599+0000","last_became_active":"2023-10-25T23:36:09.299938+0000","last_became_peered":"2023-10-25T23:36:09.299938+0000","last_unstale":"2023-10-25T23:44:32.578599+0000","last_undegraded":"2023-10-25T23:44:32.578599+0000","last_fullsized":"2023-10-25T23:44:32.578599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2403,"log_dups_size":0,"ondisk_log_size":2403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:18:14.857365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.172680212,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":3949,"num_write":1292,"num_write_kb":20710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.15","version":"38'671","reported_seq":703,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.419765+0000","last_change":"2023-10-25T23:36:08.279751+0000","last_active":"2023-10-25T23:44:32.419765+0000","last_peered":"2023-10-25T23:44:32.419765+0000","last_clean":"2023-10-25T23:44:32.419765+0000","last_became_active":"2023-10-25T23:36:08.279509+0000","last_became_peered":"2023-10-25T23:36:08.279509+0000","last_unstale":"2023-10-25T23:44:32.419765+0000","last_undegraded":"2023-10-25T23:44:32.419765+0000","last_fullsized":"2023-10-25T23:44:32.419765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":671,"log_dups_size":0,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":674,"num_write_kb":75677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"37'2100","reported_seq":4713,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.956038+0000","last_change":"2023-10-25T23:44:38.965806+0000","last_active":"2023-10-25T23:44:38.956038+0000","last_peered":"2023-10-25T23:44:38.956038+0000","last_clean":"2023-10-25T23:44:38.956038+0000","last_became_active":"2023-10-25T23:36:09.285196+0000","last_became_peered":"2023-10-25T23:36:09.285196+0000","last_unstale":"2023-10-25T23:44:38.956038+0000","last_undegraded":"2023-10-25T23:44:38.956038+0000","last_fullsized":"2023-10-25T23:44:38.956038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:57:33.172851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.093006917999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":5156,"num_write":1232,"num_write_kb":26142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.14","version":"37'525","reported_seq":559,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.948109+0000","last_change":"2023-10-25T23:36:08.272911+0000","last_active":"2023-10-25T23:44:37.948109+0000","last_peered":"2023-10-25T23:44:37.948109+0000","last_clean":"2023-10-25T23:44:37.948109+0000","last_became_active":"2023-10-25T23:36:08.272248+0000","last_became_peered":"2023-10-25T23:36:08.272248+0000","last_unstale":"2023-10-25T23:44:37.948109+0000","last_undegraded":"2023-10-25T23:44:37.948109+0000","last_fullsized":"2023-10-25T23:44:37.948109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166496,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":486,"num_write_kb":123603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"38'2004","reported_seq":4609,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.524715+0000","last_change":"2023-10-25T23:44:32.534402+0000","last_active":"2023-10-25T23:44:32.524715+0000","last_peered":"2023-10-25T23:44:32.524715+0000","last_clean":"2023-10-25T23:44:32.524715+0000","last_became_active":"2023-10-25T23:36:09.292300+0000","last_became_peered":"2023-10-25T23:36:09.292300+0000","last_unstale":"2023-10-25T23:44:32.524715+0000","last_undegraded":"2023-10-25T23:44:32.524715+0000","last_fullsized":"2023-10-25T23:44:32.524715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2004,"log_dups_size":0,"ondisk_log_size":2004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:25:10.694319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11980879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":3691,"num_write":1193,"num_write_kb":20847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.13","version":"36'212","reported_seq":244,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.472556+0000","last_change":"2023-10-25T23:36:08.274407+0000","last_active":"2023-10-25T23:44:28.472556+0000","last_peered":"2023-10-25T23:44:28.472556+0000","last_clean":"2023-10-25T23:44:28.472556+0000","last_became_active":"2023-10-25T23:36:08.274162+0000","last_became_peered":"2023-10-25T23:36:08.274162+0000","last_unstale":"2023-10-25T23:44:28.472556+0000","last_undegraded":"2023-10-25T23:44:28.472556+0000","last_fullsized":"2023-10-25T23:44:28.472556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360162,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":202,"num_write_kb":93162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"38'2303","reported_seq":4780,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.525183+0000","last_change":"2023-10-25T23:44:32.535345+0000","last_active":"2023-10-25T23:44:32.525183+0000","last_peered":"2023-10-25T23:44:32.525183+0000","last_clean":"2023-10-25T23:44:32.525183+0000","last_became_active":"2023-10-25T23:36:09.284386+0000","last_became_peered":"2023-10-25T23:36:09.284386+0000","last_unstale":"2023-10-25T23:44:32.525183+0000","last_undegraded":"2023-10-25T23:44:32.525183+0000","last_fullsized":"2023-10-25T23:44:32.525183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2303,"log_dups_size":0,"ondisk_log_size":2303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:25:24.082691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.122095678,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":8533,"num_write":1240,"num_write_kb":24417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.12","version":"35'180","reported_seq":212,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.140009+0000","last_change":"2023-10-25T23:36:08.271565+0000","last_active":"2023-10-25T23:44:28.140009+0000","last_peered":"2023-10-25T23:44:28.140009+0000","last_clean":"2023-10-25T23:44:28.140009+0000","last_became_active":"2023-10-25T23:36:08.271188+0000","last_became_peered":"2023-10-25T23:36:08.271188+0000","last_unstale":"2023-10-25T23:44:28.140009+0000","last_undegraded":"2023-10-25T23:44:28.140009+0000","last_fullsized":"2023-10-25T23:44:28.140009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:51:48.005011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":160,"num_write_kb":61795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"37'2148","reported_seq":4727,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.508023+0000","last_change":"2023-10-25T23:44:32.524610+0000","last_active":"2023-10-25T23:44:32.508023+0000","last_peered":"2023-10-25T23:44:32.508023+0000","last_clean":"2023-10-25T23:44:32.508023+0000","last_became_active":"2023-10-25T23:36:09.294200+0000","last_became_peered":"2023-10-25T23:36:09.294200+0000","last_unstale":"2023-10-25T23:44:32.508023+0000","last_undegraded":"2023-10-25T23:44:32.508023+0000","last_fullsized":"2023-10-25T23:44:32.508023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2148,"log_dups_size":0,"ondisk_log_size":2148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:58:37.312724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11302248199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":3992,"num_write":1263,"num_write_kb":18428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.11","version":"37'389","reported_seq":423,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.949534+0000","last_change":"2023-10-25T23:36:08.273427+0000","last_active":"2023-10-25T23:44:37.949534+0000","last_peered":"2023-10-25T23:44:37.949534+0000","last_clean":"2023-10-25T23:44:37.949534+0000","last_became_active":"2023-10-25T23:36:08.272301+0000","last_became_peered":"2023-10-25T23:36:08.272301+0000","last_unstale":"2023-10-25T23:44:37.949534+0000","last_undegraded":"2023-10-25T23:44:37.949534+0000","last_fullsized":"2023-10-25T23:44:37.949534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":376,"num_write_kb":99496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"38'2009","reported_seq":4631,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.502533+0000","last_change":"2023-10-25T23:44:39.507532+0000","last_active":"2023-10-25T23:44:39.502533+0000","last_peered":"2023-10-25T23:44:39.502533+0000","last_clean":"2023-10-25T23:44:39.502533+0000","last_became_active":"2023-10-25T23:36:09.291305+0000","last_became_peered":"2023-10-25T23:36:09.291305+0000","last_unstale":"2023-10-25T23:44:39.502533+0000","last_undegraded":"2023-10-25T23:44:39.502533+0000","last_fullsized":"2023-10-25T23:44:39.502533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:35:20.916506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044631746999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":3822,"num_write":1210,"num_write_kb":15603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.10","version":"36'336","reported_seq":370,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.871585+0000","last_change":"2023-10-25T23:36:08.277621+0000","last_active":"2023-10-25T23:44:37.871585+0000","last_peered":"2023-10-25T23:44:37.871585+0000","last_clean":"2023-10-25T23:44:37.871585+0000","last_became_active":"2023-10-25T23:36:08.277327+0000","last_became_peered":"2023-10-25T23:36:08.277327+0000","last_unstale":"2023-10-25T23:44:37.871585+0000","last_undegraded":"2023-10-25T23:44:37.871585+0000","last_fullsized":"2023-10-25T23:44:37.871585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:04.918703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":349,"num_write_kb":89245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"38'2078","reported_seq":4705,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.497526+0000","last_change":"2023-10-25T23:44:32.507949+0000","last_active":"2023-10-25T23:44:32.497526+0000","last_peered":"2023-10-25T23:44:32.497526+0000","last_clean":"2023-10-25T23:44:32.497526+0000","last_became_active":"2023-10-25T23:36:09.295231+0000","last_became_peered":"2023-10-25T23:36:09.295231+0000","last_unstale":"2023-10-25T23:44:32.497526+0000","last_undegraded":"2023-10-25T23:44:32.497526+0000","last_fullsized":"2023-10-25T23:44:32.497526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2078,"log_dups_size":0,"ondisk_log_size":2078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:20:50.930557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.096538947,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":12104,"num_write":1268,"num_write_kb":24673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.f","version":"36'388","reported_seq":422,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.871300+0000","last_change":"2023-10-25T23:36:08.263573+0000","last_active":"2023-10-25T23:44:37.871300+0000","last_peered":"2023-10-25T23:44:37.871300+0000","last_clean":"2023-10-25T23:44:37.871300+0000","last_became_active":"2023-10-25T23:36:08.263264+0000","last_became_peered":"2023-10-25T23:36:08.263264+0000","last_unstale":"2023-10-25T23:44:37.871300+0000","last_undegraded":"2023-10-25T23:44:37.871300+0000","last_fullsized":"2023-10-25T23:44:37.871300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554454,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":368,"num_write_kb":90831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"38'2065","reported_seq":4672,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.524666+0000","last_change":"2023-10-25T23:44:32.534422+0000","last_active":"2023-10-25T23:44:32.524666+0000","last_peered":"2023-10-25T23:44:32.524666+0000","last_clean":"2023-10-25T23:44:32.524666+0000","last_became_active":"2023-10-25T23:36:09.294298+0000","last_became_peered":"2023-10-25T23:36:09.294298+0000","last_unstale":"2023-10-25T23:44:32.524666+0000","last_undegraded":"2023-10-25T23:44:32.524666+0000","last_fullsized":"2023-10-25T23:44:32.524666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2065,"log_dups_size":0,"ondisk_log_size":2065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:15:03.433377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12011416900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":8972,"num_write":1223,"num_write_kb":21636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.4","version":"37'318","reported_seq":351,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:31.099513+0000","last_change":"2023-10-25T23:36:08.277383+0000","last_active":"2023-10-25T23:44:31.099513+0000","last_peered":"2023-10-25T23:44:31.099513+0000","last_clean":"2023-10-25T23:44:31.099513+0000","last_became_active":"2023-10-25T23:36:08.277087+0000","last_became_peered":"2023-10-25T23:36:08.277087+0000","last_unstale":"2023-10-25T23:44:31.099513+0000","last_undegraded":"2023-10-25T23:44:31.099513+0000","last_fullsized":"2023-10-25T23:44:31.099513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":307,"num_write_kb":115956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"38'2151","reported_seq":4738,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.499581+0000","last_change":"2023-10-25T23:44:32.509417+0000","last_active":"2023-10-25T23:44:32.499581+0000","last_peered":"2023-10-25T23:44:32.499581+0000","last_clean":"2023-10-25T23:44:32.499581+0000","last_became_active":"2023-10-25T23:36:50.069951+0000","last_became_peered":"2023-10-25T23:36:50.069951+0000","last_unstale":"2023-10-25T23:44:32.499581+0000","last_undegraded":"2023-10-25T23:44:32.499581+0000","last_fullsized":"2023-10-25T23:44:32.499581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2151,"log_dups_size":0,"ondisk_log_size":2151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:22:15.481808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.114189366,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":24659,"num_write":1256,"num_write_kb":46504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.2","version":"36'293","reported_seq":326,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:31.105686+0000","last_change":"2023-10-25T23:36:08.279568+0000","last_active":"2023-10-25T23:44:31.105686+0000","last_peered":"2023-10-25T23:44:31.105686+0000","last_clean":"2023-10-25T23:44:31.105686+0000","last_became_active":"2023-10-25T23:36:08.279302+0000","last_became_peered":"2023-10-25T23:36:08.279302+0000","last_unstale":"2023-10-25T23:44:31.105686+0000","last_undegraded":"2023-10-25T23:44:31.105686+0000","last_fullsized":"2023-10-25T23:44:31.105686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:27.340205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":257,"num_write_kb":101207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"37'2033","reported_seq":4663,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.965867+0000","last_change":"2023-10-25T23:44:38.976975+0000","last_active":"2023-10-25T23:44:38.965867+0000","last_peered":"2023-10-25T23:44:38.965867+0000","last_clean":"2023-10-25T23:44:38.965867+0000","last_became_active":"2023-10-25T23:36:09.292670+0000","last_became_peered":"2023-10-25T23:36:09.292670+0000","last_unstale":"2023-10-25T23:44:38.965867+0000","last_undegraded":"2023-10-25T23:44:38.965867+0000","last_fullsized":"2023-10-25T23:44:38.965867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:47:28.005164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104196124,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":4275,"num_write":1236,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.0","version":"37'2110","reported_seq":4697,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.466256+0000","last_change":"2023-10-25T23:44:32.474501+0000","last_active":"2023-10-25T23:44:32.466256+0000","last_peered":"2023-10-25T23:44:32.466256+0000","last_clean":"2023-10-25T23:44:32.466256+0000","last_became_active":"2023-10-25T23:36:09.283766+0000","last_became_peered":"2023-10-25T23:36:09.283766+0000","last_unstale":"2023-10-25T23:44:32.466256+0000","last_undegraded":"2023-10-25T23:44:32.466256+0000","last_fullsized":"2023-10-25T23:44:32.466256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2110,"log_dups_size":0,"ondisk_log_size":2110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:45:53.731749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055185130999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":3969,"num_write":1247,"num_write_kb":17464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.1","version":"36'550","reported_seq":878,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.871700+0000","last_change":"2023-10-25T23:36:08.264050+0000","last_active":"2023-10-25T23:44:37.871700+0000","last_peered":"2023-10-25T23:44:37.871700+0000","last_clean":"2023-10-25T23:44:37.871700+0000","last_became_active":"2023-10-25T23:36:08.263842+0000","last_became_peered":"2023-10-25T23:36:08.263842+0000","last_unstale":"2023-10-25T23:44:37.871700+0000","last_undegraded":"2023-10-25T23:44:37.871700+0000","last_fullsized":"2023-10-25T23:44:37.871700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:31.130445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":301,"num_read_kb":4287,"num_write":520,"num_write_kb":107914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"38'2106","reported_seq":4676,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.569558+0000","last_change":"2023-10-25T23:44:32.579545+0000","last_active":"2023-10-25T23:44:32.569558+0000","last_peered":"2023-10-25T23:44:32.569558+0000","last_clean":"2023-10-25T23:44:32.569558+0000","last_became_active":"2023-10-25T23:36:09.295595+0000","last_became_peered":"2023-10-25T23:36:09.295595+0000","last_unstale":"2023-10-25T23:44:32.569558+0000","last_undegraded":"2023-10-25T23:44:32.569558+0000","last_fullsized":"2023-10-25T23:44:32.569558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2106,"log_dups_size":0,"ondisk_log_size":2106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:47:48.760379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16669458700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":3321,"num_write":1232,"num_write_kb":16686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.3","version":"36'221","reported_seq":254,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:31.105720+0000","last_change":"2023-10-25T23:36:08.272009+0000","last_active":"2023-10-25T23:44:31.105720+0000","last_peered":"2023-10-25T23:44:31.105720+0000","last_clean":"2023-10-25T23:44:31.105720+0000","last_became_active":"2023-10-25T23:36:08.271640+0000","last_became_peered":"2023-10-25T23:36:08.271640+0000","last_unstale":"2023-10-25T23:44:31.105720+0000","last_undegraded":"2023-10-25T23:44:31.105720+0000","last_fullsized":"2023-10-25T23:44:31.105720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:40.023263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":206,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":186,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:27.995191+0000","last_change":"2023-10-25T23:35:58.277542+0000","last_active":"2023-10-25T23:44:27.995191+0000","last_peered":"2023-10-25T23:44:27.995191+0000","last_clean":"2023-10-25T23:44:27.995191+0000","last_became_active":"2023-10-25T23:35:58.276606+0000","last_became_peered":"2023-10-25T23:35:58.276606+0000","last_unstale":"2023-10-25T23:44:27.995191+0000","last_undegraded":"2023-10-25T23:44:27.995191+0000","last_fullsized":"2023-10-25T23:44:27.995191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:35:57.197265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:35:57.197265+0000","last_clean_scrub_stamp":"2023-10-25T23:35:57.197265+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:53:55.116662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"38'1942","reported_seq":4532,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.523005+0000","last_change":"2023-10-25T23:44:32.535944+0000","last_active":"2023-10-25T23:44:32.523005+0000","last_peered":"2023-10-25T23:44:32.523005+0000","last_clean":"2023-10-25T23:44:32.523005+0000","last_became_active":"2023-10-25T23:36:09.291072+0000","last_became_peered":"2023-10-25T23:36:09.291072+0000","last_unstale":"2023-10-25T23:44:32.523005+0000","last_undegraded":"2023-10-25T23:44:32.523005+0000","last_fullsized":"2023-10-25T23:44:32.523005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1942,"log_dups_size":0,"ondisk_log_size":1942,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:08:35.964760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.124694893,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":28650,"num_write":1164,"num_write_kb":22232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.0","version":"36'240","reported_seq":273,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:27.995297+0000","last_change":"2023-10-25T23:36:08.277937+0000","last_active":"2023-10-25T23:44:27.995297+0000","last_peered":"2023-10-25T23:44:27.995297+0000","last_clean":"2023-10-25T23:44:27.995297+0000","last_became_active":"2023-10-25T23:36:08.277663+0000","last_became_peered":"2023-10-25T23:36:08.277663+0000","last_unstale":"2023-10-25T23:44:27.995297+0000","last_undegraded":"2023-10-25T23:44:27.995297+0000","last_fullsized":"2023-10-25T23:44:27.995297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:04.918703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":226,"num_write_kb":82970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"38'485","reported_seq":518,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.414939+0000","last_change":"2023-10-25T23:36:08.270783+0000","last_active":"2023-10-25T23:44:32.414939+0000","last_peered":"2023-10-25T23:44:32.414939+0000","last_clean":"2023-10-25T23:44:32.414939+0000","last_became_active":"2023-10-25T23:36:08.269896+0000","last_became_peered":"2023-10-25T23:36:08.269896+0000","last_unstale":"2023-10-25T23:44:32.414939+0000","last_undegraded":"2023-10-25T23:44:32.414939+0000","last_fullsized":"2023-10-25T23:44:32.414939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":446,"num_write_kb":94912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"38'2027","reported_seq":4641,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.483964+0000","last_change":"2023-10-25T23:44:32.490756+0000","last_active":"2023-10-25T23:44:32.483964+0000","last_peered":"2023-10-25T23:44:32.483964+0000","last_clean":"2023-10-25T23:44:32.483964+0000","last_became_active":"2023-10-25T23:36:09.278967+0000","last_became_peered":"2023-10-25T23:36:09.278967+0000","last_unstale":"2023-10-25T23:44:32.483964+0000","last_undegraded":"2023-10-25T23:44:32.483964+0000","last_fullsized":"2023-10-25T23:44:32.483964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2027,"log_dups_size":0,"ondisk_log_size":2027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:55:37.816244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070850333000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":3903,"num_write":1243,"num_write_kb":26062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.6","version":"37'363","reported_seq":395,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.150970+0000","last_change":"2023-10-25T23:36:08.279363+0000","last_active":"2023-10-25T23:44:32.150970+0000","last_peered":"2023-10-25T23:44:32.150970+0000","last_clean":"2023-10-25T23:44:32.150970+0000","last_became_active":"2023-10-25T23:36:08.279082+0000","last_became_peered":"2023-10-25T23:36:08.279082+0000","last_unstale":"2023-10-25T23:44:32.150970+0000","last_undegraded":"2023-10-25T23:44:32.150970+0000","last_fullsized":"2023-10-25T23:44:32.150970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":463,"num_write_kb":81485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"38'1958","reported_seq":4546,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.579608+0000","last_change":"2023-10-25T23:44:32.589792+0000","last_active":"2023-10-25T23:44:32.579608+0000","last_peered":"2023-10-25T23:44:32.579608+0000","last_clean":"2023-10-25T23:44:32.579608+0000","last_became_active":"2023-10-25T23:36:09.289751+0000","last_became_peered":"2023-10-25T23:36:09.289751+0000","last_unstale":"2023-10-25T23:44:32.579608+0000","last_undegraded":"2023-10-25T23:44:32.579608+0000","last_fullsized":"2023-10-25T23:44:32.579608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1958,"log_dups_size":0,"ondisk_log_size":1958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:25:10.694319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.180222046,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":4389,"num_write":1130,"num_write_kb":12211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.7","version":"38'408","reported_seq":442,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.947700+0000","last_change":"2023-10-25T23:36:08.274349+0000","last_active":"2023-10-25T23:44:37.947700+0000","last_peered":"2023-10-25T23:44:37.947700+0000","last_clean":"2023-10-25T23:44:37.947700+0000","last_became_active":"2023-10-25T23:36:08.273029+0000","last_became_peered":"2023-10-25T23:36:08.273029+0000","last_unstale":"2023-10-25T23:44:37.947700+0000","last_undegraded":"2023-10-25T23:44:37.947700+0000","last_fullsized":"2023-10-25T23:44:37.947700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":396,"num_write_kb":80384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"37'1987","reported_seq":4591,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.546622+0000","last_change":"2023-10-25T23:44:32.561359+0000","last_active":"2023-10-25T23:44:32.546622+0000","last_peered":"2023-10-25T23:44:32.546622+0000","last_clean":"2023-10-25T23:44:32.546622+0000","last_became_active":"2023-10-25T23:36:09.287532+0000","last_became_peered":"2023-10-25T23:36:09.287532+0000","last_unstale":"2023-10-25T23:44:32.546622+0000","last_undegraded":"2023-10-25T23:44:32.546622+0000","last_fullsized":"2023-10-25T23:44:32.546622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:48:17.801733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14756345200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":4941,"num_write":1181,"num_write_kb":9554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.8","version":"36'238","reported_seq":270,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:27.995191+0000","last_change":"2023-10-25T23:36:08.266963+0000","last_active":"2023-10-25T23:44:27.995191+0000","last_peered":"2023-10-25T23:44:27.995191+0000","last_clean":"2023-10-25T23:44:27.995191+0000","last_became_active":"2023-10-25T23:36:08.266648+0000","last_became_peered":"2023-10-25T23:36:08.266648+0000","last_unstale":"2023-10-25T23:44:27.995191+0000","last_undegraded":"2023-10-25T23:44:27.995191+0000","last_fullsized":"2023-10-25T23:44:27.995191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:31.130445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":194,"num_write_kb":95518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"38'2105","reported_seq":4726,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.938764+0000","last_change":"2023-10-25T23:44:38.947498+0000","last_active":"2023-10-25T23:44:38.938764+0000","last_peered":"2023-10-25T23:44:38.938764+0000","last_clean":"2023-10-25T23:44:38.938764+0000","last_became_active":"2023-10-25T23:36:09.284666+0000","last_became_peered":"2023-10-25T23:36:09.284666+0000","last_unstale":"2023-10-25T23:44:38.938764+0000","last_undegraded":"2023-10-25T23:44:38.938764+0000","last_fullsized":"2023-10-25T23:44:38.938764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2105,"log_dups_size":0,"ondisk_log_size":2105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:12:30.838027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.075073965000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":4417,"num_write":1270,"num_write_kb":29307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.9","version":"36'390","reported_seq":422,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.138646+0000","last_change":"2023-10-25T23:36:08.278162+0000","last_active":"2023-10-25T23:44:28.138646+0000","last_peered":"2023-10-25T23:44:28.138646+0000","last_clean":"2023-10-25T23:44:28.138646+0000","last_became_active":"2023-10-25T23:36:08.277873+0000","last_became_peered":"2023-10-25T23:36:08.277873+0000","last_unstale":"2023-10-25T23:44:28.138646+0000","last_undegraded":"2023-10-25T23:44:28.138646+0000","last_fullsized":"2023-10-25T23:44:28.138646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":385,"num_write_kb":96608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"38'2131","reported_seq":4728,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.533964+0000","last_change":"2023-10-25T23:44:32.544755+0000","last_active":"2023-10-25T23:44:32.533964+0000","last_peered":"2023-10-25T23:44:32.533964+0000","last_clean":"2023-10-25T23:44:32.533964+0000","last_became_active":"2023-10-25T23:36:09.289320+0000","last_became_peered":"2023-10-25T23:36:09.289320+0000","last_unstale":"2023-10-25T23:44:32.533964+0000","last_undegraded":"2023-10-25T23:44:32.533964+0000","last_fullsized":"2023-10-25T23:44:32.533964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2131,"log_dups_size":0,"ondisk_log_size":2131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:58:54.338525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.135709307,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":230,"num_read_kb":4443,"num_write":1269,"num_write_kb":26048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.a","version":"36'618","reported_seq":650,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.138363+0000","last_change":"2023-10-25T23:36:08.278921+0000","last_active":"2023-10-25T23:44:28.138363+0000","last_peered":"2023-10-25T23:44:28.138363+0000","last_clean":"2023-10-25T23:44:28.138363+0000","last_became_active":"2023-10-25T23:36:08.278656+0000","last_became_peered":"2023-10-25T23:36:08.278656+0000","last_unstale":"2023-10-25T23:44:28.138363+0000","last_undegraded":"2023-10-25T23:44:28.138363+0000","last_fullsized":"2023-10-25T23:44:28.138363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":598,"num_write_kb":115954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"38'2104","reported_seq":4678,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.559006+0000","last_change":"2023-10-25T23:44:32.569480+0000","last_active":"2023-10-25T23:44:32.559006+0000","last_peered":"2023-10-25T23:44:32.559006+0000","last_clean":"2023-10-25T23:44:32.559006+0000","last_became_active":"2023-10-25T23:36:09.292345+0000","last_became_peered":"2023-10-25T23:36:09.292345+0000","last_unstale":"2023-10-25T23:44:32.559006+0000","last_undegraded":"2023-10-25T23:44:32.559006+0000","last_fullsized":"2023-10-25T23:44:32.559006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2104,"log_dups_size":0,"ondisk_log_size":2104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:58:37.312724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15989214199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":8471,"num_write":1242,"num_write_kb":22974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.b","version":"38'416","reported_seq":448,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.411010+0000","last_change":"2023-10-25T23:36:08.270589+0000","last_active":"2023-10-25T23:44:32.411010+0000","last_peered":"2023-10-25T23:44:32.411010+0000","last_clean":"2023-10-25T23:44:32.411010+0000","last_became_active":"2023-10-25T23:36:08.268753+0000","last_became_peered":"2023-10-25T23:36:08.268753+0000","last_unstale":"2023-10-25T23:44:32.411010+0000","last_undegraded":"2023-10-25T23:44:32.411010+0000","last_fullsized":"2023-10-25T23:44:32.411010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":415,"num_write_kb":99792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"37'2024","reported_seq":4651,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.507668+0000","last_change":"2023-10-25T23:44:39.510909+0000","last_active":"2023-10-25T23:44:39.507668+0000","last_peered":"2023-10-25T23:44:39.507668+0000","last_clean":"2023-10-25T23:44:39.507668+0000","last_became_active":"2023-10-25T23:36:09.290151+0000","last_became_peered":"2023-10-25T23:36:09.290151+0000","last_unstale":"2023-10-25T23:44:39.507668+0000","last_undegraded":"2023-10-25T23:44:39.507668+0000","last_fullsized":"2023-10-25T23:44:39.507668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2024,"log_dups_size":0,"ondisk_log_size":2024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:56:59.222424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047955154,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":5633,"num_write":1198,"num_write_kb":13442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.c","version":"37'230","reported_seq":264,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.871765+0000","last_change":"2023-10-25T23:36:08.272161+0000","last_active":"2023-10-25T23:44:37.871765+0000","last_peered":"2023-10-25T23:44:37.871765+0000","last_clean":"2023-10-25T23:44:37.871765+0000","last_became_active":"2023-10-25T23:36:08.271846+0000","last_became_peered":"2023-10-25T23:36:08.271846+0000","last_unstale":"2023-10-25T23:44:37.871765+0000","last_undegraded":"2023-10-25T23:44:37.871765+0000","last_fullsized":"2023-10-25T23:44:37.871765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:37:39.512919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":195,"num_write_kb":98810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"38'2024","reported_seq":4615,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.534494+0000","last_change":"2023-10-25T23:44:32.543725+0000","last_active":"2023-10-25T23:44:32.534494+0000","last_peered":"2023-10-25T23:44:32.534494+0000","last_clean":"2023-10-25T23:44:32.534494+0000","last_became_active":"2023-10-25T23:36:09.295635+0000","last_became_peered":"2023-10-25T23:36:09.295635+0000","last_unstale":"2023-10-25T23:44:32.534494+0000","last_undegraded":"2023-10-25T23:44:32.534494+0000","last_fullsized":"2023-10-25T23:44:32.534494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2024,"log_dups_size":0,"ondisk_log_size":2024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:58:54.338525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12892921700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":10038,"num_write":1186,"num_write_kb":32237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.d","version":"36'444","reported_seq":476,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-25T23:44:28.138558+0000","last_change":"2023-10-25T23:36:08.277618+0000","last_active":"2023-10-25T23:44:28.138558+0000","last_peered":"2023-10-25T23:44:28.138558+0000","last_clean":"2023-10-25T23:44:28.138558+0000","last_became_active":"2023-10-25T23:36:08.277344+0000","last_became_peered":"2023-10-25T23:36:08.277344+0000","last_unstale":"2023-10-25T23:44:28.138558+0000","last_undegraded":"2023-10-25T23:44:28.138558+0000","last_fullsized":"2023-10-25T23:44:28.138558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:21:29.062087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25170780,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":452,"num_write_kb":113081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"38'2036","reported_seq":4641,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.467108+0000","last_change":"2023-10-25T23:44:32.477913+0000","last_active":"2023-10-25T23:44:32.467108+0000","last_peered":"2023-10-25T23:44:32.467108+0000","last_clean":"2023-10-25T23:44:32.467108+0000","last_became_active":"2023-10-25T23:36:09.299234+0000","last_became_peered":"2023-10-25T23:36:09.299234+0000","last_unstale":"2023-10-25T23:44:32.467108+0000","last_undegraded":"2023-10-25T23:44:32.467108+0000","last_fullsized":"2023-10-25T23:44:32.467108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:07:23.792926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.083041489999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":4213,"num_write":1231,"num_write_kb":8559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"2.e","version":"36'466","reported_seq":500,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.871997+0000","last_change":"2023-10-25T23:36:08.269389+0000","last_active":"2023-10-25T23:44:37.871997+0000","last_peered":"2023-10-25T23:44:37.871997+0000","last_clean":"2023-10-25T23:44:37.871997+0000","last_became_active":"2023-10-25T23:36:08.269065+0000","last_became_peered":"2023-10-25T23:36:08.269065+0000","last_unstale":"2023-10-25T23:44:37.871997+0000","last_undegraded":"2023-10-25T23:44:37.871997+0000","last_fullsized":"2023-10-25T23:44:37.871997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":460,"num_write_kb":103224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"38'2026","reported_seq":4636,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.534598+0000","last_change":"2023-10-25T23:44:32.543717+0000","last_active":"2023-10-25T23:44:32.534598+0000","last_peered":"2023-10-25T23:44:32.534598+0000","last_clean":"2023-10-25T23:44:32.534598+0000","last_became_active":"2023-10-25T23:36:09.294494+0000","last_became_peered":"2023-10-25T23:36:09.294494+0000","last_unstale":"2023-10-25T23:44:32.534598+0000","last_undegraded":"2023-10-25T23:44:32.534598+0000","last_fullsized":"2023-10-25T23:44:32.534598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:47:48.760379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12874353299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":9037,"num_write":1232,"num_write_kb":21545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.20","version":"38'2048","reported_seq":4692,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.507611+0000","last_change":"2023-10-25T23:44:39.510985+0000","last_active":"2023-10-25T23:44:39.507611+0000","last_peered":"2023-10-25T23:44:39.507611+0000","last_clean":"2023-10-25T23:44:39.507611+0000","last_became_active":"2023-10-25T23:36:09.291665+0000","last_became_peered":"2023-10-25T23:36:09.291665+0000","last_unstale":"2023-10-25T23:44:39.507611+0000","last_undegraded":"2023-10-25T23:44:39.507611+0000","last_fullsized":"2023-10-25T23:44:39.507611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2048,"log_dups_size":0,"ondisk_log_size":2048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:23:16.256254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048033508000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":23343,"num_write":1242,"num_write_kb":29102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.21","version":"38'2167","reported_seq":4771,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.906315+0000","last_change":"2023-10-25T23:44:38.911392+0000","last_active":"2023-10-25T23:44:38.906315+0000","last_peered":"2023-10-25T23:44:38.906315+0000","last_clean":"2023-10-25T23:44:38.906315+0000","last_became_active":"2023-10-25T23:36:09.295817+0000","last_became_peered":"2023-10-25T23:36:09.295817+0000","last_unstale":"2023-10-25T23:44:38.906315+0000","last_undegraded":"2023-10-25T23:44:38.906315+0000","last_fullsized":"2023-10-25T23:44:38.906315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2167,"log_dups_size":0,"ondisk_log_size":2167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:45:10.022688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038422899000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":12397,"num_write":1283,"num_write_kb":33443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.22","version":"37'2070","reported_seq":4665,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.477977+0000","last_change":"2023-10-25T23:44:32.488844+0000","last_active":"2023-10-25T23:44:32.477977+0000","last_peered":"2023-10-25T23:44:32.477977+0000","last_clean":"2023-10-25T23:44:32.477977+0000","last_became_active":"2023-10-25T23:36:09.299024+0000","last_became_peered":"2023-10-25T23:36:09.299024+0000","last_unstale":"2023-10-25T23:44:32.477977+0000","last_undegraded":"2023-10-25T23:44:32.477977+0000","last_fullsized":"2023-10-25T23:44:32.477977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:10:34.048013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.093943498,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":4357,"num_write":1220,"num_write_kb":7384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.23","version":"37'2232","reported_seq":4786,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.547769+0000","last_change":"2023-10-25T23:44:32.561360+0000","last_active":"2023-10-25T23:44:32.547769+0000","last_peered":"2023-10-25T23:44:32.547769+0000","last_clean":"2023-10-25T23:44:32.547769+0000","last_became_active":"2023-10-25T23:36:09.292344+0000","last_became_peered":"2023-10-25T23:36:09.292344+0000","last_unstale":"2023-10-25T23:44:32.547769+0000","last_undegraded":"2023-10-25T23:44:32.547769+0000","last_fullsized":"2023-10-25T23:44:32.547769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2232,"log_dups_size":0,"ondisk_log_size":2232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:35:09.563199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.147721039,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":3547,"num_write":1298,"num_write_kb":27693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.24","version":"38'2016","reported_seq":4597,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.569503+0000","last_change":"2023-10-25T23:44:32.579537+0000","last_active":"2023-10-25T23:44:32.569503+0000","last_peered":"2023-10-25T23:44:32.569503+0000","last_clean":"2023-10-25T23:44:32.569503+0000","last_became_active":"2023-10-25T23:36:09.297202+0000","last_became_peered":"2023-10-25T23:36:09.297202+0000","last_unstale":"2023-10-25T23:44:32.569503+0000","last_undegraded":"2023-10-25T23:44:32.569503+0000","last_fullsized":"2023-10-25T23:44:32.569503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:15:03.433377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16961031800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":7838,"num_write":1164,"num_write_kb":15586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.25","version":"37'2020","reported_seq":4707,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.474663+0000","last_change":"2023-10-25T23:44:32.483496+0000","last_active":"2023-10-25T23:44:32.474663+0000","last_peered":"2023-10-25T23:44:32.474663+0000","last_clean":"2023-10-25T23:44:32.474663+0000","last_became_active":"2023-10-25T23:36:09.293157+0000","last_became_peered":"2023-10-25T23:36:09.293157+0000","last_unstale":"2023-10-25T23:44:32.474663+0000","last_undegraded":"2023-10-25T23:44:32.474663+0000","last_fullsized":"2023-10-25T23:44:32.474663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2020,"log_dups_size":0,"ondisk_log_size":2020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:35:16.290832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063886599000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":301,"num_read_kb":22462,"num_write":1198,"num_write_kb":27011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.26","version":"38'2156","reported_seq":4757,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.516218+0000","last_change":"2023-10-25T23:44:39.519493+0000","last_active":"2023-10-25T23:44:39.516218+0000","last_peered":"2023-10-25T23:44:39.516218+0000","last_clean":"2023-10-25T23:44:39.516218+0000","last_became_active":"2023-10-25T23:36:09.288127+0000","last_became_peered":"2023-10-25T23:36:09.288127+0000","last_unstale":"2023-10-25T23:44:39.516218+0000","last_undegraded":"2023-10-25T23:44:39.516218+0000","last_fullsized":"2023-10-25T23:44:39.516218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2156,"log_dups_size":0,"ondisk_log_size":2156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:42.350798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055712415000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":4655,"num_write":1304,"num_write_kb":14899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.27","version":"38'1996","reported_seq":4603,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.559063+0000","last_change":"2023-10-25T23:44:32.569447+0000","last_active":"2023-10-25T23:44:32.559063+0000","last_peered":"2023-10-25T23:44:32.559063+0000","last_clean":"2023-10-25T23:44:32.559063+0000","last_became_active":"2023-10-25T23:36:09.290160+0000","last_became_peered":"2023-10-25T23:36:09.290160+0000","last_unstale":"2023-10-25T23:44:32.559063+0000","last_undegraded":"2023-10-25T23:44:32.559063+0000","last_fullsized":"2023-10-25T23:44:32.559063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1996,"log_dups_size":0,"ondisk_log_size":1996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:22:15.481808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15980784200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":16054,"num_write":1171,"num_write_kb":30881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.28","version":"38'2009","reported_seq":4618,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.465470+0000","last_change":"2023-10-25T23:44:32.465470+0000","last_active":"2023-10-25T23:44:32.465470+0000","last_peered":"2023-10-25T23:44:32.465470+0000","last_clean":"2023-10-25T23:44:32.465470+0000","last_became_active":"2023-10-25T23:36:09.298637+0000","last_became_peered":"2023-10-25T23:36:09.298637+0000","last_unstale":"2023-10-25T23:44:32.465470+0000","last_undegraded":"2023-10-25T23:44:32.465470+0000","last_fullsized":"2023-10-25T23:44:32.465470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:30:25.067286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070832067999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":3413,"num_write":1198,"num_write_kb":11362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.29","version":"37'1982","reported_seq":4595,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.533912+0000","last_change":"2023-10-25T23:44:32.544759+0000","last_active":"2023-10-25T23:44:32.533912+0000","last_peered":"2023-10-25T23:44:32.533912+0000","last_clean":"2023-10-25T23:44:32.533912+0000","last_became_active":"2023-10-25T23:36:09.290546+0000","last_became_peered":"2023-10-25T23:36:09.290546+0000","last_unstale":"2023-10-25T23:44:32.533912+0000","last_undegraded":"2023-10-25T23:44:32.533912+0000","last_fullsized":"2023-10-25T23:44:32.533912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1982,"log_dups_size":0,"ondisk_log_size":1982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:07:23.792926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.135788095,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":7180,"num_write":1206,"num_write_kb":23829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.2a","version":"37'2160","reported_seq":4722,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.483906+0000","last_change":"2023-10-25T23:44:32.490753+0000","last_active":"2023-10-25T23:44:32.483906+0000","last_peered":"2023-10-25T23:44:32.483906+0000","last_clean":"2023-10-25T23:44:32.483906+0000","last_became_active":"2023-10-25T23:36:50.102780+0000","last_became_peered":"2023-10-25T23:36:50.102780+0000","last_unstale":"2023-10-25T23:44:32.483906+0000","last_undegraded":"2023-10-25T23:44:32.483906+0000","last_fullsized":"2023-10-25T23:44:32.483906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2160,"log_dups_size":0,"ondisk_log_size":2160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:06:05.306853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071023269999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":4977,"num_write":1244,"num_write_kb":20718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.2b","version":"38'2071","reported_seq":4667,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-25T23:44:32.535990+0000","last_change":"2023-10-25T23:44:32.547709+0000","last_active":"2023-10-25T23:44:32.535990+0000","last_peered":"2023-10-25T23:44:32.535990+0000","last_clean":"2023-10-25T23:44:32.535990+0000","last_became_active":"2023-10-25T23:36:09.285610+0000","last_became_peered":"2023-10-25T23:36:09.285610+0000","last_unstale":"2023-10-25T23:44:32.535990+0000","last_undegraded":"2023-10-25T23:44:32.535990+0000","last_fullsized":"2023-10-25T23:44:32.535990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:39:45.667730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.134268367,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":4129,"num_write":1211,"num_write_kb":11664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ac","length":"2"}]},{"pgid":"3.2c","version":"38'2126","reported_seq":4746,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.510974+0000","last_change":"2023-10-25T23:44:39.516069+0000","last_active":"2023-10-25T23:44:39.510974+0000","last_peered":"2023-10-25T23:44:39.510974+0000","last_clean":"2023-10-25T23:44:39.510974+0000","last_became_active":"2023-10-25T23:36:09.291566+0000","last_became_peered":"2023-10-25T23:36:09.291566+0000","last_unstale":"2023-10-25T23:44:39.510974+0000","last_undegraded":"2023-10-25T23:44:39.510974+0000","last_fullsized":"2023-10-25T23:44:39.510974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2126,"log_dups_size":0,"ondisk_log_size":2126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:10.561911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052820837000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":9012,"num_write":1282,"num_write_kb":25857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13917,"num_read_kb":527622,"num_write":78506,"num_write_kb":1459524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132701,"ondisk_log_size":132701,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":883576319,"num_objects":563,"num_object_clones":0,"num_object_copies":1126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":563,"num_whiteouts":0,"num_read":737,"num_read_kb":4867,"num_write":13233,"num_write_kb":3081677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":344,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1768792064,"data_stored":1768728153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13665,"ondisk_log_size":13665,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574957,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":431156,"kb_used_data":295912,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":93940684,"statfs":{"total":96636764160,"available":96195260416,"internally_reserved":0,"allocated":303013888,"data_stored":302765950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":138475979},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.72999999999999998,"15min":0.59599999999999997},"min":{"1min":0.26800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.67100000000000004,"5min":34.116999999999997,"15min":34.116999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.50600000000000001},"min":{"1min":0.317,"5min":0.222,"15min":0.222},"max":{"1min":0.73899999999999999,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.65400000000000003}]},{"osd":1,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.76400000000000001,"15min":0.61399999999999999},"min":{"1min":0.29599999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65200000000000002,"5min":34.424999999999997,"15min":34.424999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.77300000000000002,"15min":0.62},"min":{"1min":0.35099999999999998,"5min":0.29599999999999999,"15min":0.28100000000000003},"max":{"1min":0.79900000000000004,"5min":32.781999999999996,"15min":32.781999999999996},"last":0.69799999999999995}]},{"osd":2,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48499999999999999,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60599999999999998,"5min":1.964,"15min":1.964},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.79200000000000004,"15min":0.63900000000000001},"min":{"1min":0.34399999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76600000000000001,"5min":34.066000000000003,"15min":34.066000000000003},"last":0.56999999999999995}]},{"osd":3,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.94899999999999995,"15min":0.68400000000000005},"min":{"1min":0.40699999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.622,"5min":50.606999999999999,"15min":50.606999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.89900000000000002,"15min":0.68899999999999995},"min":{"1min":0.41199999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.89200000000000002,"5min":41.027999999999999,"15min":41.027999999999999},"last":0.58899999999999997}]},{"osd":4,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.72999999999999998,"15min":0.55500000000000005},"min":{"1min":0.33400000000000002,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.82499999999999996,"5min":28,"15min":28},"last":0.437},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.76000000000000001,"15min":0.59799999999999998},"min":{"1min":0.46899999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.177,"5min":28.25,"15min":28.25},"last":0.45600000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.84499999999999997,"15min":0.63400000000000001},"min":{"1min":0.437,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.79200000000000004,"5min":34.393000000000001,"15min":34.393000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64200000000000002,"15min":0.58299999999999996},"min":{"1min":0.40500000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84499999999999997,"5min":10.099,"15min":10.099},"last":0.374}]},{"osd":6,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.72999999999999998,"15min":0.621},"min":{"1min":0.45100000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.97999999999999998,"5min":18.271999999999998,"15min":18.271999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.98599999999999999,"15min":0.71599999999999997},"min":{"1min":0.53200000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.369,"5min":47.531999999999996,"15min":47.531999999999996},"last":0.41899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574956,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":357980,"kb_used_data":246356,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94013860,"statfs":{"total":96636764160,"available":96270192640,"internally_reserved":0,"allocated":252268544,"data_stored":252003915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":114293191},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45000000000000001,"15min":0.51200000000000001},"min":{"1min":0.26400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.623,"5min":3.3140000000000001,"15min":3.3140000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.35499999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56599999999999995,"5min":11.619,"15min":11.619},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.5,"15min":0.53600000000000003},"min":{"1min":0.27500000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68899999999999995,"5min":3.468,"15min":3.468},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.56000000000000005},"min":{"1min":0.30599999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.64600000000000002,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.61199999999999999,"15min":0.57399999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":6.327,"5min":11.683999999999999,"15min":11.683999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.58899999999999997,"15min":0.55800000000000005},"min":{"1min":0.32800000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81399999999999995,"5min":11.784000000000001,"15min":11.784000000000001},"last":0.58399999999999996}]},{"osd":3,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":1.071,"15min":0.77300000000000002},"min":{"1min":0.33900000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84499999999999997,"5min":61.121000000000002,"15min":61.121000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.36499999999999999},"max":{"1min":0.80000000000000004,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.60199999999999998}]},{"osd":4,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60299999999999998,"15min":0.54400000000000004},"min":{"1min":0.35099999999999998,"5min":0.27600000000000002,"15min":0.23200000000000001},"max":{"1min":0.91900000000000004,"5min":12.169,"15min":12.169},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.623,"15min":0.57699999999999996},"min":{"1min":0.44700000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85699999999999998,"5min":11.554,"15min":11.554},"last":0.628}]},{"osd":5,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.62,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.26100000000000001,"15min":0.245},"max":{"1min":0.77600000000000002,"5min":11.755000000000001,"15min":11.755000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.40300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.89000000000000001,"5min":3.2879999999999998,"15min":3.2879999999999998},"last":0.65200000000000002}]},{"osd":7,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.96099999999999997,"15min":0.71599999999999997},"min":{"1min":0.48099999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89500000000000002,"5min":29.977,"15min":29.977},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.97299999999999998,"15min":0.71599999999999997},"min":{"1min":0.42399999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.874,"5min":29.925000000000001,"15min":29.925000000000001},"last":0.63800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361852,"kb_used_data":254384,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94009988,"statfs":{"total":96636764160,"available":96266227712,"internally_reserved":0,"allocated":260489216,"data_stored":260237011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.378,"15min":0.36699999999999999},"min":{"1min":0.17799999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.44600000000000001,"5min":4.2839999999999998,"15min":6.9370000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.94999999999999996,"15min":0.54900000000000004},"min":{"1min":0.22,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.48199999999999998,"5min":66.522000000000006,"15min":66.522000000000006},"last":0.28399999999999997}]},{"osd":2,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35299999999999998,"15min":0.34799999999999998},"min":{"1min":0.23999999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53200000000000003,"5min":4.9180000000000001,"15min":4.9180000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41199999999999998,"15min":0.39000000000000001},"min":{"1min":0.247,"5min":0.186,"15min":0.186},"max":{"1min":0.54900000000000004,"5min":4.2060000000000004,"15min":4.2060000000000004},"last":0.25900000000000001}]},{"osd":3,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.60399999999999998,"15min":0.46800000000000003},"min":{"1min":0.26900000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.56999999999999995,"5min":21.943000000000001,"15min":21.943000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.60199999999999998,"15min":0.47699999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.55800000000000005,"5min":23.300999999999998,"15min":23.300999999999998},"last":0.39400000000000002}]},{"osd":4,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.67700000000000005,"15min":0.57899999999999996},"min":{"1min":0.35099999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.94999999999999996,"5min":14.066000000000001,"15min":14.066000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.622,"15min":0.58199999999999996},"min":{"1min":0.44,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.89700000000000002,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":0.46400000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.33300000000000002},"max":{"1min":0.90500000000000003,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.39700000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82499999999999996,"5min":4.9960000000000004,"15min":9.7650000000000006},"last":0.44600000000000001}]},{"osd":6,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64600000000000002,"15min":0.60799999999999998},"min":{"1min":0.46999999999999997,"5min":0.313,"15min":0.313},"max":{"1min":0.83699999999999997,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.78200000000000003,"15min":0.65100000000000002},"min":{"1min":0.438,"5min":0.38400000000000001,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":21.876000000000001,"15min":21.876000000000001},"last":0.56899999999999995}]},{"osd":7,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93200000000000005,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.76100000000000001,"15min":0.65200000000000002},"min":{"1min":0.44,"5min":0.371,"15min":0.36399999999999999},"max":{"1min":1.6850000000000001,"5min":18.754999999999999,"15min":18.754999999999999},"last":0.505}]}]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":373948,"kb_used_data":230384,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":93997892,"statfs":{"total":96636764160,"available":96253841408,"internally_reserved":0,"allocated":235913216,"data_stored":235657142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.375,"15min":0.35899999999999999},"min":{"1min":0.26900000000000002,"5min":0.20200000000000001,"15min":0.17899999999999999},"max":{"1min":1.365,"5min":4.649,"15min":4.649},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39000000000000001,"15min":0.36399999999999999},"min":{"1min":0.23699999999999999,"5min":0.20499999999999999,"15min":0.19400000000000001},"max":{"1min":1.641,"5min":5.1589999999999998,"15min":5.1589999999999998},"last":0.51600000000000001}]},{"osd":2,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38200000000000001},"min":{"1min":0.23699999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.423,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.42899999999999999,"15min":0.40600000000000003},"min":{"1min":0.251,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53700000000000003,"5min":7.6870000000000003,"15min":7.6870000000000003},"last":0.57699999999999996}]},{"osd":3,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.435,"15min":0.39300000000000002},"min":{"1min":0.28000000000000003,"5min":0.23999999999999999,"15min":0.23899999999999999},"max":{"1min":2.0819999999999999,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.47299999999999998,"15min":0.442},"min":{"1min":0.313,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.954,"5min":5.0750000000000002,"15min":5.0750000000000002},"last":0.61799999999999999}]},{"osd":4,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.58099999999999996},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67100000000000004,"5min":5.9729999999999999,"15min":5.9729999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.62,"15min":0.58799999999999997},"min":{"1min":0.35299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.3769999999999998,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.77300000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63400000000000001,"15min":0.63200000000000001},"min":{"1min":0.438,"5min":0.375,"15min":0.32300000000000001},"max":{"1min":1.3939999999999999,"5min":5.1120000000000001,"15min":8.5169999999999995},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65000000000000002,"15min":0.60399999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.84199999999999997,"5min":6.0199999999999996,"15min":6.0199999999999996},"last":0.84699999999999998}]},{"osd":6,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.624,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.4369999999999998,"5min":4.9850000000000003,"15min":4.9850000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.32200000000000001},"max":{"1min":1.4510000000000001,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.79400000000000004}]},{"osd":7,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66200000000000003,"15min":0.66300000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84899999999999998,"5min":6.0720000000000001,"15min":8.4979999999999993},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.65100000000000002,"15min":0.60699999999999998},"min":{"1min":0.47499999999999998,"5min":0.374,"15min":0.374},"max":{"1min":2.411,"5min":4.883,"15min":4.883},"last":0.70199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574959,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188100,"kb_used_data":102840,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94183740,"statfs":{"total":96636764160,"available":96444149760,"internally_reserved":0,"allocated":105308160,"data_stored":105055525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.32600000000000001,"15min":0.82799999999999996},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.79600000000000004,"5min":2.7269999999999999,"15min":18.052},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.371},"min":{"1min":0.222,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.0389999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.311}]},{"osd":1,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33900000000000002,"15min":0.85199999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.82899999999999996,"5min":1.03,"15min":18.175000000000001},"last":0.247},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.64500000000000002},"min":{"1min":0.251,"5min":0.22900000000000001,"15min":0.22700000000000001},"max":{"1min":0.49299999999999999,"5min":0.50800000000000001,"15min":10.23},"last":0.35599999999999998}]},{"osd":3,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.35999999999999999,"15min":0.89200000000000002},"min":{"1min":0.24099999999999999,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":0.84699999999999998,"5min":0.97999999999999998,"15min":18.236000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.42499999999999999,"15min":0.92300000000000004},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":18.004999999999999},"last":0.34300000000000003}]},{"osd":4,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54600000000000004,"15min":0.76900000000000002},"min":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.32100000000000001},"max":{"1min":0.75700000000000001,"5min":1.2589999999999999,"15min":8.1839999999999993},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55500000000000005,"15min":0.58499999999999996},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.518,"5min":1.518,"15min":2.4580000000000002},"last":0.53500000000000003}]},{"osd":5,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54200000000000004,"15min":0.58799999999999997},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.31900000000000001},"max":{"1min":0.80200000000000005,"5min":0.85099999999999998,"15min":8.3520000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":1.075},"min":{"1min":0.38300000000000001,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.81100000000000005,"5min":1.4419999999999999,"15min":18.143999999999998},"last":0.69899999999999995}]},{"osd":6,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":1.1000000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.316},"max":{"1min":0.78100000000000003,"5min":1.012,"15min":18.206},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.77600000000000002},"min":{"1min":0.44,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86899999999999999,"5min":1.3240000000000001,"15min":7.0060000000000002},"last":0.70899999999999996}]},{"osd":7,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.84799999999999998,"5min":0.88100000000000001,"15min":2.3900000000000001},"last":0.747},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68700000000000006,"15min":1.145},"min":{"1min":0.41799999999999998,"5min":0.40500000000000003,"15min":0.39500000000000002},"max":{"1min":2.0339999999999998,"5min":7.9850000000000003,"15min":18.109999999999999},"last":0.75600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574957,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312500,"kb_used_data":182824,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94059340,"statfs":{"total":96636764160,"available":96316764160,"internally_reserved":0,"allocated":187211776,"data_stored":186956203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":132774344},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.435,"15min":0.376},"min":{"1min":0.23999999999999999,"5min":0.17899999999999999,"15min":0.17799999999999999},"max":{"1min":0.65400000000000003,"5min":5.9560000000000004,"15min":5.9560000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.311,"5min":0.89400000000000002,"15min":0.54200000000000004},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.65400000000000003,"5min":55.152999999999999,"15min":55.152999999999999},"last":0.47899999999999998}]},{"osd":1,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.36599999999999999},"min":{"1min":0.217,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.294,"5min":2.323,"15min":2.323},"last":0.501},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.52200000000000002,"15min":0.438},"min":{"1min":0.33800000000000002,"5min":0.245,"15min":0.24399999999999999},"max":{"1min":0.624,"5min":6.0609999999999999,"15min":6.0609999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.46500000000000002,"15min":0.44},"min":{"1min":0.31900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59999999999999998,"5min":4.6840000000000002,"15min":4.6840000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.83699999999999997,"15min":0.55100000000000005},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.3260000000000001,"5min":40.789000000000001,"15min":40.789000000000001},"last":0.55000000000000004}]},{"osd":4,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.1319999999999999,"15min":0.77700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33000000000000002},"max":{"1min":1.1719999999999999,"5min":58.180999999999997,"15min":58.180999999999997},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.629,"15min":0.58199999999999996},"min":{"1min":0.39200000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.94799999999999995,"5min":4.6509999999999998,"15min":4.6509999999999998},"last":0.69999999999999996}]},{"osd":5,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":1.1990000000000001,"15min":0.80000000000000004},"min":{"1min":0.38500000000000001,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":1.21,"5min":60.893999999999998,"15min":60.893999999999998},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66800000000000004,"15min":0.61299999999999999},"min":{"1min":0.43099999999999999,"5min":0.38300000000000001,"15min":0.378},"max":{"1min":1.3540000000000001,"5min":4.2489999999999997,"15min":4.2489999999999997},"last":0.76700000000000002}]},{"osd":6,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.385,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.71399999999999997,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.91800000000000004,"5min":6.1790000000000003,"15min":6.1790000000000003},"last":0.79900000000000004}]},{"osd":7,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.98699999999999999,"15min":0.74299999999999999},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88,"5min":33.006999999999998,"15min":33.006999999999998},"last":0.748},{"interface":"front","average":{"1min":0.60899999999999999,"5min":1.175,"15min":0.80600000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":1.2509999999999999,"5min":56.667999999999999,"15min":56.667999999999999},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574957,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":343192,"kb_used_data":209352,"kb_used_omap":1,"kb_used_meta":133822,"kb_avail":94028648,"statfs":{"total":96636764160,"available":96285335552,"internally_reserved":0,"allocated":214376448,"data_stored":214112441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":137034182},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.495,"15min":0.89600000000000002},"min":{"1min":0.28799999999999998,"5min":0.26300000000000001,"15min":0.23999999999999999},"max":{"1min":3.0310000000000001,"5min":3.306,"15min":32.487000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45300000000000001,"15min":0.51300000000000001},"min":{"1min":0.24399999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.65500000000000003,"5min":1.05,"15min":6.0670000000000002},"last":0.53700000000000003}]},{"osd":1,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.73399999999999999,"15min":0.71499999999999997},"min":{"1min":0.27400000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.66800000000000004,"5min":23.579000000000001,"15min":32.417000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.83099999999999996,"15min":0.96399999999999997},"min":{"1min":0.33100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.70399999999999996,"5min":22.800000000000001,"15min":22.800000000000001},"last":0.36699999999999999}]},{"osd":2,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.60199999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":0.745,"5min":2.6779999999999999,"15min":14.757999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.72199999999999998,"15min":0.65900000000000003},"min":{"1min":0.35299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.72399999999999998,"5min":18.042999999999999,"15min":18.042999999999999},"last":0.56799999999999995}]},{"osd":3,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57699999999999996,"15min":0.73399999999999999},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66900000000000004,"5min":6.1360000000000001,"15min":55.222000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57399999999999995,"15min":0.64000000000000001},"min":{"1min":0.39100000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80600000000000005,"5min":6.3220000000000001,"15min":14.869999999999999},"last":0.39500000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.50800000000000001,"15min":0.56899999999999995},"min":{"1min":0.33300000000000002,"5min":0.26600000000000001,"15min":0.23699999999999999},"max":{"1min":0.77500000000000002,"5min":1.466,"15min":6.508},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.62},"min":{"1min":0.40799999999999997,"5min":0.26500000000000001,"15min":0.24199999999999999},"max":{"1min":0.72899999999999998,"5min":2.403,"15min":6.5270000000000001},"last":0.498}]},{"osd":6,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.497,"15min":0.60399999999999998},"min":{"1min":0.36699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83599999999999997,"5min":0.89100000000000001,"15min":14.805999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.52000000000000002,"15min":0.58799999999999997},"min":{"1min":0.45600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.48399999999999999}]},{"osd":7,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.67600000000000005,"15min":0.63500000000000001},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.79100000000000004,"5min":12.135999999999999,"15min":12.135999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.81299999999999994,"15min":0.74099999999999999},"min":{"1min":0.45700000000000002,"5min":0.33300000000000002,"15min":0.29699999999999999},"max":{"1min":0.86199999999999999,"5min":21.465,"15min":21.465},"last":0.58099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574957,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339528,"kb_used_data":209852,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94032312,"statfs":{"total":96636764160,"available":96289087488,"internally_reserved":0,"allocated":214888448,"data_stored":214639791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132774342},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.88900000000000001,"15min":0.65900000000000003},"min":{"1min":0.30499999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.63600000000000001,"5min":48.045999999999999,"15min":48.045999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48599999999999999,"15min":0.52400000000000002},"min":{"1min":0.28899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60199999999999998,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.64700000000000002}]},{"osd":1,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65100000000000002,"5min":3.8959999999999999,"15min":3.8959999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.501,"5min":0.47499999999999998,"15min":0.54900000000000004},"min":{"1min":0.28999999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.755},"last":0.80600000000000005}]},{"osd":2,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.58499999999999996,"15min":0.56399999999999995},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59199999999999997,"5min":13.271000000000001,"15min":13.271000000000001},"last":0.749},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.35899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63500000000000001,"5min":7.141,"15min":7.141},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.93000000000000005,"15min":0.68999999999999995},"min":{"1min":0.33600000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.78200000000000003,"5min":47.875999999999998,"15min":47.875999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.66500000000000004,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.71199999999999997}]},{"osd":4,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51300000000000001,"15min":0.498},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66700000000000004,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.38200000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.74199999999999999,"5min":2.657,"15min":2.657},"last":0.52600000000000002}]},{"osd":6,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57699999999999996,"15min":0.54100000000000004},"min":{"1min":0.374,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82299999999999995,"5min":6.9050000000000002,"15min":6.9050000000000002},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59199999999999997,"15min":0.55400000000000005},"min":{"1min":0.442,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70699999999999996,"5min":5.9770000000000003,"15min":5.9770000000000003},"last":0.61299999999999999}]},{"osd":7,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56899999999999995,"15min":0.55800000000000005},"min":{"1min":0.44700000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80200000000000005,"5min":3.8530000000000002,"15min":3.8530000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.49399999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76700000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.79200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":234893312,"data_stored":234881662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":260059136,"data_stored":260051894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":104857600,"data_stored":104857600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":186781696,"data_stored":186771086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":213925888,"data_stored":213914516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":214462464,"data_stored":214454679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":251817984,"data_stored":251806246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":301993984,"data_stored":301990470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-25T23:44:42.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T23:44:42.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.666+0000 7f41c8ebd700 1 -- 172.21.15.81:0/4093102678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41ac004850 msgr2=0x7f41ac004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:42.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.666+0000 7f41c8ebd700 1 --2- 172.21.15.81:0/4093102678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41ac004850 0x7f41ac004cd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f41b800c310 tx=0x7f41ac005880 comp rx=0 tx=0).stop 2023-10-25T23:44:42.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.667+0000 7f41c8ebd700 1 -- 172.21.15.81:0/4093102678 shutdown_connections 2023-10-25T23:44:42.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.667+0000 7f41c8ebd700 1 --2- 172.21.15.81:0/4093102678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41ac004850 0x7f41ac004cd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.667+0000 7f41c8ebd700 1 -- 172.21.15.81:0/4093102678 >> 172.21.15.81:0/4093102678 conn(0x7f41c40c1b30 msgr2=0x7f41c40c1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:42.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.667+0000 7f41c8ebd700 1 -- 172.21.15.81:0/4093102678 shutdown_connections 2023-10-25T23:44:42.670 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.667+0000 7f41c8ebd700 1 -- 172.21.15.81:0/4093102678 wait complete. 2023-10-25T23:44:42.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.668+0000 7f41c8ebd700 1 Processor -- start 2023-10-25T23:44:42.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.668+0000 7f41c8ebd700 1 -- start start 2023-10-25T23:44:42.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.668+0000 7f41c8ebd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41ac004850 0x7f41c40bb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:42.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.668+0000 7f41c8ebd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41c41e5d70 0x7f41c41e61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:42.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.668+0000 7f41c8ebd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41c41e2d10 0x7f41c41e31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:42.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.668+0000 7f41c8ebd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c40b8890 con 0x7f41c41e5d70 2023-10-25T23:44:42.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.668+0000 7f41c8ebd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c414d5a0 con 0x7f41c41e2d10 2023-10-25T23:44:42.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.668+0000 7f41c8ebd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c40bb7b0 con 0x7f41ac004850 2023-10-25T23:44:42.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.669+0000 7f41c1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41c41e5d70 0x7f41c41e61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:42.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.669+0000 7f41c1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41c41e5d70 0x7f41c41e61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37106/0 (socket says 172.21.15.81:37106) 2023-10-25T23:44:42.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.669+0000 7f41c1d9b700 1 -- 172.21.15.81:0/3646122695 learned_addr learned my addr 172.21.15.81:0/3646122695 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:42.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.669+0000 7f41c259c700 1 --2- 172.21.15.81:0/3646122695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41ac004850 0x7f41c40bb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:42.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.669+0000 7f41c2d9d700 1 --2- 172.21.15.81:0/3646122695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41c41e2d10 0x7f41c41e31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:42.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.669+0000 7f41c1d9b700 1 -- 172.21.15.81:0/3646122695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41ac004850 msgr2=0x7f41c40bb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:42.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.669+0000 7f41c1d9b700 1 --2- 172.21.15.81:0/3646122695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41ac004850 0x7f41c40bb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.680 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.669+0000 7f41c1d9b700 1 -- 172.21.15.81:0/3646122695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41c41e2d10 msgr2=0x7f41c41e31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:42.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.669+0000 7f41c1d9b700 1 --2- 172.21.15.81:0/3646122695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41c41e2d10 0x7f41c41e31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.669+0000 7f41c1d9b700 1 -- 172.21.15.81:0/3646122695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c41e3700 con 0x7f41c41e5d70 2023-10-25T23:44:42.681 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.669+0000 7f41c2d9d700 1 --2- 172.21.15.81:0/3646122695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41c41e2d10 0x7f41c41e31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:44:42.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.669+0000 7f41c1d9b700 1 --2- 172.21.15.81:0/3646122695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41c41e5d70 0x7f41c41e61f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f41b800c900 tx=0x7f41b8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:42.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.669+0000 7f41b2ffd700 1 -- 172.21.15.81:0/3646122695 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b8003880 con 0x7f41c41e5d70 2023-10-25T23:44:42.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.669+0000 7f41b2ffd700 1 -- 172.21.15.81:0/3646122695 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f41b8003ad0 con 0x7f41c41e5d70 2023-10-25T23:44:42.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.669+0000 7f41c8ebd700 1 -- 172.21.15.81:0/3646122695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c41e6730 con 0x7f41c41e5d70 2023-10-25T23:44:42.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.669+0000 7f41b2ffd700 1 -- 172.21.15.81:0/3646122695 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b8001640 con 0x7f41c41e5d70 2023-10-25T23:44:42.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.669+0000 7f41c8ebd700 1 -- 172.21.15.81:0/3646122695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c414d7f0 con 0x7f41c41e5d70 2023-10-25T23:44:42.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.670+0000 7f41c8ebd700 1 -- 172.21.15.81:0/3646122695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c40b5160 con 0x7f41c41e5d70 2023-10-25T23:44:42.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.671+0000 7f41b2ffd700 1 -- 172.21.15.81:0/3646122695 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f41b8021020 con 0x7f41c41e5d70 2023-10-25T23:44:42.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.671+0000 7f41b2ffd700 1 --2- 172.21.15.81:0/3646122695 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f41a406aed0 0x7f41a406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:42.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.671+0000 7f41b2ffd700 1 -- 172.21.15.81:0/3646122695 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f41b808b340 con 0x7f41c41e5d70 2023-10-25T23:44:42.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.671+0000 7f41c259c700 1 --2- 172.21.15.81:0/3646122695 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f41a406aed0 0x7f41a406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:42.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.672+0000 7f41c259c700 1 --2- 172.21.15.81:0/3646122695 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f41a406aed0 0x7f41a406d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f41b4000f60 tx=0x7f41b4000ed0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:42.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.675+0000 7f41b2ffd700 1 -- 172.21.15.81:0/3646122695 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41b80563d0 con 0x7f41c41e5d70 2023-10-25T23:44:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.865+0000 7f41c8ebd700 1 -- 172.21.15.81:0/3646122695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41c404e4c0 con 0x7f41c41e5d70 2023-10-25T23:44:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.866+0000 7f41b2ffd700 1 -- 172.21.15.81:0/3646122695 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16820 (secure 0 0 0) 0x7f41b80599f0 con 0x7f41c41e5d70 2023-10-25T23:44:42.868 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:44:42.869 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"fsid":"97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf","created":"2023-10-25T23:35:42.986840+0000","modified":"2023-10-25T23:44:38.868183+0000","last_up_change":"2023-10-25T23:35:55.052199+0000","last_in_change":"2023-10-25T23:35:46.443490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T23:35:57.031170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T23:36:06.841771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T23:36:07.613269+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":689,"snap_epoch":40,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48415836-8f22-4dcd-baa3-1d09c90c9a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6809","nonce":1045657984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6811","nonce":1045657984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6815","nonce":1045657984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6813","nonce":1045657984}]},"public_addr":"172.21.15.81:6809/1045657984","cluster_addr":"172.21.15.81:6811/1045657984","heartbeat_back_addr":"172.21.15.81:6815/1045657984","heartbeat_front_addr":"172.21.15.81:6813/1045657984","state":["exists","up"]},{"osd":1,"uuid":"19a4f6b5-e75c-45ae-aa08-b3467e69eed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6801","nonce":725386907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6803","nonce":725386907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6807","nonce":725386907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6805","nonce":725386907}]},"public_addr":"172.21.15.81:6801/725386907","cluster_addr":"172.21.15.81:6803/725386907","heartbeat_back_addr":"172.21.15.81:6807/725386907","heartbeat_front_addr":"172.21.15.81:6805/725386907","state":["exists","up"]},{"osd":2,"uuid":"60645312-54f5-4a74-ae52-68d17ff2d6e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6825","nonce":1744054610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6827","nonce":1744054610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6831","nonce":1744054610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6829","nonce":1744054610}]},"public_addr":"172.21.15.81:6825/1744054610","cluster_addr":"172.21.15.81:6827/1744054610","heartbeat_back_addr":"172.21.15.81:6831/1744054610","heartbeat_front_addr":"172.21.15.81:6829/1744054610","state":["exists","up"]},{"osd":3,"uuid":"c636a4a2-c1e8-4306-a78b-fe37eebab526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6817","nonce":1391123341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6819","nonce":1391123341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6823","nonce":1391123341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6821","nonce":1391123341}]},"public_addr":"172.21.15.81:6817/1391123341","cluster_addr":"172.21.15.81:6819/1391123341","heartbeat_back_addr":"172.21.15.81:6823/1391123341","heartbeat_front_addr":"172.21.15.81:6821/1391123341","state":["exists","up"]},{"osd":4,"uuid":"3cafc826-e531-4aa7-8b2a-b592f318f138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6817","nonce":1232781703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6819","nonce":1232781703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6823","nonce":1232781703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6821","nonce":1232781703}]},"public_addr":"172.21.15.89:6817/1232781703","cluster_addr":"172.21.15.89:6819/1232781703","heartbeat_back_addr":"172.21.15.89:6823/1232781703","heartbeat_front_addr":"172.21.15.89:6821/1232781703","state":["exists","up"]},{"osd":5,"uuid":"6098deb2-258e-47e1-b283-9a24c9dddf27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6801","nonce":2255820086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6803","nonce":2255820086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6807","nonce":2255820086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6805","nonce":2255820086}]},"public_addr":"172.21.15.89:6801/2255820086","cluster_addr":"172.21.15.89:6803/2255820086","heartbeat_back_addr":"172.21.15.89:6807/2255820086","heartbeat_front_addr":"172.21.15.89:6805/2255820086","state":["exists","up"]},{"osd":6,"uuid":"d79f68de-3c19-4f68-bbd1-59c8484dfaa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6809","nonce":2561967165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6811","nonce":2561967165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6815","nonce":2561967165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6813","nonce":2561967165}]},"public_addr":"172.21.15.89:6809/2561967165","cluster_addr":"172.21.15.89:6811/2561967165","heartbeat_back_addr":"172.21.15.89:6815/2561967165","heartbeat_front_addr":"172.21.15.89:6813/2561967165","state":["exists","up"]},{"osd":7,"uuid":"f1f7002e-4de9-4a08-97a1-fb52a116687f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6825","nonce":2647243500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6827","nonce":2647243500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6831","nonce":2647243500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6829","nonce":2647243500}]},"public_addr":"172.21.15.89:6825/2647243500","cluster_addr":"172.21.15.89:6827/2647243500","heartbeat_back_addr":"172.21.15.89:6831/2647243500","heartbeat_front_addr":"172.21.15.89:6829/2647243500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.613750+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.593515+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.713198+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.725623+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.686409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.596728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.670930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.676762+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":686,"length":4}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":686,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T23:44:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.869+0000 7f41c8ebd700 1 -- 172.21.15.81:0/3646122695 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f41a406aed0 msgr2=0x7f41a406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.869+0000 7f41c8ebd700 1 --2- 172.21.15.81:0/3646122695 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f41a406aed0 0x7f41a406d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f41b4000f60 tx=0x7f41b4000ed0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.869+0000 7f41c8ebd700 1 -- 172.21.15.81:0/3646122695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41c41e5d70 msgr2=0x7f41c41e61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.869+0000 7f41c8ebd700 1 --2- 172.21.15.81:0/3646122695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41c41e5d70 0x7f41c41e61f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f41b800c900 tx=0x7f41b8000ed0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.869+0000 7f41c8ebd700 1 -- 172.21.15.81:0/3646122695 shutdown_connections 2023-10-25T23:44:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.869+0000 7f41c8ebd700 1 --2- 172.21.15.81:0/3646122695 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f41a406aed0 0x7f41a406d390 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.869+0000 7f41c8ebd700 1 --2- 172.21.15.81:0/3646122695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41c41e2d10 0x7f41c41e31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.869+0000 7f41c8ebd700 1 --2- 172.21.15.81:0/3646122695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f41ac004850 0x7f41c40bb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.869+0000 7f41c8ebd700 1 --2- 172.21.15.81:0/3646122695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41c41e5d70 0x7f41c41e61f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.869+0000 7f41c8ebd700 1 -- 172.21.15.81:0/3646122695 >> 172.21.15.81:0/3646122695 conn(0x7f41c40c1b30 msgr2=0x7f41c40bee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.869+0000 7f41c8ebd700 1 -- 172.21.15.81:0/3646122695 shutdown_connections 2023-10-25T23:44:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:42.869+0000 7f41c8ebd700 1 -- 172.21.15.81:0/3646122695 wait complete. 2023-10-25T23:44:43.884 INFO:tasks.ceph:Scrubbing osd.0 2023-10-25T23:44:43.885 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-25T23:44:44.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.022+0000 7fcedd18a700 1 -- 172.21.15.81:0/481311672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced80b3e30 msgr2=0x7fced80ba3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.022+0000 7fcedd18a700 1 --2- 172.21.15.81:0/481311672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced80b3e30 0x7fced80ba3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fced8070e10 tx=0x7fcecc009c70 comp rx=0 tx=0).stop 2023-10-25T23:44:44.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.022+0000 7fcedd18a700 1 -- 172.21.15.81:0/481311672 shutdown_connections 2023-10-25T23:44:44.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.022+0000 7fcedd18a700 1 --2- 172.21.15.81:0/481311672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced80b3e30 0x7fced80ba3c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.022+0000 7fcedd18a700 1 --2- 172.21.15.81:0/481311672 >> v2:172.21.15.89:3300/0 conn(0x7fced814bbd0 0x7fced814e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.022+0000 7fcedd18a700 1 -- 172.21.15.81:0/481311672 >> 172.21.15.81:0/481311672 conn(0x7fced806b320 msgr2=0x7fced806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:44.026 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.022+0000 7fcedd18a700 1 -- 172.21.15.81:0/481311672 shutdown_connections 2023-10-25T23:44:44.027 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.022+0000 7fcedd18a700 1 -- 172.21.15.81:0/481311672 wait complete. 2023-10-25T23:44:44.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.024+0000 7fcedd18a700 1 Processor -- start 2023-10-25T23:44:44.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.024+0000 7fcedd18a700 1 -- start start 2023-10-25T23:44:44.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.024+0000 7fcedd18a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced80b3e30 0x7fced813f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:44.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.024+0000 7fcedd18a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fced80ba900 0x7fced81e4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:44.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.024+0000 7fcedd18a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fced814bbd0 0x7fced813b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:44.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.024+0000 7fcedd18a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced813d7d0 con 0x7fced80b3e30 2023-10-25T23:44:44.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.024+0000 7fcedd18a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced813cb90 con 0x7fced814bbd0 2023-10-25T23:44:44.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.024+0000 7fcedd18a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced814c7e0 con 0x7fced80ba900 2023-10-25T23:44:44.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.024+0000 7fced6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced80b3e30 0x7fced813f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:44.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.024+0000 7fced6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced80b3e30 0x7fced813f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37118/0 (socket says 172.21.15.81:37118) 2023-10-25T23:44:44.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.024+0000 7fced6d9d700 1 -- 172.21.15.81:0/3096106498 learned_addr learned my addr 172.21.15.81:0/3096106498 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:44.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.025+0000 7fced659c700 1 --2- 172.21.15.81:0/3096106498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fced80ba900 0x7fced81e4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:44.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.025+0000 7fced759e700 1 --2- 172.21.15.81:0/3096106498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fced814bbd0 0x7fced813b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:44.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.025+0000 7fced6d9d700 1 -- 172.21.15.81:0/3096106498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fced80ba900 msgr2=0x7fced81e4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.025+0000 7fced6d9d700 1 --2- 172.21.15.81:0/3096106498 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fced80ba900 0x7fced81e4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.025+0000 7fced6d9d700 1 -- 172.21.15.81:0/3096106498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fced814bbd0 msgr2=0x7fced813b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.025+0000 7fced6d9d700 1 --2- 172.21.15.81:0/3096106498 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fced814bbd0 0x7fced813b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.025+0000 7fced6d9d700 1 -- 172.21.15.81:0/3096106498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc0095f0 con 0x7fced80b3e30 2023-10-25T23:44:44.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.025+0000 7fced6d9d700 1 --2- 172.21.15.81:0/3096106498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced80b3e30 0x7fced813f070 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcecc005fd0 tx=0x7fcecc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:44.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.025+0000 7fcebf7fe700 1 -- 172.21.15.81:0/3096106498 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc01d070 con 0x7fced80b3e30 2023-10-25T23:44:44.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.025+0000 7fcebf7fe700 1 -- 172.21.15.81:0/3096106498 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcecc003890 con 0x7fced80b3e30 2023-10-25T23:44:44.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.025+0000 7fcebf7fe700 1 -- 172.21.15.81:0/3096106498 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc0045f0 con 0x7fced80b3e30 2023-10-25T23:44:44.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.025+0000 7fcedd18a700 1 -- 172.21.15.81:0/3096106498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced814c4b0 con 0x7fced80b3e30 2023-10-25T23:44:44.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.025+0000 7fcedd18a700 1 -- 172.21.15.81:0/3096106498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced813cde0 con 0x7fced80b3e30 2023-10-25T23:44:44.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.026+0000 7fcedd18a700 1 -- 172.21.15.81:0/3096106498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fced80b7fd0 con 0x7fced80b3e30 2023-10-25T23:44:44.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.026+0000 7fcebf7fe700 1 -- 172.21.15.81:0/3096106498 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcecc003ca0 con 0x7fced80b3e30 2023-10-25T23:44:44.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.027+0000 7fcebf7fe700 1 --2- 172.21.15.81:0/3096106498 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fcec406aed0 0x7fcec406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:44.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.027+0000 7fcebf7fe700 1 -- 172.21.15.81:0/3096106498 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fcecc08b1a0 con 0x7fced80b3e30 2023-10-25T23:44:44.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.027+0000 7fcebf7fe700 1 --2- 172.21.15.81:0/3096106498 >> [v2:172.21.15.81:6808/1045657984,v1:172.21.15.81:6809/1045657984] conn(0x7fcec40732d0 0x7fcec4075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:44.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.027+0000 7fcebf7fe700 1 -- 172.21.15.81:0/3096106498 --> [v2:172.21.15.81:6808/1045657984,v1:172.21.15.81:6809/1045657984] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcec4075e40 con 0x7fcec40732d0 2023-10-25T23:44:44.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.027+0000 7fcebf7fe700 1 -- 172.21.15.81:0/3096106498 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcecc08b5f0 con 0x7fced80b3e30 2023-10-25T23:44:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.027+0000 7fced659c700 1 --2- 172.21.15.81:0/3096106498 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fcec406aed0 0x7fcec406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.027+0000 7fced759e700 1 --2- 172.21.15.81:0/3096106498 >> [v2:172.21.15.81:6808/1045657984,v1:172.21.15.81:6809/1045657984] conn(0x7fcec40732d0 0x7fcec4075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.027+0000 7fced759e700 1 --2- 172.21.15.81:0/3096106498 >> [v2:172.21.15.81:6808/1045657984,v1:172.21.15.81:6809/1045657984] conn(0x7fcec40732d0 0x7fcec4075770 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:44.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.028+0000 7fced659c700 1 --2- 172.21.15.81:0/3096106498 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fcec406aed0 0x7fcec406d390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcec8005950 tx=0x7fcec80058e0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:44.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.028+0000 7fcebf7fe700 1 -- 172.21.15.81:0/3096106498 <== osd.0 v2:172.21.15.81:6808/1045657984 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fcec4075e40 con 0x7fcec40732d0 2023-10-25T23:44:44.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.043+0000 7fcedd18a700 1 -- 172.21.15.81:0/3096106498 --> [v2:172.21.15.81:6808/1045657984,v1:172.21.15.81:6809/1045657984] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fced814c310 con 0x7fcec40732d0 2023-10-25T23:44:44.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.043+0000 7fcebf7fe700 1 -- 172.21.15.81:0/3096106498 <== osd.0 v2:172.21.15.81:6808/1045657984 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fced814c310 con 0x7fcec40732d0 2023-10-25T23:44:44.045 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-25T23:44:44.046 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-10-25T23:44:44.046 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-25T23:44:44.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.043+0000 7fcedd18a700 1 -- 172.21.15.81:0/3096106498 >> [v2:172.21.15.81:6808/1045657984,v1:172.21.15.81:6809/1045657984] conn(0x7fcec40732d0 msgr2=0x7fcec4075770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.043+0000 7fcedd18a700 1 --2- 172.21.15.81:0/3096106498 >> [v2:172.21.15.81:6808/1045657984,v1:172.21.15.81:6809/1045657984] conn(0x7fcec40732d0 0x7fcec4075770 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.043+0000 7fcedd18a700 1 -- 172.21.15.81:0/3096106498 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fcec406aed0 msgr2=0x7fcec406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.043+0000 7fcedd18a700 1 --2- 172.21.15.81:0/3096106498 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fcec406aed0 0x7fcec406d390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcec8005950 tx=0x7fcec80058e0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.043+0000 7fcedd18a700 1 -- 172.21.15.81:0/3096106498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced80b3e30 msgr2=0x7fced813f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.043+0000 7fcedd18a700 1 --2- 172.21.15.81:0/3096106498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fced80b3e30 0x7fced813f070 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcecc005fd0 tx=0x7fcecc0042f0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.043+0000 7fced759e700 1 -- 172.21.15.81:0/3096106498 reap_dead start 2023-10-25T23:44:44.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.043+0000 7fcedd18a700 1 -- 172.21.15.81:0/3096106498 shutdown_connections 2023-10-25T23:44:44.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.043+0000 7fcedd18a700 1 -- 172.21.15.81:0/3096106498 >> 172.21.15.81:0/3096106498 conn(0x7fced806b320 msgr2=0x7fced806f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:44.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.043+0000 7fcedd18a700 1 -- 172.21.15.81:0/3096106498 shutdown_connections 2023-10-25T23:44:44.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.043+0000 7fcedd18a700 1 -- 172.21.15.81:0/3096106498 wait complete. 2023-10-25T23:44:44.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-25T23:44:44.180 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.178+0000 7f5de6a8f700 1 -- 172.21.15.81:0/2985334876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de00bb530 msgr2=0x7f5de00bd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.178+0000 7f5de6a8f700 1 --2- 172.21.15.81:0/2985334876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de00bb530 0x7f5de00bd5c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5de00bb1f0 tx=0x7f5dcc009c70 comp rx=0 tx=0).stop 2023-10-25T23:44:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.178+0000 7f5de6a8f700 1 -- 172.21.15.81:0/2985334876 shutdown_connections 2023-10-25T23:44:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.178+0000 7f5de6a8f700 1 --2- 172.21.15.81:0/2985334876 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5de00bdb00 0x7f5de014e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.178+0000 7f5de6a8f700 1 --2- 172.21.15.81:0/2985334876 >> v2:172.21.15.89:3300/0 conn(0x7f5de0144f60 0x7f5de014b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.178+0000 7f5de6a8f700 1 --2- 172.21.15.81:0/2985334876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de00bb530 0x7f5de00bd5c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.178+0000 7f5de6a8f700 1 -- 172.21.15.81:0/2985334876 >> 172.21.15.81:0/2985334876 conn(0x7f5de006b320 msgr2=0x7f5de006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.178+0000 7f5de6a8f700 1 -- 172.21.15.81:0/2985334876 shutdown_connections 2023-10-25T23:44:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.178+0000 7f5de6a8f700 1 -- 172.21.15.81:0/2985334876 wait complete. 2023-10-25T23:44:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.180+0000 7f5de6a8f700 1 Processor -- start 2023-10-25T23:44:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.180+0000 7f5de6a8f700 1 -- start start 2023-10-25T23:44:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.180+0000 7f5de6a8f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5de00bb530 0x7f5de01d5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.180+0000 7f5de6a8f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5de00bdb00 0x7f5de01e7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.180+0000 7f5de6a8f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de0144f60 0x7f5de00ba9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.180+0000 7f5de6a8f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de01e4f30 con 0x7f5de0144f60 2023-10-25T23:44:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.180+0000 7f5de6a8f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de01d64e0 con 0x7f5de00bdb00 2023-10-25T23:44:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.180+0000 7f5de6a8f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de01e4680 con 0x7f5de00bb530 2023-10-25T23:44:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.180+0000 7f5de502c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de0144f60 0x7f5de00ba9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.181+0000 7f5de502c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de0144f60 0x7f5de00ba9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37134/0 (socket says 172.21.15.81:37134) 2023-10-25T23:44:44.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.181+0000 7f5de502c700 1 -- 172.21.15.81:0/3282194743 learned_addr learned my addr 172.21.15.81:0/3282194743 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:44.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.181+0000 7f5ddffff700 1 --2- 172.21.15.81:0/3282194743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5de00bdb00 0x7f5de01e7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:44.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.181+0000 7f5de482b700 1 --2- 172.21.15.81:0/3282194743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5de00bb530 0x7f5de01d5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:44.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.181+0000 7f5de502c700 1 -- 172.21.15.81:0/3282194743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5de00bb530 msgr2=0x7f5de01d5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.181+0000 7f5de502c700 1 --2- 172.21.15.81:0/3282194743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5de00bb530 0x7f5de01d5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.181+0000 7f5de502c700 1 -- 172.21.15.81:0/3282194743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5de00bdb00 msgr2=0x7f5de01e7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.181+0000 7f5de502c700 1 --2- 172.21.15.81:0/3282194743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5de00bdb00 0x7f5de01e7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.181+0000 7f5de502c700 1 -- 172.21.15.81:0/3282194743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dcc0095f0 con 0x7f5de0144f60 2023-10-25T23:44:44.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.181+0000 7f5de482b700 1 --2- 172.21.15.81:0/3282194743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5de00bb530 0x7f5de01d5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:44:44.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.181+0000 7f5de502c700 1 --2- 172.21.15.81:0/3282194743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de0144f60 0x7f5de00ba9a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800ab80 tx=0x7f5dd800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:44.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.181+0000 7f5ddd7fa700 1 -- 172.21.15.81:0/3282194743 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd800f070 con 0x7f5de0144f60 2023-10-25T23:44:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.181+0000 7f5ddd7fa700 1 -- 172.21.15.81:0/3282194743 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5dd8004bb0 con 0x7f5de0144f60 2023-10-25T23:44:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.181+0000 7f5de6a8f700 1 -- 172.21.15.81:0/3282194743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de01e81b0 con 0x7f5de0144f60 2023-10-25T23:44:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.181+0000 7f5ddd7fa700 1 -- 172.21.15.81:0/3282194743 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd800c710 con 0x7f5de0144f60 2023-10-25T23:44:44.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.181+0000 7f5de6a8f700 1 -- 172.21.15.81:0/3282194743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de00baee0 con 0x7f5de0144f60 2023-10-25T23:44:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.182+0000 7f5de6a8f700 1 -- 172.21.15.81:0/3282194743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de01e5070 con 0x7f5de0144f60 2023-10-25T23:44:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.183+0000 7f5ddd7fa700 1 -- 172.21.15.81:0/3282194743 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5dd800c870 con 0x7f5de0144f60 2023-10-25T23:44:44.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.183+0000 7f5ddd7fa700 1 --2- 172.21.15.81:0/3282194743 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f5dc406aed0 0x7f5dc406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.183+0000 7f5ddd7fa700 1 -- 172.21.15.81:0/3282194743 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f5dd80892f0 con 0x7f5de0144f60 2023-10-25T23:44:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.183+0000 7f5de482b700 1 --2- 172.21.15.81:0/3282194743 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f5dc406aed0 0x7f5dc406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.183+0000 7f5de482b700 1 --2- 172.21.15.81:0/3282194743 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f5dc406aed0 0x7f5dc406d390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4005fd0 tx=0x7f5dd4005ee0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.187+0000 7f5ddd7fa700 1 -- 172.21.15.81:0/3282194743 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5de01e5070 con 0x7f5de0144f60 2023-10-25T23:44:44.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.376+0000 7f5de6a8f700 1 -- 172.21.15.81:0/3282194743 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f5de014b190 con 0x7f5dc406aed0 2023-10-25T23:44:44.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.377+0000 7f5ddd7fa700 1 -- 172.21.15.81:0/3282194743 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5dd40098a0 con 0x7f5dc406aed0 2023-10-25T23:44:44.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.379+0000 7f5de6a8f700 1 -- 172.21.15.81:0/3282194743 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f5dc406aed0 msgr2=0x7f5dc406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.381 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.379+0000 7f5de6a8f700 1 --2- 172.21.15.81:0/3282194743 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f5dc406aed0 0x7f5dc406d390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4005fd0 tx=0x7f5dd4005ee0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.379+0000 7f5de6a8f700 1 -- 172.21.15.81:0/3282194743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de0144f60 msgr2=0x7f5de00ba9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.379+0000 7f5de6a8f700 1 --2- 172.21.15.81:0/3282194743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de0144f60 0x7f5de00ba9a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800ab80 tx=0x7f5dd800af40 comp rx=0 tx=0).stop 2023-10-25T23:44:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.379+0000 7f5de6a8f700 1 -- 172.21.15.81:0/3282194743 shutdown_connections 2023-10-25T23:44:44.382 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.379+0000 7f5de6a8f700 1 --2- 172.21.15.81:0/3282194743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5de0144f60 0x7f5de00ba9a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.379+0000 7f5de6a8f700 1 --2- 172.21.15.81:0/3282194743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5de00bb530 0x7f5de01d5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.379+0000 7f5de6a8f700 1 --2- 172.21.15.81:0/3282194743 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f5dc406aed0 0x7f5dc406d390 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.383 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.379+0000 7f5de6a8f700 1 --2- 172.21.15.81:0/3282194743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5de00bdb00 0x7f5de01e7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.379+0000 7f5de6a8f700 1 -- 172.21.15.81:0/3282194743 >> 172.21.15.81:0/3282194743 conn(0x7f5de006b320 msgr2=0x7f5de0144490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:44.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.379+0000 7f5de6a8f700 1 -- 172.21.15.81:0/3282194743 shutdown_connections 2023-10-25T23:44:44.384 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.379+0000 7f5de6a8f700 1 -- 172.21.15.81:0/3282194743 wait complete. 2023-10-25T23:44:44.385 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 0 to deep-scrub 2023-10-25T23:44:44.393 INFO:tasks.ceph:Scrubbing osd.1 2023-10-25T23:44:44.394 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-25T23:44:44.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.518+0000 7f0a13347700 1 -- 172.21.15.81:0/98099083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a0c0b3e30 msgr2=0x7f0a0c0ba3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.518+0000 7f0a13347700 1 --2- 172.21.15.81:0/98099083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a0c0b3e30 0x7f0a0c0ba3c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0a08005fd0 tx=0x7f0a08009c70 comp rx=0 tx=0).stop 2023-10-25T23:44:44.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.518+0000 7f0a13347700 1 -- 172.21.15.81:0/98099083 shutdown_connections 2023-10-25T23:44:44.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.518+0000 7f0a13347700 1 --2- 172.21.15.81:0/98099083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a0c0b3e30 0x7f0a0c0ba3c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.518+0000 7f0a13347700 1 --2- 172.21.15.81:0/98099083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a0c14bbd0 0x7f0a0c14e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.518+0000 7f0a13347700 1 -- 172.21.15.81:0/98099083 >> 172.21.15.81:0/98099083 conn(0x7f0a0c06b320 msgr2=0x7f0a0c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:44.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.518+0000 7f0a13347700 1 -- 172.21.15.81:0/98099083 shutdown_connections 2023-10-25T23:44:44.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.518+0000 7f0a13347700 1 -- 172.21.15.81:0/98099083 wait complete. 2023-10-25T23:44:44.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.519+0000 7f0a13347700 1 Processor -- start 2023-10-25T23:44:44.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.519+0000 7f0a13347700 1 -- start start 2023-10-25T23:44:44.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.520+0000 7f0a13347700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a0c0b3e30 0x7f0a0c13fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:44.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.520+0000 7f0a13347700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a0c0ba900 0x7f0a0c0bc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:44.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.520+0000 7f0a13347700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a0c14bbd0 0x7f0a0c1e4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:44.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.520+0000 7f0a13347700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0b7270 con 0x7f0a0c0ba900 2023-10-25T23:44:44.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.520+0000 7f0a13347700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c140150 con 0x7f0a0c14bbd0 2023-10-25T23:44:44.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.520+0000 7f0a13347700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c147410 con 0x7f0a0c0b3e30 2023-10-25T23:44:44.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.520+0000 7f0a108e2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a0c0ba900 0x7f0a0c0bc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:44.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.520+0000 7f0a108e2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a0c0ba900 0x7f0a0c0bc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37146/0 (socket says 172.21.15.81:37146) 2023-10-25T23:44:44.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.520+0000 7f0a108e2700 1 -- 172.21.15.81:0/2957176516 learned_addr learned my addr 172.21.15.81:0/2957176516 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:44.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.520+0000 7f0a118e4700 1 --2- 172.21.15.81:0/2957176516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a0c14bbd0 0x7f0a0c1e4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:44.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.520+0000 7f0a110e3700 1 --2- 172.21.15.81:0/2957176516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a0c0b3e30 0x7f0a0c13fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:44.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.520+0000 7f0a108e2700 1 -- 172.21.15.81:0/2957176516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a0c0b3e30 msgr2=0x7f0a0c13fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.520+0000 7f0a108e2700 1 --2- 172.21.15.81:0/2957176516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0a0c0b3e30 0x7f0a0c13fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.520+0000 7f0a108e2700 1 -- 172.21.15.81:0/2957176516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a0c14bbd0 msgr2=0x7f0a0c1e4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.520+0000 7f0a108e2700 1 --2- 172.21.15.81:0/2957176516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a0c14bbd0 0x7f0a0c1e4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.520+0000 7f0a108e2700 1 -- 172.21.15.81:0/2957176516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a080095f0 con 0x7f0a0c0ba900 2023-10-25T23:44:44.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.520+0000 7f0a108e2700 1 --2- 172.21.15.81:0/2957176516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a0c0ba900 0x7f0a0c0bc830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00b450 tx=0x7f09fc00b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:44.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.520+0000 7f0a01ffb700 1 -- 172.21.15.81:0/2957176516 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc011830 con 0x7f0a0c0ba900 2023-10-25T23:44:44.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.521+0000 7f0a01ffb700 1 -- 172.21.15.81:0/2957176516 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f09fc011a80 con 0x7f0a0c0ba900 2023-10-25T23:44:44.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.521+0000 7f0a13347700 1 -- 172.21.15.81:0/2957176516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0c14ec90 con 0x7f0a0c0ba900 2023-10-25T23:44:44.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.521+0000 7f0a01ffb700 1 -- 172.21.15.81:0/2957176516 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc011e90 con 0x7f0a0c0ba900 2023-10-25T23:44:44.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.521+0000 7f0a13347700 1 -- 172.21.15.81:0/2957176516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0c147680 con 0x7f0a0c0ba900 2023-10-25T23:44:44.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.521+0000 7f0a13347700 1 -- 172.21.15.81:0/2957176516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a0c0b7fd0 con 0x7f0a0c0ba900 2023-10-25T23:44:44.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.522+0000 7f0a01ffb700 1 -- 172.21.15.81:0/2957176516 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f09fc01a400 con 0x7f0a0c0ba900 2023-10-25T23:44:44.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.522+0000 7f0a01ffb700 1 --2- 172.21.15.81:0/2957176516 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f09f006af00 0x7f09f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:44.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.522+0000 7f0a01ffb700 1 -- 172.21.15.81:0/2957176516 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f09fc089780 con 0x7f0a0c0ba900 2023-10-25T23:44:44.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.523+0000 7f0a01ffb700 1 --2- 172.21.15.81:0/2957176516 >> [v2:172.21.15.81:6800/725386907,v1:172.21.15.81:6801/725386907] conn(0x7f09f0073190 0x7f09f0075630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:44.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.523+0000 7f0a01ffb700 1 -- 172.21.15.81:0/2957176516 --> [v2:172.21.15.81:6800/725386907,v1:172.21.15.81:6801/725386907] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09f0075d00 con 0x7f09f0073190 2023-10-25T23:44:44.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.523+0000 7f0a01ffb700 1 -- 172.21.15.81:0/2957176516 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09fc08bd60 con 0x7f0a0c0ba900 2023-10-25T23:44:44.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.523+0000 7f0a110e3700 1 --2- 172.21.15.81:0/2957176516 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f09f006af00 0x7f09f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:44.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.523+0000 7f0a118e4700 1 --2- 172.21.15.81:0/2957176516 >> [v2:172.21.15.81:6800/725386907,v1:172.21.15.81:6801/725386907] conn(0x7f09f0073190 0x7f09f0075630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:44.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.523+0000 7f0a118e4700 1 --2- 172.21.15.81:0/2957176516 >> [v2:172.21.15.81:6800/725386907,v1:172.21.15.81:6801/725386907] conn(0x7f09f0073190 0x7f09f0075630 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:44.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.523+0000 7f0a110e3700 1 --2- 172.21.15.81:0/2957176516 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f09f006af00 0x7f09f006d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0a08000c00 tx=0x7f0a080047c0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:44.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.524+0000 7f0a01ffb700 1 -- 172.21.15.81:0/2957176516 <== osd.1 v2:172.21.15.81:6800/725386907 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f09f0075d00 con 0x7f09f0073190 2023-10-25T23:44:44.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.538+0000 7f0a13347700 1 -- 172.21.15.81:0/2957176516 --> [v2:172.21.15.81:6800/725386907,v1:172.21.15.81:6801/725386907] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0a0c148960 con 0x7f09f0073190 2023-10-25T23:44:44.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.538+0000 7f0a01ffb700 1 -- 172.21.15.81:0/2957176516 <== osd.1 v2:172.21.15.81:6800/725386907 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0a0c148960 con 0x7f09f0073190 2023-10-25T23:44:44.541 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-25T23:44:44.541 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-10-25T23:44:44.541 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-25T23:44:44.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.539+0000 7f0a13347700 1 -- 172.21.15.81:0/2957176516 >> [v2:172.21.15.81:6800/725386907,v1:172.21.15.81:6801/725386907] conn(0x7f09f0073190 msgr2=0x7f09f0075630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.539+0000 7f0a13347700 1 --2- 172.21.15.81:0/2957176516 >> [v2:172.21.15.81:6800/725386907,v1:172.21.15.81:6801/725386907] conn(0x7f09f0073190 0x7f09f0075630 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.539+0000 7f0a13347700 1 -- 172.21.15.81:0/2957176516 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f09f006af00 msgr2=0x7f09f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.539+0000 7f0a13347700 1 --2- 172.21.15.81:0/2957176516 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f09f006af00 0x7f09f006d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0a08000c00 tx=0x7f0a080047c0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.539+0000 7f0a13347700 1 -- 172.21.15.81:0/2957176516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a0c0ba900 msgr2=0x7f0a0c0bc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.539+0000 7f0a13347700 1 --2- 172.21.15.81:0/2957176516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a0c0ba900 0x7f0a0c0bc830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00b450 tx=0x7f09fc00b760 comp rx=0 tx=0).stop 2023-10-25T23:44:44.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.539+0000 7f0a118e4700 1 -- 172.21.15.81:0/2957176516 reap_dead start 2023-10-25T23:44:44.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.539+0000 7f0a13347700 1 -- 172.21.15.81:0/2957176516 shutdown_connections 2023-10-25T23:44:44.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.539+0000 7f0a13347700 1 -- 172.21.15.81:0/2957176516 >> 172.21.15.81:0/2957176516 conn(0x7f0a0c06b320 msgr2=0x7f0a0c0ba1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:44.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.539+0000 7f0a13347700 1 -- 172.21.15.81:0/2957176516 shutdown_connections 2023-10-25T23:44:44.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.539+0000 7f0a13347700 1 -- 172.21.15.81:0/2957176516 wait complete. 2023-10-25T23:44:44.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-25T23:44:44.676 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.674+0000 7f6273caa700 1 -- 172.21.15.81:0/29678172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f626c06f660 msgr2=0x7f626c0bb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.674+0000 7f6273caa700 1 --2- 172.21.15.81:0/29678172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f626c06f660 0x7f626c0bb700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f626c0b7cc0 tx=0x7f6268009c70 comp rx=0 tx=0).stop 2023-10-25T23:44:44.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.674+0000 7f6273caa700 1 -- 172.21.15.81:0/29678172 shutdown_connections 2023-10-25T23:44:44.677 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.674+0000 7f6273caa700 1 --2- 172.21.15.81:0/29678172 >> v2:172.21.15.89:3300/0 conn(0x7f626c0bd570 0x7f626c0bd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.674+0000 7f6273caa700 1 --2- 172.21.15.81:0/29678172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f626c06f660 0x7f626c0bb700 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.674+0000 7f6273caa700 1 -- 172.21.15.81:0/29678172 >> 172.21.15.81:0/29678172 conn(0x7f626c06b320 msgr2=0x7f626c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:44.678 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.674+0000 7f6273caa700 1 -- 172.21.15.81:0/29678172 shutdown_connections 2023-10-25T23:44:44.679 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.674+0000 7f6273caa700 1 -- 172.21.15.81:0/29678172 wait complete. 2023-10-25T23:44:44.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.675+0000 7f6273caa700 1 Processor -- start 2023-10-25T23:44:44.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.676+0000 7f6273caa700 1 -- start start 2023-10-25T23:44:44.682 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.676+0000 7f6273caa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f626c06f660 0x7f626c1d7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:44.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.676+0000 7f6273caa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f626c0bd570 0x7f626c136e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:44.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.676+0000 7f6273caa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f626c145de0 0x7f626c1d6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:44.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.676+0000 7f6273caa700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c1d24a0 con 0x7f626c0bd570 2023-10-25T23:44:44.683 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.676+0000 7f6273caa700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c143440 con 0x7f626c145de0 2023-10-25T23:44:44.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.676+0000 7f6273caa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626c14a9a0 con 0x7f626c06f660 2023-10-25T23:44:44.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.676+0000 7f6271245700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f626c0bd570 0x7f626c136e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:44.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.676+0000 7f6271245700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f626c0bd570 0x7f626c136e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37160/0 (socket says 172.21.15.81:37160) 2023-10-25T23:44:44.684 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.676+0000 7f6271245700 1 -- 172.21.15.81:0/2400024023 learned_addr learned my addr 172.21.15.81:0/2400024023 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:44.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.676+0000 7f6272247700 1 --2- 172.21.15.81:0/2400024023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f626c145de0 0x7f626c1d6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:44.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.677+0000 7f6271a46700 1 --2- 172.21.15.81:0/2400024023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f626c06f660 0x7f626c1d7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:44.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.677+0000 7f6271245700 1 -- 172.21.15.81:0/2400024023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f626c06f660 msgr2=0x7f626c1d7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.685 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.677+0000 7f6271245700 1 --2- 172.21.15.81:0/2400024023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f626c06f660 0x7f626c1d7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.677+0000 7f6271245700 1 -- 172.21.15.81:0/2400024023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f626c145de0 msgr2=0x7f626c1d6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.677+0000 7f6271245700 1 --2- 172.21.15.81:0/2400024023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f626c145de0 0x7f626c1d6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.686 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.677+0000 7f6271245700 1 -- 172.21.15.81:0/2400024023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62680095f0 con 0x7f626c0bd570 2023-10-25T23:44:44.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.677+0000 7f6271a46700 1 --2- 172.21.15.81:0/2400024023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f626c06f660 0x7f626c1d7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:44:44.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.677+0000 7f6271245700 1 --2- 172.21.15.81:0/2400024023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f626c0bd570 0x7f626c136e80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f626c0b7f00 tx=0x7f626800be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:44.687 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.677+0000 7f62627fc700 1 -- 172.21.15.81:0/2400024023 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626801d070 con 0x7f626c0bd570 2023-10-25T23:44:44.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.677+0000 7f62627fc700 1 -- 172.21.15.81:0/2400024023 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f62680059e0 con 0x7f626c0bd570 2023-10-25T23:44:44.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.677+0000 7f6273caa700 1 -- 172.21.15.81:0/2400024023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626c14ac80 con 0x7f626c0bd570 2023-10-25T23:44:44.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.677+0000 7f62627fc700 1 -- 172.21.15.81:0/2400024023 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268003af0 con 0x7f626c0bd570 2023-10-25T23:44:44.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.677+0000 7f6273caa700 1 -- 172.21.15.81:0/2400024023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626c14b240 con 0x7f626c0bd570 2023-10-25T23:44:44.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.678+0000 7f6273caa700 1 -- 172.21.15.81:0/2400024023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626c04e4c0 con 0x7f626c0bd570 2023-10-25T23:44:44.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.678+0000 7f62627fc700 1 -- 172.21.15.81:0/2400024023 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6268003c50 con 0x7f626c0bd570 2023-10-25T23:44:44.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.679+0000 7f62627fc700 1 --2- 172.21.15.81:0/2400024023 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f625006af00 0x7f625006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:44.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.679+0000 7f62627fc700 1 -- 172.21.15.81:0/2400024023 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f626808ae10 con 0x7f626c0bd570 2023-10-25T23:44:44.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.679+0000 7f6271a46700 1 --2- 172.21.15.81:0/2400024023 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f625006af00 0x7f625006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:44.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.679+0000 7f6271a46700 1 --2- 172.21.15.81:0/2400024023 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f625006af00 0x7f625006d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f625c005fd0 tx=0x7f625c005ee0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:44.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.683+0000 7f62627fc700 1 -- 172.21.15.81:0/2400024023 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6268055e20 con 0x7f626c0bd570 2023-10-25T23:44:44.881 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.879+0000 7f6273caa700 1 -- 172.21.15.81:0/2400024023 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f626c0bbc40 con 0x7f625006af00 2023-10-25T23:44:44.882 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.880+0000 7f62627fc700 1 -- 172.21.15.81:0/2400024023 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f625c0098a0 con 0x7f625006af00 2023-10-25T23:44:44.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.882+0000 7f6273caa700 1 -- 172.21.15.81:0/2400024023 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f625006af00 msgr2=0x7f625006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.884 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.882+0000 7f6273caa700 1 --2- 172.21.15.81:0/2400024023 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f625006af00 0x7f625006d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f625c005fd0 tx=0x7f625c005ee0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.882+0000 7f6273caa700 1 -- 172.21.15.81:0/2400024023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f626c0bd570 msgr2=0x7f626c136e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:44.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.882+0000 7f6273caa700 1 --2- 172.21.15.81:0/2400024023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f626c0bd570 0x7f626c136e80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f626c0b7f00 tx=0x7f626800be90 comp rx=0 tx=0).stop 2023-10-25T23:44:44.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.882+0000 7f6273caa700 1 -- 172.21.15.81:0/2400024023 shutdown_connections 2023-10-25T23:44:44.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.882+0000 7f6273caa700 1 --2- 172.21.15.81:0/2400024023 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f625006af00 0x7f625006d3c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.882+0000 7f6273caa700 1 --2- 172.21.15.81:0/2400024023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f626c145de0 0x7f626c1d6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.882+0000 7f6273caa700 1 --2- 172.21.15.81:0/2400024023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f626c06f660 0x7f626c1d7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.886 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.882+0000 7f6273caa700 1 --2- 172.21.15.81:0/2400024023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f626c0bd570 0x7f626c136e80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:44.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.882+0000 7f6273caa700 1 -- 172.21.15.81:0/2400024023 >> 172.21.15.81:0/2400024023 conn(0x7f626c06b320 msgr2=0x7f626c13f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:44.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.882+0000 7f6273caa700 1 -- 172.21.15.81:0/2400024023 shutdown_connections 2023-10-25T23:44:44.887 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:44.882+0000 7f6273caa700 1 -- 172.21.15.81:0/2400024023 wait complete. 2023-10-25T23:44:44.888 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 1 to deep-scrub 2023-10-25T23:44:44.896 INFO:tasks.ceph:Scrubbing osd.2 2023-10-25T23:44:44.897 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-25T23:44:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.020+0000 7f8eacc1a700 1 -- 172.21.15.81:0/1896645468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea814bbd0 msgr2=0x7f8ea814e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.020+0000 7f8eacc1a700 1 --2- 172.21.15.81:0/1896645468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea814bbd0 0x7f8ea814e980 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8e98005fd0 tx=0x7f8e98009c70 comp rx=0 tx=0).stop 2023-10-25T23:44:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.021+0000 7f8eacc1a700 1 -- 172.21.15.81:0/1896645468 shutdown_connections 2023-10-25T23:44:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.021+0000 7f8eacc1a700 1 --2- 172.21.15.81:0/1896645468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea814bbd0 0x7f8ea814e980 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.021+0000 7f8eacc1a700 1 -- 172.21.15.81:0/1896645468 >> 172.21.15.81:0/1896645468 conn(0x7f8ea806b320 msgr2=0x7f8ea806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.021+0000 7f8eacc1a700 1 -- 172.21.15.81:0/1896645468 shutdown_connections 2023-10-25T23:44:45.025 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.021+0000 7f8eacc1a700 1 -- 172.21.15.81:0/1896645468 wait complete. 2023-10-25T23:44:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.022+0000 7f8eacc1a700 1 Processor -- start 2023-10-25T23:44:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.022+0000 7f8eacc1a700 1 -- start start 2023-10-25T23:44:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8eacc1a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea80b3e30 0x7f8ea813e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8eacc1a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ea80b7dc0 0x7f8ea81e5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8eacc1a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ea814bbd0 0x7f8ea8140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8eacc1a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea8146b60 con 0x7f8ea80b3e30 2023-10-25T23:44:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8eacc1a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea81471f0 con 0x7f8ea814bbd0 2023-10-25T23:44:45.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8eacc1a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea813e7c0 con 0x7f8ea80b7dc0 2023-10-25T23:44:45.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8ea659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea80b3e30 0x7f8ea813e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:45.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8ea659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea80b3e30 0x7f8ea813e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37172/0 (socket says 172.21.15.81:37172) 2023-10-25T23:44:45.030 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8ea659c700 1 -- 172.21.15.81:0/771837999 learned_addr learned my addr 172.21.15.81:0/771837999 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8ea6d9d700 1 --2- 172.21.15.81:0/771837999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ea814bbd0 0x7f8ea8140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8ea5d9b700 1 --2- 172.21.15.81:0/771837999 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ea80b7dc0 0x7f8ea81e5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8ea659c700 1 -- 172.21.15.81:0/771837999 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ea80b7dc0 msgr2=0x7f8ea81e5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8ea659c700 1 --2- 172.21.15.81:0/771837999 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8ea80b7dc0 0x7f8ea81e5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8ea659c700 1 -- 172.21.15.81:0/771837999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ea814bbd0 msgr2=0x7f8ea8140210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8ea659c700 1 --2- 172.21.15.81:0/771837999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8ea814bbd0 0x7f8ea8140210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8ea659c700 1 -- 172.21.15.81:0/771837999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e980095f0 con 0x7f8ea80b3e30 2023-10-25T23:44:45.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8ea659c700 1 --2- 172.21.15.81:0/771837999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea80b3e30 0x7f8ea813e280 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00c500 tx=0x7f8e9c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:45.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8e96ffd700 1 -- 172.21.15.81:0/771837999 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c011790 con 0x7f8ea80b3e30 2023-10-25T23:44:45.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8e96ffd700 1 -- 172.21.15.81:0/771837999 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8e9c0119e0 con 0x7f8ea80b3e30 2023-10-25T23:44:45.033 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8eacc1a700 1 -- 172.21.15.81:0/771837999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea806c140 con 0x7f8ea80b3e30 2023-10-25T23:44:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8e96ffd700 1 -- 172.21.15.81:0/771837999 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c011df0 con 0x7f8ea80b3e30 2023-10-25T23:44:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.023+0000 7f8eacc1a700 1 -- 172.21.15.81:0/771837999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea8148690 con 0x7f8ea80b3e30 2023-10-25T23:44:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.024+0000 7f8eacc1a700 1 -- 172.21.15.81:0/771837999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ea804e4c0 con 0x7f8ea80b3e30 2023-10-25T23:44:45.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.025+0000 7f8e96ffd700 1 -- 172.21.15.81:0/771837999 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8e9c01c460 con 0x7f8ea80b3e30 2023-10-25T23:44:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.025+0000 7f8e96ffd700 1 --2- 172.21.15.81:0/771837999 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f8e8806aed0 0x7f8e8806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.025+0000 7f8e96ffd700 1 -- 172.21.15.81:0/771837999 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f8e9c089670 con 0x7f8ea80b3e30 2023-10-25T23:44:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.025+0000 7f8e96ffd700 1 --2- 172.21.15.81:0/771837999 >> [v2:172.21.15.81:6824/1744054610,v1:172.21.15.81:6825/1744054610] conn(0x7f8e880732d0 0x7f8e88075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:45.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.025+0000 7f8e96ffd700 1 -- 172.21.15.81:0/771837999 --> [v2:172.21.15.81:6824/1744054610,v1:172.21.15.81:6825/1744054610] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e88075e40 con 0x7f8e880732d0 2023-10-25T23:44:45.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.025+0000 7f8e96ffd700 1 -- 172.21.15.81:0/771837999 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e9c08bd30 con 0x7f8ea80b3e30 2023-10-25T23:44:45.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.025+0000 7f8ea5d9b700 1 --2- 172.21.15.81:0/771837999 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f8e8806aed0 0x7f8e8806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:45.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.025+0000 7f8ea6d9d700 1 --2- 172.21.15.81:0/771837999 >> [v2:172.21.15.81:6824/1744054610,v1:172.21.15.81:6825/1744054610] conn(0x7f8e880732d0 0x7f8e88075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.026+0000 7f8ea6d9d700 1 --2- 172.21.15.81:0/771837999 >> [v2:172.21.15.81:6824/1744054610,v1:172.21.15.81:6825/1744054610] conn(0x7f8e880732d0 0x7f8e88075770 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.026+0000 7f8ea5d9b700 1 --2- 172.21.15.81:0/771837999 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f8e8806aed0 0x7f8e8806d390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8ea814bfe0 tx=0x7f8e98019040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.026+0000 7f8e96ffd700 1 -- 172.21.15.81:0/771837999 <== osd.2 v2:172.21.15.81:6824/1744054610 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f8e88075e40 con 0x7f8e880732d0 2023-10-25T23:44:45.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.041+0000 7f8eacc1a700 1 -- 172.21.15.81:0/771837999 --> [v2:172.21.15.81:6824/1744054610,v1:172.21.15.81:6825/1744054610] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8ea80bad40 con 0x7f8e880732d0 2023-10-25T23:44:45.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.041+0000 7f8e96ffd700 1 -- 172.21.15.81:0/771837999 <== osd.2 v2:172.21.15.81:6824/1744054610 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f8ea80bad40 con 0x7f8e880732d0 2023-10-25T23:44:45.044 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-25T23:44:45.044 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-10-25T23:44:45.044 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-25T23:44:45.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.042+0000 7f8eacc1a700 1 -- 172.21.15.81:0/771837999 >> [v2:172.21.15.81:6824/1744054610,v1:172.21.15.81:6825/1744054610] conn(0x7f8e880732d0 msgr2=0x7f8e88075770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.042+0000 7f8eacc1a700 1 --2- 172.21.15.81:0/771837999 >> [v2:172.21.15.81:6824/1744054610,v1:172.21.15.81:6825/1744054610] conn(0x7f8e880732d0 0x7f8e88075770 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.042+0000 7f8eacc1a700 1 -- 172.21.15.81:0/771837999 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f8e8806aed0 msgr2=0x7f8e8806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.042+0000 7f8eacc1a700 1 --2- 172.21.15.81:0/771837999 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f8e8806aed0 0x7f8e8806d390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8ea814bfe0 tx=0x7f8e98019040 comp rx=0 tx=0).stop 2023-10-25T23:44:45.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.042+0000 7f8eacc1a700 1 -- 172.21.15.81:0/771837999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea80b3e30 msgr2=0x7f8ea813e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.042+0000 7f8eacc1a700 1 --2- 172.21.15.81:0/771837999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ea80b3e30 0x7f8ea813e280 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c00c500 tx=0x7f8e9c00c810 comp rx=0 tx=0).stop 2023-10-25T23:44:45.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.042+0000 7f8ea6d9d700 1 -- 172.21.15.81:0/771837999 reap_dead start 2023-10-25T23:44:45.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.042+0000 7f8eacc1a700 1 -- 172.21.15.81:0/771837999 shutdown_connections 2023-10-25T23:44:45.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.042+0000 7f8eacc1a700 1 -- 172.21.15.81:0/771837999 >> 172.21.15.81:0/771837999 conn(0x7f8ea806b320 msgr2=0x7f8ea806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:45.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.042+0000 7f8eacc1a700 1 -- 172.21.15.81:0/771837999 shutdown_connections 2023-10-25T23:44:45.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.042+0000 7f8eacc1a700 1 -- 172.21.15.81:0/771837999 wait complete. 2023-10-25T23:44:45.056 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-25T23:44:45.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.178+0000 7f6b775cb700 1 -- 172.21.15.81:0/91505894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b70144f60 msgr2=0x7f6b7014b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.181 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.178+0000 7f6b775cb700 1 --2- 172.21.15.81:0/91505894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b70144f60 0x7f6b7014b990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6b700b6130 tx=0x7f6b6c009c70 comp rx=0 tx=0).stop 2023-10-25T23:44:45.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.179+0000 7f6b775cb700 1 -- 172.21.15.81:0/91505894 shutdown_connections 2023-10-25T23:44:45.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.179+0000 7f6b775cb700 1 --2- 172.21.15.81:0/91505894 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b700bdb00 0x7f6b7014e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.179+0000 7f6b775cb700 1 --2- 172.21.15.81:0/91505894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b70144f60 0x7f6b7014b990 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.182 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.179+0000 7f6b775cb700 1 --2- 172.21.15.81:0/91505894 >> v2:172.21.15.89:3300/0 conn(0x7f6b700bb530 0x7f6b700bd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.179+0000 7f6b775cb700 1 -- 172.21.15.81:0/91505894 >> 172.21.15.81:0/91505894 conn(0x7f6b7006b320 msgr2=0x7f6b7006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:45.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.179+0000 7f6b775cb700 1 -- 172.21.15.81:0/91505894 shutdown_connections 2023-10-25T23:44:45.183 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.179+0000 7f6b775cb700 1 -- 172.21.15.81:0/91505894 wait complete. 2023-10-25T23:44:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.180+0000 7f6b775cb700 1 Processor -- start 2023-10-25T23:44:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.180+0000 7f6b775cb700 1 -- start start 2023-10-25T23:44:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.181+0000 7f6b775cb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b700bb530 0x7f6b70140a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.181+0000 7f6b775cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b700bdb00 0x7f6b7013aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.181+0000 7f6b775cb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b70144f60 0x7f6b701e4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.181+0000 7f6b775cb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b701e4380 con 0x7f6b700bdb00 2023-10-25T23:44:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.181+0000 7f6b775cb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b701405c0 con 0x7f6b70144f60 2023-10-25T23:44:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.181+0000 7f6b775cb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b701e2430 con 0x7f6b700bb530 2023-10-25T23:44:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.181+0000 7f6b74b66700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b700bdb00 0x7f6b7013aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.181+0000 7f6b74b66700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b700bdb00 0x7f6b7013aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37190/0 (socket says 172.21.15.81:37190) 2023-10-25T23:44:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.181+0000 7f6b74b66700 1 -- 172.21.15.81:0/3628119099 learned_addr learned my addr 172.21.15.81:0/3628119099 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.181+0000 7f6b75b68700 1 --2- 172.21.15.81:0/3628119099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b70144f60 0x7f6b701e4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.181+0000 7f6b75367700 1 --2- 172.21.15.81:0/3628119099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b700bb530 0x7f6b70140a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.181+0000 7f6b74b66700 1 -- 172.21.15.81:0/3628119099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b700bb530 msgr2=0x7f6b70140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.181+0000 7f6b74b66700 1 --2- 172.21.15.81:0/3628119099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b700bb530 0x7f6b70140a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.181+0000 7f6b74b66700 1 -- 172.21.15.81:0/3628119099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b70144f60 msgr2=0x7f6b701e4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.181+0000 7f6b74b66700 1 --2- 172.21.15.81:0/3628119099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b70144f60 0x7f6b701e4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.181+0000 7f6b74b66700 1 -- 172.21.15.81:0/3628119099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c0095f0 con 0x7f6b700bdb00 2023-10-25T23:44:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.182+0000 7f6b74b66700 1 --2- 172.21.15.81:0/3628119099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b700bdb00 0x7f6b7013aec0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6b6000c940 tx=0x7f6b6000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.182+0000 7f6b65ffb700 1 -- 172.21.15.81:0/3628119099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6000e880 con 0x7f6b700bdb00 2023-10-25T23:44:45.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.182+0000 7f6b65ffb700 1 -- 172.21.15.81:0/3628119099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6b6000ead0 con 0x7f6b700bdb00 2023-10-25T23:44:45.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.182+0000 7f6b775cb700 1 -- 172.21.15.81:0/3628119099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7013ba20 con 0x7f6b700bdb00 2023-10-25T23:44:45.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.182+0000 7f6b65ffb700 1 -- 172.21.15.81:0/3628119099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6000f450 con 0x7f6b700bdb00 2023-10-25T23:44:45.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.182+0000 7f6b775cb700 1 -- 172.21.15.81:0/3628119099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b701e5140 con 0x7f6b700bdb00 2023-10-25T23:44:45.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.183+0000 7f6b775cb700 1 -- 172.21.15.81:0/3628119099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b700c0730 con 0x7f6b700bdb00 2023-10-25T23:44:45.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.184+0000 7f6b65ffb700 1 -- 172.21.15.81:0/3628119099 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6b6000f5b0 con 0x7f6b700bdb00 2023-10-25T23:44:45.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.184+0000 7f6b65ffb700 1 --2- 172.21.15.81:0/3628119099 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6b5406aed0 0x7f6b5406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:45.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.184+0000 7f6b65ffb700 1 -- 172.21.15.81:0/3628119099 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f6b60089bb0 con 0x7f6b700bdb00 2023-10-25T23:44:45.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.184+0000 7f6b75367700 1 --2- 172.21.15.81:0/3628119099 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6b5406aed0 0x7f6b5406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:45.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.185+0000 7f6b75367700 1 --2- 172.21.15.81:0/3628119099 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6b5406aed0 0x7f6b5406d390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0098e0 tx=0x7f6b6c0047c0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.189+0000 7f6b65ffb700 1 -- 172.21.15.81:0/3628119099 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6b60054c40 con 0x7f6b700bdb00 2023-10-25T23:44:45.390 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.388+0000 7f6b775cb700 1 -- 172.21.15.81:0/3628119099 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b7014b190 con 0x7f6b5406aed0 2023-10-25T23:44:45.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.389+0000 7f6b65ffb700 1 -- 172.21.15.81:0/3628119099 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6b6c020040 con 0x7f6b5406aed0 2023-10-25T23:44:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.391+0000 7f6b775cb700 1 -- 172.21.15.81:0/3628119099 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6b5406aed0 msgr2=0x7f6b5406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.391+0000 7f6b775cb700 1 --2- 172.21.15.81:0/3628119099 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6b5406aed0 0x7f6b5406d390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0098e0 tx=0x7f6b6c0047c0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.391+0000 7f6b775cb700 1 -- 172.21.15.81:0/3628119099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b700bdb00 msgr2=0x7f6b7013aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.391+0000 7f6b775cb700 1 --2- 172.21.15.81:0/3628119099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b700bdb00 0x7f6b7013aec0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6b6000c940 tx=0x7f6b6000cc50 comp rx=0 tx=0).stop 2023-10-25T23:44:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.391+0000 7f6b775cb700 1 -- 172.21.15.81:0/3628119099 shutdown_connections 2023-10-25T23:44:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.391+0000 7f6b775cb700 1 --2- 172.21.15.81:0/3628119099 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6b5406aed0 0x7f6b5406d390 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.391+0000 7f6b775cb700 1 --2- 172.21.15.81:0/3628119099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b70144f60 0x7f6b701e4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.391+0000 7f6b775cb700 1 --2- 172.21.15.81:0/3628119099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b700bb530 0x7f6b70140a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.391+0000 7f6b775cb700 1 --2- 172.21.15.81:0/3628119099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b700bdb00 0x7f6b7013aec0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.391+0000 7f6b775cb700 1 -- 172.21.15.81:0/3628119099 >> 172.21.15.81:0/3628119099 conn(0x7f6b7006b320 msgr2=0x7f6b700b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:45.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.391+0000 7f6b775cb700 1 -- 172.21.15.81:0/3628119099 shutdown_connections 2023-10-25T23:44:45.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.391+0000 7f6b775cb700 1 -- 172.21.15.81:0/3628119099 wait complete. 2023-10-25T23:44:45.397 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 2 to deep-scrub 2023-10-25T23:44:45.405 INFO:tasks.ceph:Scrubbing osd.3 2023-10-25T23:44:45.405 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-25T23:44:45.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.529+0000 7f0410da5700 1 -- 172.21.15.81:0/2179649425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f4004bb0 msgr2=0x7f03f4004fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.529+0000 7f0410da5700 1 --2- 172.21.15.81:0/2179649425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f4004bb0 0x7f03f4004fd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f040000c310 tx=0x7f03f4006990 comp rx=0 tx=0).stop 2023-10-25T23:44:45.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.529+0000 7f040ad9d700 1 -- 172.21.15.81:0/2179649425 reap_dead start 2023-10-25T23:44:45.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.529+0000 7f0410da5700 1 -- 172.21.15.81:0/2179649425 shutdown_connections 2023-10-25T23:44:45.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.529+0000 7f0410da5700 1 -- 172.21.15.81:0/2179649425 >> 172.21.15.81:0/2179649425 conn(0x7f040c0bf890 msgr2=0x7f040c0bfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:45.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.529+0000 7f0410da5700 1 -- 172.21.15.81:0/2179649425 shutdown_connections 2023-10-25T23:44:45.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.529+0000 7f0410da5700 1 -- 172.21.15.81:0/2179649425 wait complete. 2023-10-25T23:44:45.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.530+0000 7f0410da5700 1 Processor -- start 2023-10-25T23:44:45.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.530+0000 7f0410da5700 1 -- start start 2023-10-25T23:44:45.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.531+0000 7f0410da5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f4004bb0 0x7f040c14d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:45.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.531+0000 7f0410da5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f040c1450c0 0x7f040c1e3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:45.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.531+0000 7f0410da5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f040c1e4250 0x7f040c129b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:45.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.531+0000 7f0410da5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c1e38f0 con 0x7f03f4004bb0 2023-10-25T23:44:45.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.531+0000 7f0410da5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c144500 con 0x7f040c1e4250 2023-10-25T23:44:45.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.531+0000 7f0410da5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040c14d960 con 0x7f040c1450c0 2023-10-25T23:44:45.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.531+0000 7f040a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f4004bb0 0x7f040c14d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:45.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.531+0000 7f040a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f4004bb0 0x7f040c14d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37210/0 (socket says 172.21.15.81:37210) 2023-10-25T23:44:45.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.531+0000 7f040a59c700 1 -- 172.21.15.81:0/755781203 learned_addr learned my addr 172.21.15.81:0/755781203 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:45.539 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.531+0000 7f040ad9d700 1 --2- 172.21.15.81:0/755781203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f040c1e4250 0x7f040c129b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:45.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.531+0000 7f0409d9b700 1 --2- 172.21.15.81:0/755781203 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f040c1450c0 0x7f040c1e3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:45.540 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.531+0000 7f040a59c700 1 -- 172.21.15.81:0/755781203 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f040c1450c0 msgr2=0x7f040c1e3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.531+0000 7f040a59c700 1 --2- 172.21.15.81:0/755781203 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f040c1450c0 0x7f040c1e3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.531+0000 7f040a59c700 1 -- 172.21.15.81:0/755781203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f040c1e4250 msgr2=0x7f040c129b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.531+0000 7f040a59c700 1 --2- 172.21.15.81:0/755781203 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f040c1e4250 0x7f040c129b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.531+0000 7f040a59c700 1 -- 172.21.15.81:0/755781203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c1e46d0 con 0x7f03f4004bb0 2023-10-25T23:44:45.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.532+0000 7f040a59c700 1 --2- 172.21.15.81:0/755781203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f4004bb0 0x7f040c14d420 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0400000c00 tx=0x7f04000011c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:45.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.532+0000 7f03faffd700 1 -- 172.21.15.81:0/755781203 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0400001630 con 0x7f03f4004bb0 2023-10-25T23:44:45.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.532+0000 7f03faffd700 1 -- 172.21.15.81:0/755781203 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0400003680 con 0x7f03f4004bb0 2023-10-25T23:44:45.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.532+0000 7f0410da5700 1 -- 172.21.15.81:0/755781203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040c12ffc0 con 0x7f03f4004bb0 2023-10-25T23:44:45.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.532+0000 7f03faffd700 1 -- 172.21.15.81:0/755781203 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0400003a90 con 0x7f03f4004bb0 2023-10-25T23:44:45.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.532+0000 7f0410da5700 1 -- 172.21.15.81:0/755781203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040c1e6430 con 0x7f03f4004bb0 2023-10-25T23:44:45.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.533+0000 7f0410da5700 1 -- 172.21.15.81:0/755781203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f040c04e4c0 con 0x7f03f4004bb0 2023-10-25T23:44:45.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.533+0000 7f03faffd700 1 -- 172.21.15.81:0/755781203 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0400022070 con 0x7f03f4004bb0 2023-10-25T23:44:45.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.534+0000 7f03faffd700 1 --2- 172.21.15.81:0/755781203 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f03ec06af00 0x7f03ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:45.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.534+0000 7f03faffd700 1 -- 172.21.15.81:0/755781203 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f040008b9c0 con 0x7f03f4004bb0 2023-10-25T23:44:45.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.534+0000 7f03faffd700 1 --2- 172.21.15.81:0/755781203 >> [v2:172.21.15.81:6816/1391123341,v1:172.21.15.81:6817/1391123341] conn(0x7f03ec073300 0x7f03ec0757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:45.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.534+0000 7f03faffd700 1 -- 172.21.15.81:0/755781203 --> [v2:172.21.15.81:6816/1391123341,v1:172.21.15.81:6817/1391123341] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f03ec075e70 con 0x7f03ec073300 2023-10-25T23:44:45.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.534+0000 7f03faffd700 1 -- 172.21.15.81:0/755781203 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f040008be10 con 0x7f03f4004bb0 2023-10-25T23:44:45.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.534+0000 7f0409d9b700 1 --2- 172.21.15.81:0/755781203 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f03ec06af00 0x7f03ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:45.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.534+0000 7f040ad9d700 1 --2- 172.21.15.81:0/755781203 >> [v2:172.21.15.81:6816/1391123341,v1:172.21.15.81:6817/1391123341] conn(0x7f03ec073300 0x7f03ec0757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:45.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.534+0000 7f040ad9d700 1 --2- 172.21.15.81:0/755781203 >> [v2:172.21.15.81:6816/1391123341,v1:172.21.15.81:6817/1391123341] conn(0x7f03ec073300 0x7f03ec0757a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:45.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.534+0000 7f0409d9b700 1 --2- 172.21.15.81:0/755781203 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f03ec06af00 0x7f03ec06d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f040c1314c0 tx=0x7f03fc00d550 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:45.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.535+0000 7f03faffd700 1 -- 172.21.15.81:0/755781203 <== osd.3 v2:172.21.15.81:6816/1391123341 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f03ec075e70 con 0x7f03ec073300 2023-10-25T23:44:45.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.549+0000 7f0410da5700 1 -- 172.21.15.81:0/755781203 --> [v2:172.21.15.81:6816/1391123341,v1:172.21.15.81:6817/1391123341] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f040c1e3a30 con 0x7f03ec073300 2023-10-25T23:44:45.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.550+0000 7f03faffd700 1 -- 172.21.15.81:0/755781203 <== osd.3 v2:172.21.15.81:6816/1391123341 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f040c1e3a30 con 0x7f03ec073300 2023-10-25T23:44:45.552 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-25T23:44:45.552 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-10-25T23:44:45.552 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-25T23:44:45.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.550+0000 7f0410da5700 1 -- 172.21.15.81:0/755781203 >> [v2:172.21.15.81:6816/1391123341,v1:172.21.15.81:6817/1391123341] conn(0x7f03ec073300 msgr2=0x7f03ec0757a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.550+0000 7f0410da5700 1 --2- 172.21.15.81:0/755781203 >> [v2:172.21.15.81:6816/1391123341,v1:172.21.15.81:6817/1391123341] conn(0x7f03ec073300 0x7f03ec0757a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.550+0000 7f0410da5700 1 -- 172.21.15.81:0/755781203 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f03ec06af00 msgr2=0x7f03ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.550+0000 7f0410da5700 1 --2- 172.21.15.81:0/755781203 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f03ec06af00 0x7f03ec06d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f040c1314c0 tx=0x7f03fc00d550 comp rx=0 tx=0).stop 2023-10-25T23:44:45.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.550+0000 7f0410da5700 1 -- 172.21.15.81:0/755781203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f4004bb0 msgr2=0x7f040c14d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.550+0000 7f0410da5700 1 --2- 172.21.15.81:0/755781203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f4004bb0 0x7f040c14d420 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0400000c00 tx=0x7f04000011c0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.555 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.550+0000 7f040ad9d700 1 -- 172.21.15.81:0/755781203 reap_dead start 2023-10-25T23:44:45.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.550+0000 7f0410da5700 1 -- 172.21.15.81:0/755781203 shutdown_connections 2023-10-25T23:44:45.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.550+0000 7f0410da5700 1 -- 172.21.15.81:0/755781203 >> 172.21.15.81:0/755781203 conn(0x7f040c0bf890 msgr2=0x7f040c1490b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:45.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.550+0000 7f0410da5700 1 -- 172.21.15.81:0/755781203 shutdown_connections 2023-10-25T23:44:45.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.550+0000 7f0410da5700 1 -- 172.21.15.81:0/755781203 wait complete. 2023-10-25T23:44:45.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-25T23:44:45.688 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.686+0000 7f794c94e700 1 -- 172.21.15.81:0/1859543975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7930003a00 msgr2=0x7f7930003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.689 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.686+0000 7f794c94e700 1 --2- 172.21.15.81:0/1859543975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7930003a00 0x7f7930003e40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f793c00c310 tx=0x7f7930005880 comp rx=0 tx=0).stop 2023-10-25T23:44:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.686+0000 7f794c94e700 1 -- 172.21.15.81:0/1859543975 shutdown_connections 2023-10-25T23:44:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.686+0000 7f794c94e700 1 --2- 172.21.15.81:0/1859543975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7930003a00 0x7f7930003e40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.686+0000 7f794c94e700 1 -- 172.21.15.81:0/1859543975 >> 172.21.15.81:0/1859543975 conn(0x7f794806b320 msgr2=0x7f794806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:45.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.686+0000 7f794c94e700 1 -- 172.21.15.81:0/1859543975 shutdown_connections 2023-10-25T23:44:45.691 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.686+0000 7f794c94e700 1 -- 172.21.15.81:0/1859543975 wait complete. 2023-10-25T23:44:45.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.687+0000 7f794c94e700 1 Processor -- start 2023-10-25T23:44:45.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.687+0000 7f794c94e700 1 -- start start 2023-10-25T23:44:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.688+0000 7f794c94e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7930003a00 0x7f79481e4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.688+0000 7f794c94e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79481d42a0 0x7f79481d6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.688+0000 7f794c94e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79481d66c0 0x7f79481402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.688+0000 7f794c94e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79481d3e50 con 0x7f79481d42a0 2023-10-25T23:44:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.688+0000 7f794c94e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79481e4eb0 con 0x7f7930003a00 2023-10-25T23:44:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.688+0000 7f794c94e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79481d3890 con 0x7f79481d66c0 2023-10-25T23:44:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.688+0000 7f7945d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79481d42a0 0x7f79481d6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.688+0000 7f7945d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79481d42a0 0x7f79481d6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37232/0 (socket says 172.21.15.81:37232) 2023-10-25T23:44:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.688+0000 7f7945d9b700 1 -- 172.21.15.81:0/1690570653 learned_addr learned my addr 172.21.15.81:0/1690570653 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.688+0000 7f794659c700 1 --2- 172.21.15.81:0/1690570653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7930003a00 0x7f79481e4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.688+0000 7f7946d9d700 1 --2- 172.21.15.81:0/1690570653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79481d66c0 0x7f79481402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.688+0000 7f7945d9b700 1 -- 172.21.15.81:0/1690570653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79481d66c0 msgr2=0x7f79481402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.688+0000 7f7945d9b700 1 --2- 172.21.15.81:0/1690570653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79481d66c0 0x7f79481402e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.688+0000 7f7945d9b700 1 -- 172.21.15.81:0/1690570653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7930003a00 msgr2=0x7f79481e4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.688+0000 7f7945d9b700 1 --2- 172.21.15.81:0/1690570653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7930003a00 0x7f79481e4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.699 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.688+0000 7f7945d9b700 1 -- 172.21.15.81:0/1690570653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79481d3b70 con 0x7f79481d42a0 2023-10-25T23:44:45.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.688+0000 7f7945d9b700 1 --2- 172.21.15.81:0/1690570653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79481d42a0 0x7f79481d6180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7938011a10 tx=0x7f7938011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:45.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.688+0000 7f7936ffd700 1 -- 172.21.15.81:0/1690570653 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7938004520 con 0x7f79481d42a0 2023-10-25T23:44:45.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.689+0000 7f7936ffd700 1 -- 172.21.15.81:0/1690570653 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f793800f8b0 con 0x7f79481d42a0 2023-10-25T23:44:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.689+0000 7f794c94e700 1 -- 172.21.15.81:0/1690570653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79481e5150 con 0x7f79481d42a0 2023-10-25T23:44:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.689+0000 7f7936ffd700 1 -- 172.21.15.81:0/1690570653 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793800fcc0 con 0x7f79481d42a0 2023-10-25T23:44:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.689+0000 7f794c94e700 1 -- 172.21.15.81:0/1690570653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79481e4b40 con 0x7f79481d42a0 2023-10-25T23:44:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.690+0000 7f794c94e700 1 -- 172.21.15.81:0/1690570653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7948145640 con 0x7f79481d42a0 2023-10-25T23:44:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.690+0000 7f7936ffd700 1 -- 172.21.15.81:0/1690570653 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7938004830 con 0x7f79481d42a0 2023-10-25T23:44:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.690+0000 7f7936ffd700 1 --2- 172.21.15.81:0/1690570653 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f792806af00 0x7f792806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:45.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.690+0000 7f7936ffd700 1 -- 172.21.15.81:0/1690570653 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f793808a220 con 0x7f79481d42a0 2023-10-25T23:44:45.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.691+0000 7f794659c700 1 --2- 172.21.15.81:0/1690570653 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f792806af00 0x7f792806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:45.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.691+0000 7f794659c700 1 --2- 172.21.15.81:0/1690570653 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f792806af00 0x7f792806d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f793c000c00 tx=0x7f793c00f000 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:45.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.695+0000 7f7936ffd700 1 -- 172.21.15.81:0/1690570653 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7938055220 con 0x7f79481d42a0 2023-10-25T23:44:45.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.883+0000 7f794c94e700 1 -- 172.21.15.81:0/1690570653 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f794806f7e0 con 0x7f792806af00 2023-10-25T23:44:45.885 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.883+0000 7f7936ffd700 1 -- 172.21.15.81:0/1690570653 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f793c00ccf0 con 0x7f792806af00 2023-10-25T23:44:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.886+0000 7f794c94e700 1 -- 172.21.15.81:0/1690570653 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f792806af00 msgr2=0x7f792806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.886+0000 7f794c94e700 1 --2- 172.21.15.81:0/1690570653 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f792806af00 0x7f792806d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f793c000c00 tx=0x7f793c00f000 comp rx=0 tx=0).stop 2023-10-25T23:44:45.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.886+0000 7f794c94e700 1 -- 172.21.15.81:0/1690570653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79481d42a0 msgr2=0x7f79481d6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:45.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.886+0000 7f794c94e700 1 --2- 172.21.15.81:0/1690570653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79481d42a0 0x7f79481d6180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7938011a10 tx=0x7f7938011d20 comp rx=0 tx=0).stop 2023-10-25T23:44:45.889 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.886+0000 7f794c94e700 1 -- 172.21.15.81:0/1690570653 shutdown_connections 2023-10-25T23:44:45.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.886+0000 7f794c94e700 1 --2- 172.21.15.81:0/1690570653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79481d66c0 0x7f79481402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.886+0000 7f794c94e700 1 --2- 172.21.15.81:0/1690570653 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f792806af00 0x7f792806d3c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.886+0000 7f794c94e700 1 --2- 172.21.15.81:0/1690570653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7930003a00 0x7f79481e4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.890 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.886+0000 7f794c94e700 1 --2- 172.21.15.81:0/1690570653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79481d42a0 0x7f79481d6180 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:45.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.886+0000 7f794c94e700 1 -- 172.21.15.81:0/1690570653 >> 172.21.15.81:0/1690570653 conn(0x7f794806b320 msgr2=0x7f79480c02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:45.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.886+0000 7f794c94e700 1 -- 172.21.15.81:0/1690570653 shutdown_connections 2023-10-25T23:44:45.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:45.886+0000 7f794c94e700 1 -- 172.21.15.81:0/1690570653 wait complete. 2023-10-25T23:44:45.892 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 3 to deep-scrub 2023-10-25T23:44:45.900 INFO:tasks.ceph:Scrubbing osd.4 2023-10-25T23:44:45.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-25T23:44:46.038 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.036+0000 7f33cdf46700 1 -- 172.21.15.81:0/1652515712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c80b3e30 msgr2=0x7f33c80ba3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.036+0000 7f33cdf46700 1 --2- 172.21.15.81:0/1652515712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c80b3e30 0x7f33c80ba3c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f33b0005fd0 tx=0x7f33b0009c70 comp rx=0 tx=0).stop 2023-10-25T23:44:46.039 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.036+0000 7f33cdf46700 1 -- 172.21.15.81:0/1652515712 shutdown_connections 2023-10-25T23:44:46.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.036+0000 7f33cdf46700 1 --2- 172.21.15.81:0/1652515712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c80b3e30 0x7f33c80ba3c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.036+0000 7f33cdf46700 1 --2- 172.21.15.81:0/1652515712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33c80ba900 0x7f33c8155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.040 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.036+0000 7f33cdf46700 1 -- 172.21.15.81:0/1652515712 >> 172.21.15.81:0/1652515712 conn(0x7f33c806b320 msgr2=0x7f33c806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:46.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.036+0000 7f33cdf46700 1 -- 172.21.15.81:0/1652515712 shutdown_connections 2023-10-25T23:44:46.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.036+0000 7f33cdf46700 1 -- 172.21.15.81:0/1652515712 wait complete. 2023-10-25T23:44:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.037+0000 7f33cdf46700 1 Processor -- start 2023-10-25T23:44:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.038+0000 7f33cdf46700 1 -- start start 2023-10-25T23:44:46.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.038+0000 7f33cdf46700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33c80b3e30 0x7f33c80b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.038+0000 7f33cdf46700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33c80ba900 0x7f33c8148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.038+0000 7f33cdf46700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c814bbd0 0x7f33c80bc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.038+0000 7f33cdf46700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80b4af0 con 0x7f33c814bbd0 2023-10-25T23:44:46.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.038+0000 7f33cdf46700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c8145ac0 con 0x7f33c80b3e30 2023-10-25T23:44:46.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.038+0000 7f33cdf46700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c8148dc0 con 0x7f33c80ba900 2023-10-25T23:44:46.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.038+0000 7f33c7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c814bbd0 0x7f33c80bc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:46.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.038+0000 7f33c7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c814bbd0 0x7f33c80bc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37248/0 (socket says 172.21.15.81:37248) 2023-10-25T23:44:46.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.038+0000 7f33c7fff700 1 -- 172.21.15.81:0/2620119299 learned_addr learned my addr 172.21.15.81:0/2620119299 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:46.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.039+0000 7f33c77fe700 1 --2- 172.21.15.81:0/2620119299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33c80b3e30 0x7f33c80b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:46.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.039+0000 7f33c6ffd700 1 --2- 172.21.15.81:0/2620119299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33c80ba900 0x7f33c8148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:46.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.039+0000 7f33c7fff700 1 -- 172.21.15.81:0/2620119299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33c80ba900 msgr2=0x7f33c8148880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.039+0000 7f33c7fff700 1 --2- 172.21.15.81:0/2620119299 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33c80ba900 0x7f33c8148880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.039+0000 7f33c7fff700 1 -- 172.21.15.81:0/2620119299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33c80b3e30 msgr2=0x7f33c80b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.039+0000 7f33c7fff700 1 --2- 172.21.15.81:0/2620119299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33c80b3e30 0x7f33c80b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.039+0000 7f33c7fff700 1 -- 172.21.15.81:0/2620119299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b00095f0 con 0x7f33c814bbd0 2023-10-25T23:44:46.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.039+0000 7f33c77fe700 1 --2- 172.21.15.81:0/2620119299 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33c80b3e30 0x7f33c80b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:44:46.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.039+0000 7f33c7fff700 1 --2- 172.21.15.81:0/2620119299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c814bbd0 0x7f33c80bc910 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f33c000c0f0 tx=0x7f33c000c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:46.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.039+0000 7f33bffff700 1 -- 172.21.15.81:0/2620119299 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0018070 con 0x7f33c814bbd0 2023-10-25T23:44:46.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.039+0000 7f33bffff700 1 -- 172.21.15.81:0/2620119299 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f33c000f040 con 0x7f33c814bbd0 2023-10-25T23:44:46.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.039+0000 7f33bffff700 1 -- 172.21.15.81:0/2620119299 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0009e70 con 0x7f33c814bbd0 2023-10-25T23:44:46.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.039+0000 7f33cdf46700 1 -- 172.21.15.81:0/2620119299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c80bce50 con 0x7f33c814bbd0 2023-10-25T23:44:46.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.039+0000 7f33cdf46700 1 -- 172.21.15.81:0/2620119299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c81e5480 con 0x7f33c814bbd0 2023-10-25T23:44:46.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.040+0000 7f33cdf46700 1 -- 172.21.15.81:0/2620119299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f33c814d5e0 con 0x7f33c814bbd0 2023-10-25T23:44:46.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.040+0000 7f33bffff700 1 -- 172.21.15.81:0/2620119299 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f33c000cb80 con 0x7f33c814bbd0 2023-10-25T23:44:46.052 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.041+0000 7f33bffff700 1 --2- 172.21.15.81:0/2620119299 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f33a806aed0 0x7f33a806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:46.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.041+0000 7f33bffff700 1 -- 172.21.15.81:0/2620119299 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f33c0089930 con 0x7f33c814bbd0 2023-10-25T23:44:46.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.041+0000 7f33bffff700 1 --2- 172.21.15.81:0/2620119299 >> [v2:172.21.15.89:6816/1232781703,v1:172.21.15.89:6817/1232781703] conn(0x7f33a80732d0 0x7f33a8075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:46.053 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.041+0000 7f33bffff700 1 -- 172.21.15.81:0/2620119299 --> [v2:172.21.15.89:6816/1232781703,v1:172.21.15.89:6817/1232781703] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33a8075e40 con 0x7f33a80732d0 2023-10-25T23:44:46.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.041+0000 7f33bffff700 1 -- 172.21.15.81:0/2620119299 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33c008e2c0 con 0x7f33c814bbd0 2023-10-25T23:44:46.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.041+0000 7f33c77fe700 1 --2- 172.21.15.81:0/2620119299 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f33a806aed0 0x7f33a806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:46.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.041+0000 7f33c6ffd700 1 --2- 172.21.15.81:0/2620119299 >> [v2:172.21.15.89:6816/1232781703,v1:172.21.15.89:6817/1232781703] conn(0x7f33a80732d0 0x7f33a8075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:46.054 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.041+0000 7f33c77fe700 1 --2- 172.21.15.81:0/2620119299 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f33a806aed0 0x7f33a806d390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f33b0000c00 tx=0x7f33b00047c0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:46.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.041+0000 7f33c6ffd700 1 --2- 172.21.15.81:0/2620119299 >> [v2:172.21.15.89:6816/1232781703,v1:172.21.15.89:6817/1232781703] conn(0x7f33a80732d0 0x7f33a8075770 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:46.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.042+0000 7f33bffff700 1 -- 172.21.15.81:0/2620119299 <== osd.4 v2:172.21.15.89:6816/1232781703 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f33a8075e40 con 0x7f33a80732d0 2023-10-25T23:44:46.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.057+0000 7f33cdf46700 1 -- 172.21.15.81:0/2620119299 --> [v2:172.21.15.89:6816/1232781703,v1:172.21.15.89:6817/1232781703] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f33c80b7fd0 con 0x7f33a80732d0 2023-10-25T23:44:46.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.057+0000 7f33bffff700 1 -- 172.21.15.81:0/2620119299 <== osd.4 v2:172.21.15.89:6816/1232781703 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f33b80050e0 con 0x7f33a80732d0 2023-10-25T23:44:46.059 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-25T23:44:46.060 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-10-25T23:44:46.060 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-25T23:44:46.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.057+0000 7f33cdf46700 1 -- 172.21.15.81:0/2620119299 >> [v2:172.21.15.89:6816/1232781703,v1:172.21.15.89:6817/1232781703] conn(0x7f33a80732d0 msgr2=0x7f33a8075770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.058+0000 7f33cdf46700 1 --2- 172.21.15.81:0/2620119299 >> [v2:172.21.15.89:6816/1232781703,v1:172.21.15.89:6817/1232781703] conn(0x7f33a80732d0 0x7f33a8075770 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.058+0000 7f33cdf46700 1 -- 172.21.15.81:0/2620119299 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f33a806aed0 msgr2=0x7f33a806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.058+0000 7f33cdf46700 1 --2- 172.21.15.81:0/2620119299 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f33a806aed0 0x7f33a806d390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f33b0000c00 tx=0x7f33b00047c0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.062 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.058+0000 7f33cdf46700 1 -- 172.21.15.81:0/2620119299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c814bbd0 msgr2=0x7f33c80bc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.058+0000 7f33cdf46700 1 --2- 172.21.15.81:0/2620119299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c814bbd0 0x7f33c80bc910 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f33c000c0f0 tx=0x7f33c000c4b0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.058+0000 7f33c7fff700 1 -- 172.21.15.81:0/2620119299 reap_dead start 2023-10-25T23:44:46.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.058+0000 7f33cdf46700 1 -- 172.21.15.81:0/2620119299 shutdown_connections 2023-10-25T23:44:46.063 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.058+0000 7f33cdf46700 1 -- 172.21.15.81:0/2620119299 >> 172.21.15.81:0/2620119299 conn(0x7f33c806b320 msgr2=0x7f33c814e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:46.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.058+0000 7f33cdf46700 1 -- 172.21.15.81:0/2620119299 shutdown_connections 2023-10-25T23:44:46.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.058+0000 7f33cdf46700 1 -- 172.21.15.81:0/2620119299 wait complete. 2023-10-25T23:44:46.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-25T23:44:46.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.194+0000 7f6c7a951700 1 -- 172.21.15.81:0/128365258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c74144e80 msgr2=0x7f6c74072240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.194+0000 7f6c7a951700 1 --2- 172.21.15.81:0/128365258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c74144e80 0x7f6c74072240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6c640098f0 tx=0x7f6c64009c00 comp rx=0 tx=0).stop 2023-10-25T23:44:46.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.194+0000 7f6c7a951700 1 -- 172.21.15.81:0/128365258 shutdown_connections 2023-10-25T23:44:46.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.194+0000 7f6c7a951700 1 --2- 172.21.15.81:0/128365258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c74144e80 0x7f6c74072240 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.194+0000 7f6c7a951700 1 --2- 172.21.15.81:0/128365258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c74071190 0x7f6c7406b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.194+0000 7f6c7a951700 1 -- 172.21.15.81:0/128365258 >> 172.21.15.81:0/128365258 conn(0x7f6c7406d9b0 msgr2=0x7f6c7406ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:46.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.194+0000 7f6c7a951700 1 -- 172.21.15.81:0/128365258 shutdown_connections 2023-10-25T23:44:46.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.194+0000 7f6c7a951700 1 -- 172.21.15.81:0/128365258 wait complete. 2023-10-25T23:44:46.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.195+0000 7f6c7a951700 1 Processor -- start 2023-10-25T23:44:46.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.196+0000 7f6c7a951700 1 -- start start 2023-10-25T23:44:46.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.196+0000 7f6c7a951700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c7406b760 0x7f6c7413fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:46.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.196+0000 7f6c7a951700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c74071190 0x7f6c741e5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:46.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.196+0000 7f6c7a951700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c74144e80 0x7f6c7413b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:46.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.196+0000 7f6c7a951700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c740bb060 con 0x7f6c74071190 2023-10-25T23:44:46.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.196+0000 7f6c7a951700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c740bc2f0 con 0x7f6c74144e80 2023-10-25T23:44:46.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.196+0000 7f6c7a951700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c740be3b0 con 0x7f6c7406b760 2023-10-25T23:44:46.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.196+0000 7f6c737fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c74071190 0x7f6c741e5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:46.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.197+0000 7f6c737fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c74071190 0x7f6c741e5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37262/0 (socket says 172.21.15.81:37262) 2023-10-25T23:44:46.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.197+0000 7f6c737fe700 1 -- 172.21.15.81:0/2806480624 learned_addr learned my addr 172.21.15.81:0/2806480624 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:46.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.197+0000 7f6c73fff700 1 --2- 172.21.15.81:0/2806480624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c7406b760 0x7f6c7413fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:46.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.197+0000 7f6c78eee700 1 --2- 172.21.15.81:0/2806480624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c74144e80 0x7f6c7413b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:46.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.197+0000 7f6c737fe700 1 -- 172.21.15.81:0/2806480624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c7406b760 msgr2=0x7f6c7413fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.197+0000 7f6c737fe700 1 --2- 172.21.15.81:0/2806480624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c7406b760 0x7f6c7413fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.197+0000 7f6c737fe700 1 -- 172.21.15.81:0/2806480624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c74144e80 msgr2=0x7f6c7413b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.197+0000 7f6c737fe700 1 --2- 172.21.15.81:0/2806480624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c74144e80 0x7f6c7413b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.197+0000 7f6c737fe700 1 -- 172.21.15.81:0/2806480624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c68009520 con 0x7f6c74071190 2023-10-25T23:44:46.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.197+0000 7f6c737fe700 1 --2- 172.21.15.81:0/2806480624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c74071190 0x7f6c741e5b80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800eb30 tx=0x7f6c6800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:46.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.197+0000 7f6c70ff9700 1 -- 172.21.15.81:0/2806480624 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68009880 con 0x7f6c74071190 2023-10-25T23:44:46.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.197+0000 7f6c70ff9700 1 -- 172.21.15.81:0/2806480624 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6c6800cbd0 con 0x7f6c74071190 2023-10-25T23:44:46.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.197+0000 7f6c70ff9700 1 -- 172.21.15.81:0/2806480624 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c68004020 con 0x7f6c74071190 2023-10-25T23:44:46.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.197+0000 7f6c7a951700 1 -- 172.21.15.81:0/2806480624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c64009520 con 0x7f6c74071190 2023-10-25T23:44:46.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.197+0000 7f6c7a951700 1 -- 172.21.15.81:0/2806480624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c740bf1d0 con 0x7f6c74071190 2023-10-25T23:44:46.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.198+0000 7f6c7a951700 1 -- 172.21.15.81:0/2806480624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c74067490 con 0x7f6c74071190 2023-10-25T23:44:46.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.199+0000 7f6c70ff9700 1 -- 172.21.15.81:0/2806480624 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6c68004180 con 0x7f6c74071190 2023-10-25T23:44:46.208 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.199+0000 7f6c70ff9700 1 --2- 172.21.15.81:0/2806480624 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6c6006aed0 0x7f6c6006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:46.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.199+0000 7f6c70ff9700 1 -- 172.21.15.81:0/2806480624 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f6c68014070 con 0x7f6c74071190 2023-10-25T23:44:46.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.199+0000 7f6c73fff700 1 --2- 172.21.15.81:0/2806480624 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6c6006aed0 0x7f6c6006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:46.209 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.200+0000 7f6c73fff700 1 --2- 172.21.15.81:0/2806480624 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6c6006aed0 0x7f6c6006d390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009230 tx=0x7f6c6401a040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:46.210 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.203+0000 7f6c70ff9700 1 -- 172.21.15.81:0/2806480624 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6c68055050 con 0x7f6c74071190 2023-10-25T23:44:46.393 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.391+0000 7f6c7a951700 1 -- 172.21.15.81:0/2806480624 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c740715f0 con 0x7f6c6006aed0 2023-10-25T23:44:46.394 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.392+0000 7f6c70ff9700 1 -- 172.21.15.81:0/2806480624 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6c6400bba0 con 0x7f6c6006aed0 2023-10-25T23:44:46.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.394+0000 7f6c7a951700 1 -- 172.21.15.81:0/2806480624 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6c6006aed0 msgr2=0x7f6c6006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.394+0000 7f6c7a951700 1 --2- 172.21.15.81:0/2806480624 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6c6006aed0 0x7f6c6006d390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009230 tx=0x7f6c6401a040 comp rx=0 tx=0).stop 2023-10-25T23:44:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.394+0000 7f6c7a951700 1 -- 172.21.15.81:0/2806480624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c74071190 msgr2=0x7f6c741e5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.394+0000 7f6c7a951700 1 --2- 172.21.15.81:0/2806480624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c74071190 0x7f6c741e5b80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800eb30 tx=0x7f6c6800ee40 comp rx=0 tx=0).stop 2023-10-25T23:44:46.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.394+0000 7f6c7a951700 1 -- 172.21.15.81:0/2806480624 shutdown_connections 2023-10-25T23:44:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.394+0000 7f6c7a951700 1 --2- 172.21.15.81:0/2806480624 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6c6006aed0 0x7f6c6006d390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.394+0000 7f6c7a951700 1 --2- 172.21.15.81:0/2806480624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c74144e80 0x7f6c7413b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.394+0000 7f6c7a951700 1 --2- 172.21.15.81:0/2806480624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c7406b760 0x7f6c7413fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.394+0000 7f6c7a951700 1 --2- 172.21.15.81:0/2806480624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c74071190 0x7f6c741e5b80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.394+0000 7f6c7a951700 1 -- 172.21.15.81:0/2806480624 >> 172.21.15.81:0/2806480624 conn(0x7f6c7406d9b0 msgr2=0x7f6c74072de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.394+0000 7f6c7a951700 1 -- 172.21.15.81:0/2806480624 shutdown_connections 2023-10-25T23:44:46.399 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.394+0000 7f6c7a951700 1 -- 172.21.15.81:0/2806480624 wait complete. 2023-10-25T23:44:46.400 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 4 to deep-scrub 2023-10-25T23:44:46.408 INFO:tasks.ceph:Scrubbing osd.5 2023-10-25T23:44:46.409 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-25T23:44:46.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.533+0000 7fca267f8700 1 -- 172.21.15.81:0/2023415346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca200b7dc0 msgr2=0x7fca2014eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.533+0000 7fca267f8700 1 --2- 172.21.15.81:0/2023415346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca200b7dc0 0x7fca2014eec0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fca20070e10 tx=0x7fca1800b380 comp rx=0 tx=0).stop 2023-10-25T23:44:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.533+0000 7fca267f8700 1 -- 172.21.15.81:0/2023415346 shutdown_connections 2023-10-25T23:44:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.533+0000 7fca267f8700 1 --2- 172.21.15.81:0/2023415346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca200b7dc0 0x7fca2014eec0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.533+0000 7fca267f8700 1 --2- 172.21.15.81:0/2023415346 >> v2:172.21.15.89:3300/0 conn(0x7fca2014bbd0 0x7fca2014e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.533+0000 7fca267f8700 1 -- 172.21.15.81:0/2023415346 >> 172.21.15.81:0/2023415346 conn(0x7fca2006b320 msgr2=0x7fca2006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:46.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.533+0000 7fca267f8700 1 -- 172.21.15.81:0/2023415346 shutdown_connections 2023-10-25T23:44:46.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.533+0000 7fca267f8700 1 -- 172.21.15.81:0/2023415346 wait complete. 2023-10-25T23:44:46.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.535+0000 7fca267f8700 1 Processor -- start 2023-10-25T23:44:46.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.535+0000 7fca267f8700 1 -- start start 2023-10-25T23:44:46.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.536+0000 7fca267f8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca200b3e30 0x7fca200b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:46.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.536+0000 7fca267f8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca200b7dc0 0x7fca2014dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.536+0000 7fca267f8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2014bbd0 0x7fca201e65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.536+0000 7fca267f8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca200b7580 con 0x7fca2014bbd0 2023-10-25T23:44:46.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.536+0000 7fca267f8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca200b66d0 con 0x7fca200b7dc0 2023-10-25T23:44:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.536+0000 7fca267f8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2014e020 con 0x7fca200b3e30 2023-10-25T23:44:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.536+0000 7fca24d95700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2014bbd0 0x7fca201e65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:46.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.536+0000 7fca24d95700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2014bbd0 0x7fca201e65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37278/0 (socket says 172.21.15.81:37278) 2023-10-25T23:44:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.536+0000 7fca24d95700 1 -- 172.21.15.81:0/294304244 learned_addr learned my addr 172.21.15.81:0/294304244 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.536+0000 7fca1f7fe700 1 --2- 172.21.15.81:0/294304244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca200b7dc0 0x7fca2014dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:46.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.536+0000 7fca1ffff700 1 --2- 172.21.15.81:0/294304244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca200b3e30 0x7fca200b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:46.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.536+0000 7fca24d95700 1 -- 172.21.15.81:0/294304244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca200b3e30 msgr2=0x7fca200b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.536+0000 7fca24d95700 1 --2- 172.21.15.81:0/294304244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fca200b3e30 0x7fca200b7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.536+0000 7fca24d95700 1 -- 172.21.15.81:0/294304244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca200b7dc0 msgr2=0x7fca2014dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.536+0000 7fca24d95700 1 --2- 172.21.15.81:0/294304244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca200b7dc0 0x7fca2014dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.536+0000 7fca24d95700 1 -- 172.21.15.81:0/294304244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca18009d00 con 0x7fca2014bbd0 2023-10-25T23:44:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.536+0000 7fca24d95700 1 --2- 172.21.15.81:0/294304244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2014bbd0 0x7fca201e65d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fca18009fd0 tx=0x7fca180097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.537+0000 7fca1cff9700 1 -- 172.21.15.81:0/294304244 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1800e040 con 0x7fca2014bbd0 2023-10-25T23:44:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.537+0000 7fca1cff9700 1 -- 172.21.15.81:0/294304244 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fca180079d0 con 0x7fca2014bbd0 2023-10-25T23:44:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.537+0000 7fca267f8700 1 -- 172.21.15.81:0/294304244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca2006c140 con 0x7fca2014bbd0 2023-10-25T23:44:46.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.537+0000 7fca1cff9700 1 -- 172.21.15.81:0/294304244 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca18007e20 con 0x7fca2014bbd0 2023-10-25T23:44:46.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.537+0000 7fca267f8700 1 -- 172.21.15.81:0/294304244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca200b6110 con 0x7fca2014bbd0 2023-10-25T23:44:46.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.537+0000 7fca267f8700 1 -- 172.21.15.81:0/294304244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca2004e4c0 con 0x7fca2014bbd0 2023-10-25T23:44:46.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.538+0000 7fca1cff9700 1 -- 172.21.15.81:0/294304244 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fca18004030 con 0x7fca2014bbd0 2023-10-25T23:44:46.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.538+0000 7fca1cff9700 1 --2- 172.21.15.81:0/294304244 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fca0c06aed0 0x7fca0c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:46.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.538+0000 7fca1cff9700 1 -- 172.21.15.81:0/294304244 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fca1808b2d0 con 0x7fca2014bbd0 2023-10-25T23:44:46.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.539+0000 7fca1cff9700 1 --2- 172.21.15.81:0/294304244 >> [v2:172.21.15.89:6800/2255820086,v1:172.21.15.89:6801/2255820086] conn(0x7fca0c0732d0 0x7fca0c075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:46.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.539+0000 7fca1cff9700 1 -- 172.21.15.81:0/294304244 --> [v2:172.21.15.89:6800/2255820086,v1:172.21.15.89:6801/2255820086] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca0c075e40 con 0x7fca0c0732d0 2023-10-25T23:44:46.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.539+0000 7fca1ffff700 1 --2- 172.21.15.81:0/294304244 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fca0c06aed0 0x7fca0c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:46.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.539+0000 7fca1cff9700 1 -- 172.21.15.81:0/294304244 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca1808b720 con 0x7fca2014bbd0 2023-10-25T23:44:46.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.539+0000 7fca1f7fe700 1 --2- 172.21.15.81:0/294304244 >> [v2:172.21.15.89:6800/2255820086,v1:172.21.15.89:6801/2255820086] conn(0x7fca0c0732d0 0x7fca0c075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:46.553 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.539+0000 7fca1ffff700 1 --2- 172.21.15.81:0/294304244 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fca0c06aed0 0x7fca0c06d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fca14007fd0 tx=0x7fca14007ec0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:46.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.539+0000 7fca1f7fe700 1 --2- 172.21.15.81:0/294304244 >> [v2:172.21.15.89:6800/2255820086,v1:172.21.15.89:6801/2255820086] conn(0x7fca0c0732d0 0x7fca0c075770 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:46.554 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.540+0000 7fca1cff9700 1 -- 172.21.15.81:0/294304244 <== osd.5 v2:172.21.15.89:6800/2255820086 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fca0c075e40 con 0x7fca0c0732d0 2023-10-25T23:44:46.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.554+0000 7fca267f8700 1 -- 172.21.15.81:0/294304244 --> [v2:172.21.15.89:6800/2255820086,v1:172.21.15.89:6801/2255820086] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fca201427f0 con 0x7fca0c0732d0 2023-10-25T23:44:46.556 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.555+0000 7fca1cff9700 1 -- 172.21.15.81:0/294304244 <== osd.5 v2:172.21.15.89:6800/2255820086 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fca201427f0 con 0x7fca0c0732d0 2023-10-25T23:44:46.557 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-25T23:44:46.557 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-10-25T23:44:46.558 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-25T23:44:46.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.555+0000 7fca267f8700 1 -- 172.21.15.81:0/294304244 >> [v2:172.21.15.89:6800/2255820086,v1:172.21.15.89:6801/2255820086] conn(0x7fca0c0732d0 msgr2=0x7fca0c075770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.559 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.555+0000 7fca267f8700 1 --2- 172.21.15.81:0/294304244 >> [v2:172.21.15.89:6800/2255820086,v1:172.21.15.89:6801/2255820086] conn(0x7fca0c0732d0 0x7fca0c075770 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.555+0000 7fca267f8700 1 -- 172.21.15.81:0/294304244 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fca0c06aed0 msgr2=0x7fca0c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.555+0000 7fca267f8700 1 --2- 172.21.15.81:0/294304244 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fca0c06aed0 0x7fca0c06d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fca14007fd0 tx=0x7fca14007ec0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.555+0000 7fca267f8700 1 -- 172.21.15.81:0/294304244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2014bbd0 msgr2=0x7fca201e65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.555+0000 7fca267f8700 1 --2- 172.21.15.81:0/294304244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2014bbd0 0x7fca201e65d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fca18009fd0 tx=0x7fca180097c0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.555+0000 7fca24d95700 1 -- 172.21.15.81:0/294304244 reap_dead start 2023-10-25T23:44:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.555+0000 7fca267f8700 1 -- 172.21.15.81:0/294304244 shutdown_connections 2023-10-25T23:44:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.555+0000 7fca267f8700 1 -- 172.21.15.81:0/294304244 >> 172.21.15.81:0/294304244 conn(0x7fca2006b320 msgr2=0x7fca2006ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.555+0000 7fca267f8700 1 -- 172.21.15.81:0/294304244 shutdown_connections 2023-10-25T23:44:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.555+0000 7fca267f8700 1 -- 172.21.15.81:0/294304244 wait complete. 2023-10-25T23:44:46.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-25T23:44:46.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.690+0000 7f6ee16cc700 1 -- 172.21.15.81:0/1709742385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6edc0a4350 msgr2=0x7f6edc06e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.690+0000 7f6ee16cc700 1 --2- 172.21.15.81:0/1709742385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6edc0a4350 0x7f6edc06e2d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6edc0b9e80 tx=0x7f6ed400c4c0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.693 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.690+0000 7f6ee16cc700 1 -- 172.21.15.81:0/1709742385 shutdown_connections 2023-10-25T23:44:46.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.690+0000 7f6ee16cc700 1 --2- 172.21.15.81:0/1709742385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6edc0a4350 0x7f6edc06e2d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.690+0000 7f6ee16cc700 1 --2- 172.21.15.81:0/1709742385 >> v2:172.21.15.89:3300/0 conn(0x7f6edc09f040 0x7f6edc0a2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.694 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.690+0000 7f6ee16cc700 1 -- 172.21.15.81:0/1709742385 >> 172.21.15.81:0/1709742385 conn(0x7f6edc0bc4a0 msgr2=0x7f6edc0bc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:46.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.691+0000 7f6ee16cc700 1 -- 172.21.15.81:0/1709742385 shutdown_connections 2023-10-25T23:44:46.695 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.691+0000 7f6ee16cc700 1 -- 172.21.15.81:0/1709742385 wait complete. 2023-10-25T23:44:46.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.692+0000 7f6ee16cc700 1 Processor -- start 2023-10-25T23:44:46.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.692+0000 7f6ee16cc700 1 -- start start 2023-10-25T23:44:46.698 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.692+0000 7f6ee16cc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6edc0a4350 0x7f6edc0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:46.701 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.692+0000 7f6ee16cc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6edc0bab50 0x7f6edc0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:46.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.692+0000 7f6ee16cc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6edc0b5a50 0x7f6edc1e4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:46.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.692+0000 7f6ee16cc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc09d3a0 con 0x7f6edc0bab50 2023-10-25T23:44:46.702 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6ee16cc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0b5310 con 0x7f6edc0a4350 2023-10-25T23:44:46.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6ee16cc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0b3e70 con 0x7f6edc0b5a50 2023-10-25T23:44:46.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6eda7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6edc0bab50 0x7f6edc0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:46.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6eda7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6edc0bab50 0x7f6edc0b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37292/0 (socket says 172.21.15.81:37292) 2023-10-25T23:44:46.703 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6eda7fc700 1 -- 172.21.15.81:0/380574693 learned_addr learned my addr 172.21.15.81:0/380574693 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:46.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6edaffd700 1 --2- 172.21.15.81:0/380574693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6edc0a4350 0x7f6edc0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:46.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6edb7fe700 1 --2- 172.21.15.81:0/380574693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6edc0b5a50 0x7f6edc1e4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:46.704 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6eda7fc700 1 -- 172.21.15.81:0/380574693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6edc0b5a50 msgr2=0x7f6edc1e4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6eda7fc700 1 --2- 172.21.15.81:0/380574693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6edc0b5a50 0x7f6edc1e4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6eda7fc700 1 -- 172.21.15.81:0/380574693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6edc0a4350 msgr2=0x7f6edc0b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6eda7fc700 1 --2- 172.21.15.81:0/380574693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6edc0a4350 0x7f6edc0b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.705 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6eda7fc700 1 -- 172.21.15.81:0/380574693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed400ae10 con 0x7f6edc0bab50 2023-10-25T23:44:46.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6edaffd700 1 --2- 172.21.15.81:0/380574693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6edc0a4350 0x7f6edc0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:44:46.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6eda7fc700 1 --2- 172.21.15.81:0/380574693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6edc0bab50 0x7f6edc0b3930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc00e9a0 tx=0x7f6ecc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:46.706 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6ec37fe700 1 -- 172.21.15.81:0/380574693 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc004220 con 0x7f6edc0bab50 2023-10-25T23:44:46.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6ec37fe700 1 -- 172.21.15.81:0/380574693 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6ecc004380 con 0x7f6edc0bab50 2023-10-25T23:44:46.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6ee16cc700 1 -- 172.21.15.81:0/380574693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6edc09d870 con 0x7f6edc0bab50 2023-10-25T23:44:46.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6ec37fe700 1 -- 172.21.15.81:0/380574693 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc00cbd0 con 0x7f6edc0bab50 2023-10-25T23:44:46.707 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.693+0000 7f6ee16cc700 1 -- 172.21.15.81:0/380574693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6edc09cce0 con 0x7f6edc0bab50 2023-10-25T23:44:46.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.694+0000 7f6ee16cc700 1 -- 172.21.15.81:0/380574693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6edc04e4c0 con 0x7f6edc0bab50 2023-10-25T23:44:46.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.695+0000 7f6ec37fe700 1 -- 172.21.15.81:0/380574693 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6ecc00cd30 con 0x7f6edc0bab50 2023-10-25T23:44:46.708 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.695+0000 7f6ec37fe700 1 --2- 172.21.15.81:0/380574693 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6ec806aed0 0x7f6ec806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:46.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.695+0000 7f6ec37fe700 1 -- 172.21.15.81:0/380574693 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f6ecc014070 con 0x7f6edc0bab50 2023-10-25T23:44:46.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.695+0000 7f6edaffd700 1 --2- 172.21.15.81:0/380574693 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6ec806aed0 0x7f6ec806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:46.709 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.696+0000 7f6edaffd700 1 --2- 172.21.15.81:0/380574693 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6ec806aed0 0x7f6ec806d390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0000f60 tx=0x7f6ed0009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:46.710 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.699+0000 7f6ec37fe700 1 -- 172.21.15.81:0/380574693 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ecc054fe0 con 0x7f6edc0bab50 2023-10-25T23:44:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.890+0000 7f6ee16cc700 1 -- 172.21.15.81:0/380574693 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f6edc0ba400 con 0x7f6ec806aed0 2023-10-25T23:44:46.892 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.890+0000 7f6ec37fe700 1 -- 172.21.15.81:0/380574693 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6edc0ba400 con 0x7f6ec806aed0 2023-10-25T23:44:46.894 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.892+0000 7f6ee16cc700 1 -- 172.21.15.81:0/380574693 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6ec806aed0 msgr2=0x7f6ec806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.892+0000 7f6ee16cc700 1 --2- 172.21.15.81:0/380574693 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6ec806aed0 0x7f6ec806d390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0000f60 tx=0x7f6ed0009040 comp rx=0 tx=0).stop 2023-10-25T23:44:46.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.892+0000 7f6ee16cc700 1 -- 172.21.15.81:0/380574693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6edc0bab50 msgr2=0x7f6edc0b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:46.895 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.892+0000 7f6ee16cc700 1 --2- 172.21.15.81:0/380574693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6edc0bab50 0x7f6edc0b3930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc00e9a0 tx=0x7f6ecc00ed60 comp rx=0 tx=0).stop 2023-10-25T23:44:46.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.893+0000 7f6ee16cc700 1 -- 172.21.15.81:0/380574693 shutdown_connections 2023-10-25T23:44:46.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.893+0000 7f6ee16cc700 1 --2- 172.21.15.81:0/380574693 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6edc0b5a50 0x7f6edc1e4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.896 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.893+0000 7f6ee16cc700 1 --2- 172.21.15.81:0/380574693 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f6ec806aed0 0x7f6ec806d390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.893+0000 7f6ee16cc700 1 --2- 172.21.15.81:0/380574693 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6edc0a4350 0x7f6edc0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.893+0000 7f6ee16cc700 1 --2- 172.21.15.81:0/380574693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6edc0bab50 0x7f6edc0b3930 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.893+0000 7f6ee16cc700 1 -- 172.21.15.81:0/380574693 >> 172.21.15.81:0/380574693 conn(0x7f6edc0bc4a0 msgr2=0x7f6edc0bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.893+0000 7f6ee16cc700 1 -- 172.21.15.81:0/380574693 shutdown_connections 2023-10-25T23:44:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:46.893+0000 7f6ee16cc700 1 -- 172.21.15.81:0/380574693 wait complete. 2023-10-25T23:44:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 5 to deep-scrub 2023-10-25T23:44:46.907 INFO:tasks.ceph:Scrubbing osd.6 2023-10-25T23:44:46.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-25T23:44:47.034 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.032+0000 7fb043c9d700 1 -- 172.21.15.81:0/3358945583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb03c06f270 msgr2=0x7fb03c06be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.032+0000 7fb043c9d700 1 --2- 172.21.15.81:0/3358945583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb03c06f270 0x7fb03c06be40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0679c0 tx=0x7fb02c009c70 comp rx=0 tx=0).stop 2023-10-25T23:44:47.035 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.032+0000 7fb043c9d700 1 -- 172.21.15.81:0/3358945583 shutdown_connections 2023-10-25T23:44:47.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.032+0000 7fb043c9d700 1 --2- 172.21.15.81:0/3358945583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb03c06f270 0x7fb03c06be40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.032+0000 7fb043c9d700 1 --2- 172.21.15.81:0/3358945583 >> v2:172.21.15.89:3300/0 conn(0x7fb03c06a210 0x7fb03c146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.036 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.032+0000 7fb043c9d700 1 -- 172.21.15.81:0/3358945583 >> 172.21.15.81:0/3358945583 conn(0x7fb03c06b320 msgr2=0x7fb03c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:47.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.032+0000 7fb043c9d700 1 -- 172.21.15.81:0/3358945583 shutdown_connections 2023-10-25T23:44:47.037 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.032+0000 7fb043c9d700 1 -- 172.21.15.81:0/3358945583 wait complete. 2023-10-25T23:44:47.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.033+0000 7fb043c9d700 1 Processor -- start 2023-10-25T23:44:47.041 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.033+0000 7fb043c9d700 1 -- start start 2023-10-25T23:44:47.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.034+0000 7fb043c9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb03c06a210 0x7fb03c0b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:47.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.034+0000 7fb043c9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb03c06f270 0x7fb03c1e5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:47.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.034+0000 7fb043c9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb03c1467b0 0x7fb03c14dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:47.042 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.034+0000 7fb043c9d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c1e6790 con 0x7fb03c06a210 2023-10-25T23:44:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.034+0000 7fb043c9d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c0b68d0 con 0x7fb03c06f270 2023-10-25T23:44:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.034+0000 7fb043c9d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c14fec0 con 0x7fb03c1467b0 2023-10-25T23:44:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.034+0000 7fb041a39700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb03c06a210 0x7fb03c0b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.034+0000 7fb041a39700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb03c06a210 0x7fb03c0b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37304/0 (socket says 172.21.15.81:37304) 2023-10-25T23:44:47.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.034+0000 7fb041a39700 1 -- 172.21.15.81:0/1932357784 learned_addr learned my addr 172.21.15.81:0/1932357784 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:47.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.034+0000 7fb041238700 1 --2- 172.21.15.81:0/1932357784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb03c06f270 0x7fb03c1e5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:47.044 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.034+0000 7fb04223a700 1 --2- 172.21.15.81:0/1932357784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb03c1467b0 0x7fb03c14dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.034+0000 7fb041a39700 1 -- 172.21.15.81:0/1932357784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb03c1467b0 msgr2=0x7fb03c14dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.034+0000 7fb041a39700 1 --2- 172.21.15.81:0/1932357784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb03c1467b0 0x7fb03c14dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.034+0000 7fb041a39700 1 -- 172.21.15.81:0/1932357784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb03c06f270 msgr2=0x7fb03c1e5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.034+0000 7fb041a39700 1 --2- 172.21.15.81:0/1932357784 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb03c06f270 0x7fb03c1e5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.035+0000 7fb041a39700 1 -- 172.21.15.81:0/1932357784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0095f0 con 0x7fb03c06a210 2023-10-25T23:44:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.035+0000 7fb041a39700 1 --2- 172.21.15.81:0/1932357784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb03c06a210 0x7fb03c0b4330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb03c072040 tx=0x7fb02c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.035+0000 7fb0327fc700 1 -- 172.21.15.81:0/1932357784 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c01d070 con 0x7fb03c06a210 2023-10-25T23:44:47.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.035+0000 7fb0327fc700 1 -- 172.21.15.81:0/1932357784 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb02c005a00 con 0x7fb03c06a210 2023-10-25T23:44:47.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.035+0000 7fb043c9d700 1 -- 172.21.15.81:0/1932357784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03c1d8750 con 0x7fb03c06a210 2023-10-25T23:44:47.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.035+0000 7fb0327fc700 1 -- 172.21.15.81:0/1932357784 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c003ad0 con 0x7fb03c06a210 2023-10-25T23:44:47.047 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.035+0000 7fb043c9d700 1 -- 172.21.15.81:0/1932357784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03c1e63b0 con 0x7fb03c06a210 2023-10-25T23:44:47.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.036+0000 7fb043c9d700 1 -- 172.21.15.81:0/1932357784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb03c1507d0 con 0x7fb03c06a210 2023-10-25T23:44:47.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.036+0000 7fb0327fc700 1 -- 172.21.15.81:0/1932357784 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb02c003c30 con 0x7fb03c06a210 2023-10-25T23:44:47.048 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.036+0000 7fb0327fc700 1 --2- 172.21.15.81:0/1932357784 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fb02006aed0 0x7fb02006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.037+0000 7fb0327fc700 1 -- 172.21.15.81:0/1932357784 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fb02c08ad20 con 0x7fb03c06a210 2023-10-25T23:44:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.037+0000 7fb0327fc700 1 --2- 172.21.15.81:0/1932357784 >> [v2:172.21.15.89:6808/2561967165,v1:172.21.15.89:6809/2561967165] conn(0x7fb0200732d0 0x7fb020075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.037+0000 7fb0327fc700 1 -- 172.21.15.81:0/1932357784 --> [v2:172.21.15.89:6808/2561967165,v1:172.21.15.89:6809/2561967165] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb020075e40 con 0x7fb0200732d0 2023-10-25T23:44:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.037+0000 7fb0327fc700 1 -- 172.21.15.81:0/1932357784 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb02c08f030 con 0x7fb03c06a210 2023-10-25T23:44:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.037+0000 7fb041238700 1 --2- 172.21.15.81:0/1932357784 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fb02006aed0 0x7fb02006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.037+0000 7fb04223a700 1 --2- 172.21.15.81:0/1932357784 >> [v2:172.21.15.89:6808/2561967165,v1:172.21.15.89:6809/2561967165] conn(0x7fb0200732d0 0x7fb020075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.037+0000 7fb041238700 1 --2- 172.21.15.81:0/1932357784 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fb02006aed0 0x7fb02006d390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb038005950 tx=0x7fb0380058e0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.037+0000 7fb04223a700 1 --2- 172.21.15.81:0/1932357784 >> [v2:172.21.15.89:6808/2561967165,v1:172.21.15.89:6809/2561967165] conn(0x7fb0200732d0 0x7fb020075770 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.038+0000 7fb0327fc700 1 -- 172.21.15.81:0/1932357784 <== osd.6 v2:172.21.15.89:6808/2561967165 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fb020075e40 con 0x7fb0200732d0 2023-10-25T23:44:47.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.052+0000 7fb043c9d700 1 -- 172.21.15.81:0/1932357784 --> [v2:172.21.15.89:6808/2561967165,v1:172.21.15.89:6809/2561967165] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb03c06a790 con 0x7fb0200732d0 2023-10-25T23:44:47.055 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.053+0000 7fb0327fc700 1 -- 172.21.15.81:0/1932357784 <== osd.6 v2:172.21.15.89:6808/2561967165 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb034001d20 con 0x7fb0200732d0 2023-10-25T23:44:47.056 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-25T23:44:47.056 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-10-25T23:44:47.056 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-25T23:44:47.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.053+0000 7fb043c9d700 1 -- 172.21.15.81:0/1932357784 >> [v2:172.21.15.89:6808/2561967165,v1:172.21.15.89:6809/2561967165] conn(0x7fb0200732d0 msgr2=0x7fb020075770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.053+0000 7fb043c9d700 1 --2- 172.21.15.81:0/1932357784 >> [v2:172.21.15.89:6808/2561967165,v1:172.21.15.89:6809/2561967165] conn(0x7fb0200732d0 0x7fb020075770 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.053+0000 7fb043c9d700 1 -- 172.21.15.81:0/1932357784 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fb02006aed0 msgr2=0x7fb02006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.053+0000 7fb043c9d700 1 --2- 172.21.15.81:0/1932357784 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fb02006aed0 0x7fb02006d390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb038005950 tx=0x7fb0380058e0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.053+0000 7fb043c9d700 1 -- 172.21.15.81:0/1932357784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb03c06a210 msgr2=0x7fb03c0b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.053+0000 7fb043c9d700 1 --2- 172.21.15.81:0/1932357784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb03c06a210 0x7fb03c0b4330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb03c072040 tx=0x7fb02c0042f0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.053+0000 7fb04223a700 1 -- 172.21.15.81:0/1932357784 reap_dead start 2023-10-25T23:44:47.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.053+0000 7fb043c9d700 1 -- 172.21.15.81:0/1932357784 shutdown_connections 2023-10-25T23:44:47.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.053+0000 7fb043c9d700 1 -- 172.21.15.81:0/1932357784 >> 172.21.15.81:0/1932357784 conn(0x7fb03c06b320 msgr2=0x7fb03c1433a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:47.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.053+0000 7fb043c9d700 1 -- 172.21.15.81:0/1932357784 shutdown_connections 2023-10-25T23:44:47.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.053+0000 7fb043c9d700 1 -- 172.21.15.81:0/1932357784 wait complete. 2023-10-25T23:44:47.066 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-25T23:44:47.192 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.190+0000 7f4f62eac700 1 -- 172.21.15.81:0/1654869635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c0bb530 msgr2=0x7f4f5c0bd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.190+0000 7f4f62eac700 1 --2- 172.21.15.81:0/1654869635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c0bb530 0x7f4f5c0bd5c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4f48005fd0 tx=0x7f4f48009c70 comp rx=0 tx=0).stop 2023-10-25T23:44:47.193 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.190+0000 7f4f62eac700 1 -- 172.21.15.81:0/1654869635 shutdown_connections 2023-10-25T23:44:47.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.190+0000 7f4f62eac700 1 --2- 172.21.15.81:0/1654869635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f5c0bdb00 0x7f4f5c155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.190+0000 7f4f62eac700 1 --2- 172.21.15.81:0/1654869635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c0bb530 0x7f4f5c0bd5c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.194 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.190+0000 7f4f62eac700 1 -- 172.21.15.81:0/1654869635 >> 172.21.15.81:0/1654869635 conn(0x7f4f5c06b320 msgr2=0x7f4f5c06b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:47.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.190+0000 7f4f62eac700 1 -- 172.21.15.81:0/1654869635 shutdown_connections 2023-10-25T23:44:47.195 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.190+0000 7f4f62eac700 1 -- 172.21.15.81:0/1654869635 wait complete. 2023-10-25T23:44:47.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.191+0000 7f4f62eac700 1 Processor -- start 2023-10-25T23:44:47.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.191+0000 7f4f62eac700 1 -- start start 2023-10-25T23:44:47.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.192+0000 7f4f62eac700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f5c0bb530 0x7f4f5c13caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:47.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.192+0000 7f4f62eac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c0bdb00 0x7f4f5c1d6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:47.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.192+0000 7f4f62eac700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f5c144f60 0x7f4f5c13aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:47.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.192+0000 7f4f62eac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c143500 con 0x7f4f5c0bdb00 2023-10-25T23:44:47.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.192+0000 7f4f62eac700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c1d5bf0 con 0x7f4f5c0bb530 2023-10-25T23:44:47.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.192+0000 7f4f62eac700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c1d61b0 con 0x7f4f5c144f60 2023-10-25T23:44:47.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.192+0000 7f4f5bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c0bdb00 0x7f4f5c1d6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:47.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.192+0000 7f4f5bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c0bdb00 0x7f4f5c1d6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37322/0 (socket says 172.21.15.81:37322) 2023-10-25T23:44:47.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.192+0000 7f4f5bfff700 1 -- 172.21.15.81:0/2553140770 learned_addr learned my addr 172.21.15.81:0/2553140770 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:47.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.192+0000 7f4f60c48700 1 --2- 172.21.15.81:0/2553140770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f5c0bb530 0x7f4f5c13caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:47.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.192+0000 7f4f61449700 1 --2- 172.21.15.81:0/2553140770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f5c144f60 0x7f4f5c13aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:47.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.192+0000 7f4f5bfff700 1 -- 172.21.15.81:0/2553140770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f5c144f60 msgr2=0x7f4f5c13aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.192+0000 7f4f5bfff700 1 --2- 172.21.15.81:0/2553140770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f5c144f60 0x7f4f5c13aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.192+0000 7f4f5bfff700 1 -- 172.21.15.81:0/2553140770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f5c0bb530 msgr2=0x7f4f5c13caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.192+0000 7f4f5bfff700 1 --2- 172.21.15.81:0/2553140770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f5c0bb530 0x7f4f5c13caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.192+0000 7f4f5bfff700 1 -- 172.21.15.81:0/2553140770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f480095f0 con 0x7f4f5c0bdb00 2023-10-25T23:44:47.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.192+0000 7f4f61449700 1 --2- 172.21.15.81:0/2553140770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f5c144f60 0x7f4f5c13aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:44:47.203 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.192+0000 7f4f60c48700 1 --2- 172.21.15.81:0/2553140770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f5c0bb530 0x7f4f5c13caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:44:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.193+0000 7f4f5bfff700 1 --2- 172.21.15.81:0/2553140770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c0bdb00 0x7f4f5c1d6640 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c06c270 tx=0x7f4f48004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.193+0000 7f4f597fa700 1 -- 172.21.15.81:0/2553140770 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4801c070 con 0x7f4f5c0bdb00 2023-10-25T23:44:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.193+0000 7f4f597fa700 1 -- 172.21.15.81:0/2553140770 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4f48003890 con 0x7f4f5c0bdb00 2023-10-25T23:44:47.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.193+0000 7f4f597fa700 1 -- 172.21.15.81:0/2553140770 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f48003c60 con 0x7f4f5c0bdb00 2023-10-25T23:44:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.193+0000 7f4f62eac700 1 -- 172.21.15.81:0/2553140770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5c13cfe0 con 0x7f4f5c0bdb00 2023-10-25T23:44:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.193+0000 7f4f62eac700 1 -- 172.21.15.81:0/2553140770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5c1e4e70 con 0x7f4f5c0bdb00 2023-10-25T23:44:47.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.194+0000 7f4f62eac700 1 -- 172.21.15.81:0/2553140770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5c1d6320 con 0x7f4f5c0bdb00 2023-10-25T23:44:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.194+0000 7f4f597fa700 1 -- 172.21.15.81:0/2553140770 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4f4800f460 con 0x7f4f5c0bdb00 2023-10-25T23:44:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.194+0000 7f4f597fa700 1 --2- 172.21.15.81:0/2553140770 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f4f4006af00 0x7f4f4006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.195+0000 7f4f597fa700 1 -- 172.21.15.81:0/2553140770 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f4f4808a980 con 0x7f4f5c0bdb00 2023-10-25T23:44:47.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.195+0000 7f4f60c48700 1 --2- 172.21.15.81:0/2553140770 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f4f4006af00 0x7f4f4006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.195+0000 7f4f60c48700 1 --2- 172.21.15.81:0/2553140770 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f4f4006af00 0x7f4f4006d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4f50000f60 tx=0x7f4f50009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:47.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.199+0000 7f4f597fa700 1 -- 172.21.15.81:0/2553140770 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f48055a10 con 0x7f4f5c0bdb00 2023-10-25T23:44:47.391 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.390+0000 7f4f62eac700 1 -- 172.21.15.81:0/2553140770 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f5c06f7e0 con 0x7f4f4006af00 2023-10-25T23:44:47.392 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.390+0000 7f4f597fa700 1 -- 172.21.15.81:0/2553140770 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4f500014f0 con 0x7f4f4006af00 2023-10-25T23:44:47.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.393+0000 7f4f62eac700 1 -- 172.21.15.81:0/2553140770 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f4f4006af00 msgr2=0x7f4f4006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.393+0000 7f4f62eac700 1 --2- 172.21.15.81:0/2553140770 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f4f4006af00 0x7f4f4006d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4f50000f60 tx=0x7f4f50009040 comp rx=0 tx=0).stop 2023-10-25T23:44:47.395 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.393+0000 7f4f62eac700 1 -- 172.21.15.81:0/2553140770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c0bdb00 msgr2=0x7f4f5c1d6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.393+0000 7f4f62eac700 1 --2- 172.21.15.81:0/2553140770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c0bdb00 0x7f4f5c1d6640 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c06c270 tx=0x7f4f48004310 comp rx=0 tx=0).stop 2023-10-25T23:44:47.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.393+0000 7f4f62eac700 1 -- 172.21.15.81:0/2553140770 shutdown_connections 2023-10-25T23:44:47.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.393+0000 7f4f62eac700 1 --2- 172.21.15.81:0/2553140770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f5c144f60 0x7f4f5c13aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.396 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.393+0000 7f4f62eac700 1 --2- 172.21.15.81:0/2553140770 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f4f4006af00 0x7f4f4006d3c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.393+0000 7f4f62eac700 1 --2- 172.21.15.81:0/2553140770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f5c0bb530 0x7f4f5c13caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.393+0000 7f4f62eac700 1 --2- 172.21.15.81:0/2553140770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f5c0bdb00 0x7f4f5c1d6640 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.397 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.393+0000 7f4f62eac700 1 -- 172.21.15.81:0/2553140770 >> 172.21.15.81:0/2553140770 conn(0x7f4f5c06b320 msgr2=0x7f4f5c14a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:47.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.393+0000 7f4f62eac700 1 -- 172.21.15.81:0/2553140770 shutdown_connections 2023-10-25T23:44:47.398 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.393+0000 7f4f62eac700 1 -- 172.21.15.81:0/2553140770 wait complete. 2023-10-25T23:44:47.398 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 6 to deep-scrub 2023-10-25T23:44:47.407 INFO:tasks.ceph:Scrubbing osd.7 2023-10-25T23:44:47.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-25T23:44:47.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:44:47.515 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:44:47.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.533+0000 7f0843954700 1 -- 172.21.15.81:0/346976938 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083c14bbd0 msgr2=0x7f083c14e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.533+0000 7f0843954700 1 --2- 172.21.15.81:0/346976938 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083c14bbd0 0x7f083c14e980 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f082c005fd0 tx=0x7f082c009c70 comp rx=0 tx=0).stop 2023-10-25T23:44:47.536 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.534+0000 7f0843954700 1 -- 172.21.15.81:0/346976938 shutdown_connections 2023-10-25T23:44:47.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.534+0000 7f0843954700 1 --2- 172.21.15.81:0/346976938 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083c0b7dc0 0x7f083c14eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.534+0000 7f0843954700 1 --2- 172.21.15.81:0/346976938 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083c14bbd0 0x7f083c14e980 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.537 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.534+0000 7f0843954700 1 -- 172.21.15.81:0/346976938 >> 172.21.15.81:0/346976938 conn(0x7f083c06b320 msgr2=0x7f083c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:47.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.534+0000 7f0843954700 1 -- 172.21.15.81:0/346976938 shutdown_connections 2023-10-25T23:44:47.538 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.534+0000 7f0843954700 1 -- 172.21.15.81:0/346976938 wait complete. 2023-10-25T23:44:47.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.535+0000 7f0843954700 1 Processor -- start 2023-10-25T23:44:47.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.535+0000 7f0843954700 1 -- start start 2023-10-25T23:44:47.541 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.536+0000 7f0843954700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f083c0b3e30 0x7f083c1e7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:47.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.536+0000 7f0843954700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083c0b7dc0 0x7f083c154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:47.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.536+0000 7f0843954700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083c14bbd0 0x7f083c0bcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:47.542 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.536+0000 7f0843954700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c146e30 con 0x7f083c0b3e30 2023-10-25T23:44:47.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.536+0000 7f0843954700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083c148470 con 0x7f083c14bbd0 2023-10-25T23:44:47.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.536+0000 7f0843954700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f083c0bcfe0 con 0x7f083c0b7dc0 2023-10-25T23:44:47.543 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.536+0000 7f08416f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f083c0b3e30 0x7f083c1e7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:47.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.536+0000 7f08416f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f083c0b3e30 0x7f083c1e7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37334/0 (socket says 172.21.15.81:37334) 2023-10-25T23:44:47.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.536+0000 7f08416f0700 1 -- 172.21.15.81:0/448538214 learned_addr learned my addr 172.21.15.81:0/448538214 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:47.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.536+0000 7f0840eef700 1 --2- 172.21.15.81:0/448538214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083c0b7dc0 0x7f083c154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:47.544 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.536+0000 7f0841ef1700 1 --2- 172.21.15.81:0/448538214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083c14bbd0 0x7f083c0bcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:47.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.537+0000 7f08416f0700 1 -- 172.21.15.81:0/448538214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083c0b7dc0 msgr2=0x7f083c154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.537+0000 7f08416f0700 1 --2- 172.21.15.81:0/448538214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f083c0b7dc0 0x7f083c154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.545 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.537+0000 7f08416f0700 1 -- 172.21.15.81:0/448538214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083c14bbd0 msgr2=0x7f083c0bcaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.537+0000 7f08416f0700 1 --2- 172.21.15.81:0/448538214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f083c14bbd0 0x7f083c0bcaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.537+0000 7f08416f0700 1 -- 172.21.15.81:0/448538214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0834009c40 con 0x7f083c0b3e30 2023-10-25T23:44:47.546 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.537+0000 7f08416f0700 1 --2- 172.21.15.81:0/448538214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f083c0b3e30 0x7f083c1e7650 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f083800c490 tx=0x7f083800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:47.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.537+0000 7f0831ffb700 1 -- 172.21.15.81:0/448538214 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08380052d0 con 0x7f083c0b3e30 2023-10-25T23:44:47.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.537+0000 7f0831ffb700 1 -- 172.21.15.81:0/448538214 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f083800ce90 con 0x7f083c0b3e30 2023-10-25T23:44:47.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.537+0000 7f0843954700 1 -- 172.21.15.81:0/448538214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082c0095f0 con 0x7f083c0b3e30 2023-10-25T23:44:47.547 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.537+0000 7f0831ffb700 1 -- 172.21.15.81:0/448538214 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838005580 con 0x7f083c0b3e30 2023-10-25T23:44:47.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.537+0000 7f0843954700 1 -- 172.21.15.81:0/448538214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f083c06c140 con 0x7f083c0b3e30 2023-10-25T23:44:47.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.538+0000 7f0843954700 1 -- 172.21.15.81:0/448538214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f083c04e4c0 con 0x7f083c0b3e30 2023-10-25T23:44:47.548 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.539+0000 7f0831ffb700 1 -- 172.21.15.81:0/448538214 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0838003680 con 0x7f083c0b3e30 2023-10-25T23:44:47.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.539+0000 7f0831ffb700 1 --2- 172.21.15.81:0/448538214 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f082006aed0 0x7f082006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:47.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.539+0000 7f0831ffb700 1 -- 172.21.15.81:0/448538214 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f08380889f0 con 0x7f083c0b3e30 2023-10-25T23:44:47.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.539+0000 7f0831ffb700 1 --2- 172.21.15.81:0/448538214 >> [v2:172.21.15.89:6824/2647243500,v1:172.21.15.89:6825/2647243500] conn(0x7f08200732d0 0x7f0820075770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:47.549 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.539+0000 7f0831ffb700 1 -- 172.21.15.81:0/448538214 --> [v2:172.21.15.89:6824/2647243500,v1:172.21.15.89:6825/2647243500] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0820075e40 con 0x7f08200732d0 2023-10-25T23:44:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.539+0000 7f0831ffb700 1 -- 172.21.15.81:0/448538214 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f083808d2c0 con 0x7f083c0b3e30 2023-10-25T23:44:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.539+0000 7f0840eef700 1 --2- 172.21.15.81:0/448538214 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f082006aed0 0x7f082006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.539+0000 7f0841ef1700 1 --2- 172.21.15.81:0/448538214 >> [v2:172.21.15.89:6824/2647243500,v1:172.21.15.89:6825/2647243500] conn(0x7f08200732d0 0x7f0820075770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:47.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.540+0000 7f0840eef700 1 --2- 172.21.15.81:0/448538214 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f082006aed0 0x7f082006d390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f083c14bfe0 tx=0x7f082c019040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:47.551 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.540+0000 7f0841ef1700 1 --2- 172.21.15.81:0/448538214 >> [v2:172.21.15.89:6824/2647243500,v1:172.21.15.89:6825/2647243500] conn(0x7f08200732d0 0x7f0820075770 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:47.552 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.541+0000 7f0831ffb700 1 -- 172.21.15.81:0/448538214 <== osd.7 v2:172.21.15.89:6824/2647243500 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f0820075e40 con 0x7f08200732d0 2023-10-25T23:44:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.555+0000 7f0843954700 1 -- 172.21.15.81:0/448538214 --> [v2:172.21.15.89:6824/2647243500,v1:172.21.15.89:6825/2647243500] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f083c0bad40 con 0x7f08200732d0 2023-10-25T23:44:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.556+0000 7f0831ffb700 1 -- 172.21.15.81:0/448538214 <== osd.7 v2:172.21.15.89:6824/2647243500 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f083c0bad40 con 0x7f08200732d0 2023-10-25T23:44:47.558 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2023-10-25T23:44:47.558 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-10-25T23:44:47.559 INFO:teuthology.orchestra.run.smithi081.stdout:} 2023-10-25T23:44:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.556+0000 7f0843954700 1 -- 172.21.15.81:0/448538214 >> [v2:172.21.15.89:6824/2647243500,v1:172.21.15.89:6825/2647243500] conn(0x7f08200732d0 msgr2=0x7f0820075770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.556+0000 7f0843954700 1 --2- 172.21.15.81:0/448538214 >> [v2:172.21.15.89:6824/2647243500,v1:172.21.15.89:6825/2647243500] conn(0x7f08200732d0 0x7f0820075770 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.557+0000 7f0843954700 1 -- 172.21.15.81:0/448538214 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f082006aed0 msgr2=0x7f082006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.557+0000 7f0843954700 1 --2- 172.21.15.81:0/448538214 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f082006aed0 0x7f082006d390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f083c14bfe0 tx=0x7f082c019040 comp rx=0 tx=0).stop 2023-10-25T23:44:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.557+0000 7f0843954700 1 -- 172.21.15.81:0/448538214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f083c0b3e30 msgr2=0x7f083c1e7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.557+0000 7f0843954700 1 --2- 172.21.15.81:0/448538214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f083c0b3e30 0x7f083c1e7650 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f083800c490 tx=0x7f083800c7a0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.557+0000 7f0841ef1700 1 -- 172.21.15.81:0/448538214 reap_dead start 2023-10-25T23:44:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.557+0000 7f0843954700 1 -- 172.21.15.81:0/448538214 shutdown_connections 2023-10-25T23:44:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.557+0000 7f0843954700 1 -- 172.21.15.81:0/448538214 >> 172.21.15.81:0/448538214 conn(0x7f083c06b320 msgr2=0x7f083c06e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.557+0000 7f0843954700 1 -- 172.21.15.81:0/448538214 shutdown_connections 2023-10-25T23:44:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.557+0000 7f0843954700 1 -- 172.21.15.81:0/448538214 wait complete. 2023-10-25T23:44:47.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-25T23:44:47.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.738+0000 7f88d601d700 1 -- 172.21.15.81:0/3359151071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc003a30 msgr2=0x7f88bc003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.738+0000 7f88d601d700 1 --2- 172.21.15.81:0/3359151071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88bc003a30 0x7f88bc003e50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f88c000c310 tx=0x7f88bc005880 comp rx=0 tx=0).stop 2023-10-25T23:44:47.741 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.738+0000 7f88cffff700 1 -- 172.21.15.81:0/3359151071 reap_dead start 2023-10-25T23:44:47.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.738+0000 7f88d601d700 1 -- 172.21.15.81:0/3359151071 shutdown_connections 2023-10-25T23:44:47.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.738+0000 7f88d601d700 1 -- 172.21.15.81:0/3359151071 >> 172.21.15.81:0/3359151071 conn(0x7f88d00a3590 msgr2=0x7f88d00a3970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:47.742 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.739+0000 7f88d601d700 1 -- 172.21.15.81:0/3359151071 shutdown_connections 2023-10-25T23:44:47.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.739+0000 7f88d601d700 1 -- 172.21.15.81:0/3359151071 wait complete. 2023-10-25T23:44:47.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.740+0000 7f88d601d700 1 Processor -- start 2023-10-25T23:44:47.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.740+0000 7f88d601d700 1 -- start start 2023-10-25T23:44:47.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.741+0000 7f88d601d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88bc003a30 0x7f88d014b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.741+0000 7f88d601d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88d0140bb0 0x7f88d0142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.741+0000 7f88d601d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88d01418a0 0x7f88d0141d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.741+0000 7f88d601d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d006cd40 con 0x7f88d0140bb0 2023-10-25T23:44:47.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.741+0000 7f88d601d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d0142d80 con 0x7f88d01418a0 2023-10-25T23:44:47.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.741+0000 7f88d601d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d01e4480 con 0x7f88bc003a30 2023-10-25T23:44:47.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.741+0000 7f88ceffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88d0140bb0 0x7f88d0142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.741+0000 7f88ceffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88d0140bb0 0x7f88d0142840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37358/0 (socket says 172.21.15.81:37358) 2023-10-25T23:44:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.741+0000 7f88ceffd700 1 -- 172.21.15.81:0/3058412410 learned_addr learned my addr 172.21.15.81:0/3058412410 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:47.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.741+0000 7f88cf7fe700 1 --2- 172.21.15.81:0/3058412410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88bc003a30 0x7f88d014b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:47.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.741+0000 7f88cffff700 1 --2- 172.21.15.81:0/3058412410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88d01418a0 0x7f88d0141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:47.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.741+0000 7f88ceffd700 1 -- 172.21.15.81:0/3058412410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88bc003a30 msgr2=0x7f88d014b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.741+0000 7f88ceffd700 1 --2- 172.21.15.81:0/3058412410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88bc003a30 0x7f88d014b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.750 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.741+0000 7f88ceffd700 1 -- 172.21.15.81:0/3058412410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88d01418a0 msgr2=0x7f88d0141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.741+0000 7f88ceffd700 1 --2- 172.21.15.81:0/3058412410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88d01418a0 0x7f88d0141d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.741+0000 7f88ceffd700 1 -- 172.21.15.81:0/3058412410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d01e4740 con 0x7f88d0140bb0 2023-10-25T23:44:47.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.741+0000 7f88ceffd700 1 --2- 172.21.15.81:0/3058412410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88d0140bb0 0x7f88d0142840 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f88b8011b10 tx=0x7f88b8011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:47.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.742+0000 7f88c7fff700 1 -- 172.21.15.81:0/3058412410 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8004520 con 0x7f88d0140bb0 2023-10-25T23:44:47.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.742+0000 7f88c7fff700 1 -- 172.21.15.81:0/3058412410 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f88b8011e90 con 0x7f88d0140bb0 2023-10-25T23:44:47.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.742+0000 7f88d601d700 1 -- 172.21.15.81:0/3058412410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d01400d0 con 0x7f88d0140bb0 2023-10-25T23:44:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.742+0000 7f88c7fff700 1 -- 172.21.15.81:0/3058412410 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b800fb10 con 0x7f88d0140bb0 2023-10-25T23:44:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.742+0000 7f88d601d700 1 -- 172.21.15.81:0/3058412410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d0140690 con 0x7f88d0140bb0 2023-10-25T23:44:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.743+0000 7f88d601d700 1 -- 172.21.15.81:0/3058412410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d0067490 con 0x7f88d0140bb0 2023-10-25T23:44:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.743+0000 7f88c7fff700 1 -- 172.21.15.81:0/3058412410 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f88b800fc70 con 0x7f88d0140bb0 2023-10-25T23:44:47.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.743+0000 7f88c7fff700 1 --2- 172.21.15.81:0/3058412410 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f88b006aed0 0x7f88b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:47.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.744+0000 7f88c7fff700 1 -- 172.21.15.81:0/3058412410 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f88b808a490 con 0x7f88d0140bb0 2023-10-25T23:44:47.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.744+0000 7f88cf7fe700 1 --2- 172.21.15.81:0/3058412410 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f88b006aed0 0x7f88b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:47.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.744+0000 7f88cf7fe700 1 --2- 172.21.15.81:0/3058412410 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f88b006aed0 0x7f88b006d390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f88c0001ac0 tx=0x7f88c000f000 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:47.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.748+0000 7f88c7fff700 1 -- 172.21.15.81:0/3058412410 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f88b8055520 con 0x7f88d0140bb0 2023-10-25T23:44:47.943 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.941+0000 7f88d601d700 1 -- 172.21.15.81:0/3058412410 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f88d014d800 con 0x7f88b006aed0 2023-10-25T23:44:47.944 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.942+0000 7f88c7fff700 1 -- 172.21.15.81:0/3058412410 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f88c0000ed0 con 0x7f88b006aed0 2023-10-25T23:44:47.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.944+0000 7f88d601d700 1 -- 172.21.15.81:0/3058412410 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f88b006aed0 msgr2=0x7f88b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.944+0000 7f88d601d700 1 --2- 172.21.15.81:0/3058412410 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f88b006aed0 0x7f88b006d390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f88c0001ac0 tx=0x7f88c000f000 comp rx=0 tx=0).stop 2023-10-25T23:44:47.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.944+0000 7f88d601d700 1 -- 172.21.15.81:0/3058412410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88d0140bb0 msgr2=0x7f88d0142840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:47.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.944+0000 7f88d601d700 1 --2- 172.21.15.81:0/3058412410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88d0140bb0 0x7f88d0142840 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f88b8011b10 tx=0x7f88b8011e20 comp rx=0 tx=0).stop 2023-10-25T23:44:47.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.945+0000 7f88d601d700 1 -- 172.21.15.81:0/3058412410 shutdown_connections 2023-10-25T23:44:47.948 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.945+0000 7f88d601d700 1 --2- 172.21.15.81:0/3058412410 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f88b006aed0 0x7f88b006d390 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.945+0000 7f88d601d700 1 --2- 172.21.15.81:0/3058412410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88d01418a0 0x7f88d0141d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.945+0000 7f88d601d700 1 --2- 172.21.15.81:0/3058412410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88bc003a30 0x7f88d014b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.945+0000 7f88d601d700 1 --2- 172.21.15.81:0/3058412410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88d0140bb0 0x7f88d0142840 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:47.949 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.945+0000 7f88d601d700 1 -- 172.21.15.81:0/3058412410 >> 172.21.15.81:0/3058412410 conn(0x7f88d00a3590 msgr2=0x7f88d00bbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:47.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.945+0000 7f88d601d700 1 -- 172.21.15.81:0/3058412410 shutdown_connections 2023-10-25T23:44:47.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:47.945+0000 7f88d601d700 1 -- 172.21.15.81:0/3058412410 wait complete. 2023-10-25T23:44:47.950 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 7 to deep-scrub 2023-10-25T23:44:47.959 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T23:44:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.095+0000 7f1b13984700 1 -- 172.21.15.81:0/4104763104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c06cd80 msgr2=0x7f1b0c14b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.095+0000 7f1b13984700 1 --2- 172.21.15.81:0/4104763104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c06cd80 0x7f1b0c14b760 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0b7b80 tx=0x7f1b0400b380 comp rx=0 tx=0).stop 2023-10-25T23:44:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.095+0000 7f1b13984700 1 -- 172.21.15.81:0/4104763104 shutdown_connections 2023-10-25T23:44:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.095+0000 7f1b13984700 1 --2- 172.21.15.81:0/4104763104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c06cd80 0x7f1b0c14b760 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.095+0000 7f1b13984700 1 --2- 172.21.15.81:0/4104763104 >> v2:172.21.15.89:3300/0 conn(0x7f1b0c14f330 0x7f1b0c14b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.095+0000 7f1b13984700 1 -- 172.21.15.81:0/4104763104 >> 172.21.15.81:0/4104763104 conn(0x7f1b0c0c0a40 msgr2=0x7f1b0c0c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.095+0000 7f1b13984700 1 -- 172.21.15.81:0/4104763104 shutdown_connections 2023-10-25T23:44:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.095+0000 7f1b13984700 1 -- 172.21.15.81:0/4104763104 wait complete. 2023-10-25T23:44:48.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.096+0000 7f1b13984700 1 Processor -- start 2023-10-25T23:44:48.102 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.096+0000 7f1b13984700 1 -- start start 2023-10-25T23:44:48.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.097+0000 7f1b13984700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c06cd80 0x7f1b0c1e81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:48.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.097+0000 7f1b13984700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b0c1454f0 0x7f1b0c144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:48.103 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.097+0000 7f1b13984700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b0c14f330 0x7f1b0c132790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:48.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.097+0000 7f1b13984700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c132060 con 0x7f1b0c06cd80 2023-10-25T23:44:48.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.097+0000 7f1b13984700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c1e8720 con 0x7f1b0c14f330 2023-10-25T23:44:48.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.097+0000 7f1b13984700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c132300 con 0x7f1b0c1454f0 2023-10-25T23:44:48.104 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.097+0000 7f1b11720700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c06cd80 0x7f1b0c1e81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:48.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.097+0000 7f1b11720700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c06cd80 0x7f1b0c1e81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37370/0 (socket says 172.21.15.81:37370) 2023-10-25T23:44:48.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.097+0000 7f1b11720700 1 -- 172.21.15.81:0/3671731882 learned_addr learned my addr 172.21.15.81:0/3671731882 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:44:48.105 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.097+0000 7f1b11f21700 1 --2- 172.21.15.81:0/3671731882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b0c14f330 0x7f1b0c132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:48.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.097+0000 7f1b10f1f700 1 --2- 172.21.15.81:0/3671731882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b0c1454f0 0x7f1b0c144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:48.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.097+0000 7f1b11720700 1 -- 172.21.15.81:0/3671731882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b0c1454f0 msgr2=0x7f1b0c144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:48.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.097+0000 7f1b11720700 1 --2- 172.21.15.81:0/3671731882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b0c1454f0 0x7f1b0c144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:48.106 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.097+0000 7f1b11720700 1 -- 172.21.15.81:0/3671731882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b0c14f330 msgr2=0x7f1b0c132790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:48.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.097+0000 7f1b11720700 1 --2- 172.21.15.81:0/3671731882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b0c14f330 0x7f1b0c132790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:48.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.097+0000 7f1b11720700 1 -- 172.21.15.81:0/3671731882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b04009d00 con 0x7f1b0c06cd80 2023-10-25T23:44:48.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.097+0000 7f1b10f1f700 1 --2- 172.21.15.81:0/3671731882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b0c1454f0 0x7f1b0c144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:44:48.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.098+0000 7f1b11720700 1 --2- 172.21.15.81:0/3671731882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c06cd80 0x7f1b0c1e81e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00c4c0 tx=0x7f1afc00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:48.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.098+0000 7f1b01ffb700 1 -- 172.21.15.81:0/3671731882 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc0052d0 con 0x7f1b0c06cd80 2023-10-25T23:44:48.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.098+0000 7f1b01ffb700 1 -- 172.21.15.81:0/3671731882 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1afc005540 con 0x7f1b0c06cd80 2023-10-25T23:44:48.108 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.098+0000 7f1b13984700 1 -- 172.21.15.81:0/3671731882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0c0b6410 con 0x7f1b0c06cd80 2023-10-25T23:44:48.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.098+0000 7f1b01ffb700 1 -- 172.21.15.81:0/3671731882 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1afc006aa0 con 0x7f1b0c06cd80 2023-10-25T23:44:48.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.098+0000 7f1b13984700 1 -- 172.21.15.81:0/3671731882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0c14ae70 con 0x7f1b0c06cd80 2023-10-25T23:44:48.109 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.099+0000 7f1b13984700 1 -- 172.21.15.81:0/3671731882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0c1325e0 con 0x7f1b0c06cd80 2023-10-25T23:44:48.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.099+0000 7f1b01ffb700 1 -- 172.21.15.81:0/3671731882 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1afc003680 con 0x7f1b0c06cd80 2023-10-25T23:44:48.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.100+0000 7f1b01ffb700 1 --2- 172.21.15.81:0/3671731882 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f1af006aed0 0x7f1af006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:44:48.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.100+0000 7f1b01ffb700 1 -- 172.21.15.81:0/3671731882 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f1afc0889e0 con 0x7f1b0c06cd80 2023-10-25T23:44:48.110 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.100+0000 7f1b10f1f700 1 --2- 172.21.15.81:0/3671731882 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f1af006aed0 0x7f1af006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:44:48.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.100+0000 7f1b10f1f700 1 --2- 172.21.15.81:0/3671731882 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f1af006aed0 0x7f1af006d390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c1e1de0 tx=0x7f1b08009260 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:44:48.111 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.104+0000 7f1b01ffb700 1 -- 172.21.15.81:0/3671731882 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1afc053a90 con 0x7f1b0c06cd80 2023-10-25T23:44:48.297 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.295+0000 7f1b13984700 1 -- 172.21.15.81:0/3671731882 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b0c155b00 con 0x7f1af006aed0 2023-10-25T23:44:48.305 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.303+0000 7f1b01ffb700 1 -- 172.21.15.81:0/3671731882 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+293119 (secure 0 0 0) 0x7f1b08016070 con 0x7f1af006aed0 2023-10-25T23:44:48.309 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:44:48.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.307+0000 7f1b13984700 1 -- 172.21.15.81:0/3671731882 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f1af006aed0 msgr2=0x7f1af006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:48.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.307+0000 7f1b13984700 1 --2- 172.21.15.81:0/3671731882 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f1af006aed0 0x7f1af006d390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c1e1de0 tx=0x7f1b08009260 comp rx=0 tx=0).stop 2023-10-25T23:44:48.312 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.307+0000 7f1b13984700 1 -- 172.21.15.81:0/3671731882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c06cd80 msgr2=0x7f1b0c1e81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:44:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.307+0000 7f1b13984700 1 --2- 172.21.15.81:0/3671731882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c06cd80 0x7f1b0c1e81e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00c4c0 tx=0x7f1afc00c7d0 comp rx=0 tx=0).stop 2023-10-25T23:44:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.307+0000 7f1b13984700 1 -- 172.21.15.81:0/3671731882 shutdown_connections 2023-10-25T23:44:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.307+0000 7f1b13984700 1 --2- 172.21.15.81:0/3671731882 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f1af006aed0 0x7f1af006d390 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:48.313 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.307+0000 7f1b13984700 1 --2- 172.21.15.81:0/3671731882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b0c14f330 0x7f1b0c132790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:48.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.307+0000 7f1b13984700 1 --2- 172.21.15.81:0/3671731882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b0c06cd80 0x7f1b0c1e81e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:48.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.307+0000 7f1b13984700 1 --2- 172.21.15.81:0/3671731882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b0c1454f0 0x7f1b0c144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:44:48.314 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.307+0000 7f1b13984700 1 -- 172.21.15.81:0/3671731882 >> 172.21.15.81:0/3671731882 conn(0x7f1b0c0c0a40 msgr2=0x7f1b0c06a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:44:48.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.307+0000 7f1b13984700 1 -- 172.21.15.81:0/3671731882 shutdown_connections 2023-10-25T23:44:48.315 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:44:48.307+0000 7f1b13984700 1 -- 172.21.15.81:0/3671731882 wait complete. 2023-10-25T23:44:48.315 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-25T23:44:48.321 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2023-10-25T23:44:47.871479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":885848915,"num_objects":569,"num_object_clones":2,"num_object_copies":1138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":569,"num_whiteouts":0,"num_read":14774,"num_read_kb":532593,"num_write":91961,"num_write_kb":4545297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":344,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3988246,"num_omap_keys":6992,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147101,"ondisk_log_size":147101,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2693476,"kb_used_data":1733792,"kb_used_omap":12,"kb_used_meta":959603,"kb_avail":752281244,"statfs":{"total":773094113280,"available":770335993856,"internally_reserved":0,"allocated":1775403008,"data_stored":1773281230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":982634040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1682223,"num_objects":3,"num_object_clones":2,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":63,"num_write_kb":1680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3988246,"num_omap_keys":6992,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.000790"},"pg_stats":[{"pgid":"3.3f","version":"40'1945","reported_seq":4563,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.198627+0000","last_change":"2023-10-25T23:44:39.031078+0000","last_active":"2023-10-25T23:44:41.198627+0000","last_peered":"2023-10-25T23:44:41.198627+0000","last_clean":"2023-10-25T23:44:41.198627+0000","last_became_active":"2023-10-25T23:36:09.292007+0000","last_became_peered":"2023-10-25T23:36:09.292007+0000","last_unstale":"2023-10-25T23:44:41.198627+0000","last_undegraded":"2023-10-25T23:44:41.198627+0000","last_fullsized":"2023-10-25T23:44:41.198627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1945,"log_dups_size":0,"ondisk_log_size":1945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:32:34.257289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0441538,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":3053,"num_write":1182,"num_write_kb":17288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.3e","version":"40'1938","reported_seq":4574,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.167237+0000","last_change":"2023-10-25T23:44:39.125143+0000","last_active":"2023-10-25T23:44:41.167237+0000","last_peered":"2023-10-25T23:44:41.167237+0000","last_clean":"2023-10-25T23:44:41.167237+0000","last_became_active":"2023-10-25T23:36:09.281890+0000","last_became_peered":"2023-10-25T23:36:09.281890+0000","last_unstale":"2023-10-25T23:44:41.167237+0000","last_undegraded":"2023-10-25T23:44:41.167237+0000","last_fullsized":"2023-10-25T23:44:41.167237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1938,"log_dups_size":0,"ondisk_log_size":1938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.049488604999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":12821,"num_write":1152,"num_write_kb":16010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.3d","version":"40'2038","reported_seq":4637,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.160230+0000","last_change":"2023-10-25T23:44:39.641700+0000","last_active":"2023-10-25T23:44:41.160230+0000","last_peered":"2023-10-25T23:44:41.160230+0000","last_clean":"2023-10-25T23:44:41.160230+0000","last_became_active":"2023-10-25T23:36:09.284066+0000","last_became_peered":"2023-10-25T23:36:09.284066+0000","last_unstale":"2023-10-25T23:44:41.160230+0000","last_undegraded":"2023-10-25T23:44:41.160230+0000","last_fullsized":"2023-10-25T23:44:41.160230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2038,"log_dups_size":0,"ondisk_log_size":2038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17887767900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":12209,"num_write":1200,"num_write_kb":24347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.3c","version":"40'2086","reported_seq":4784,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.191556+0000","last_change":"2023-10-25T23:44:39.130990+0000","last_active":"2023-10-25T23:44:41.191556+0000","last_peered":"2023-10-25T23:44:41.191556+0000","last_clean":"2023-10-25T23:44:41.191556+0000","last_became_active":"2023-10-25T23:36:09.299585+0000","last_became_peered":"2023-10-25T23:36:09.299585+0000","last_unstale":"2023-10-25T23:44:41.191556+0000","last_undegraded":"2023-10-25T23:44:41.191556+0000","last_fullsized":"2023-10-25T23:44:41.191556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2086,"log_dups_size":0,"ondisk_log_size":2086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:26:02.661222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16786652399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":4442,"num_write":1222,"num_write_kb":17071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.3b","version":"40'2222","reported_seq":4818,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.188243+0000","last_change":"2023-10-25T23:44:39.035458+0000","last_active":"2023-10-25T23:44:41.188243+0000","last_peered":"2023-10-25T23:44:41.188243+0000","last_clean":"2023-10-25T23:44:41.188243+0000","last_became_active":"2023-10-25T23:36:09.287403+0000","last_became_peered":"2023-10-25T23:36:09.287403+0000","last_unstale":"2023-10-25T23:44:41.188243+0000","last_undegraded":"2023-10-25T23:44:41.188243+0000","last_fullsized":"2023-10-25T23:44:41.188243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2222,"log_dups_size":0,"ondisk_log_size":2222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:36:32.757443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047660552000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":4323,"num_write":1325,"num_write_kb":21852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.3a","version":"40'1930","reported_seq":4560,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.197016+0000","last_change":"2023-10-25T23:44:39.102497+0000","last_active":"2023-10-25T23:44:41.197016+0000","last_peered":"2023-10-25T23:44:41.197016+0000","last_clean":"2023-10-25T23:44:41.197016+0000","last_became_active":"2023-10-25T23:36:09.301305+0000","last_became_peered":"2023-10-25T23:36:09.301305+0000","last_unstale":"2023-10-25T23:44:41.197016+0000","last_undegraded":"2023-10-25T23:44:41.197016+0000","last_fullsized":"2023-10-25T23:44:41.197016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1930,"log_dups_size":0,"ondisk_log_size":1930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:47:48.760379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.139844156,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":4600,"num_write":1162,"num_write_kb":16604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.39","version":"40'2105","reported_seq":4706,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.167450+0000","last_change":"2023-10-25T23:44:39.026668+0000","last_active":"2023-10-25T23:44:41.167450+0000","last_peered":"2023-10-25T23:44:41.167450+0000","last_clean":"2023-10-25T23:44:41.167450+0000","last_became_active":"2023-10-25T23:36:09.293173+0000","last_became_peered":"2023-10-25T23:36:09.293173+0000","last_unstale":"2023-10-25T23:44:41.167450+0000","last_undegraded":"2023-10-25T23:44:41.167450+0000","last_fullsized":"2023-10-25T23:44:41.167450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2105,"log_dups_size":0,"ondisk_log_size":2105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:52:54.219284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040145588000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":4028,"num_write":1252,"num_write_kb":24067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.38","version":"40'1952","reported_seq":4587,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.202923+0000","last_change":"2023-10-25T23:44:38.909560+0000","last_active":"2023-10-25T23:44:41.202923+0000","last_peered":"2023-10-25T23:44:41.202923+0000","last_clean":"2023-10-25T23:44:41.202923+0000","last_became_active":"2023-10-25T23:36:09.295518+0000","last_became_peered":"2023-10-25T23:36:09.295518+0000","last_unstale":"2023-10-25T23:44:41.202923+0000","last_undegraded":"2023-10-25T23:44:41.202923+0000","last_fullsized":"2023-10-25T23:44:41.202923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035739239999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":4005,"num_write":1156,"num_write_kb":40374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.37","version":"40'2141","reported_seq":4762,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.202531+0000","last_change":"2023-10-25T23:44:39.033197+0000","last_active":"2023-10-25T23:44:41.202531+0000","last_peered":"2023-10-25T23:44:41.202531+0000","last_clean":"2023-10-25T23:44:41.202531+0000","last_became_active":"2023-10-25T23:36:09.297036+0000","last_became_peered":"2023-10-25T23:36:09.297036+0000","last_unstale":"2023-10-25T23:44:41.202531+0000","last_undegraded":"2023-10-25T23:44:41.202531+0000","last_fullsized":"2023-10-25T23:44:41.202531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2141,"log_dups_size":0,"ondisk_log_size":2141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:54:26.151297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046296174000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":8236,"num_write":1280,"num_write_kb":21230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.36","version":"40'1990","reported_seq":4604,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.201596+0000","last_change":"2023-10-25T23:44:39.516062+0000","last_active":"2023-10-25T23:44:41.201596+0000","last_peered":"2023-10-25T23:44:41.201596+0000","last_clean":"2023-10-25T23:44:41.201596+0000","last_became_active":"2023-10-25T23:36:09.297713+0000","last_became_peered":"2023-10-25T23:36:09.297713+0000","last_unstale":"2023-10-25T23:44:41.201596+0000","last_undegraded":"2023-10-25T23:44:41.201596+0000","last_fullsized":"2023-10-25T23:44:41.201596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1990,"log_dups_size":0,"ondisk_log_size":1990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:15:18.383242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052261503000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":4128,"num_write":1151,"num_write_kb":8179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.35","version":"40'2162","reported_seq":4757,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.160816+0000","last_change":"2023-10-25T23:44:39.519698+0000","last_active":"2023-10-25T23:44:41.160816+0000","last_peered":"2023-10-25T23:44:41.160816+0000","last_clean":"2023-10-25T23:44:41.160816+0000","last_became_active":"2023-10-25T23:36:50.071605+0000","last_became_peered":"2023-10-25T23:36:50.071605+0000","last_unstale":"2023-10-25T23:44:41.160816+0000","last_undegraded":"2023-10-25T23:44:41.160816+0000","last_fullsized":"2023-10-25T23:44:41.160816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2162,"log_dups_size":0,"ondisk_log_size":2162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:06.976880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056199102000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":4889,"num_write":1231,"num_write_kb":19417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.34","version":"40'2105","reported_seq":4709,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.160190+0000","last_change":"2023-10-25T23:44:38.977002+0000","last_active":"2023-10-25T23:44:41.160190+0000","last_peered":"2023-10-25T23:44:41.160190+0000","last_clean":"2023-10-25T23:44:41.160190+0000","last_became_active":"2023-10-25T23:36:09.291351+0000","last_became_peered":"2023-10-25T23:36:09.291351+0000","last_unstale":"2023-10-25T23:44:41.160190+0000","last_undegraded":"2023-10-25T23:44:41.160190+0000","last_fullsized":"2023-10-25T23:44:41.160190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2105,"log_dups_size":0,"ondisk_log_size":2105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:56:29.776633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104157445,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":4997,"num_write":1220,"num_write_kb":33278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.33","version":"40'2041","reported_seq":4655,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.174268+0000","last_change":"2023-10-25T23:44:38.915889+0000","last_active":"2023-10-25T23:44:41.174268+0000","last_peered":"2023-10-25T23:44:41.174268+0000","last_clean":"2023-10-25T23:44:41.174268+0000","last_became_active":"2023-10-25T23:36:09.289895+0000","last_became_peered":"2023-10-25T23:36:09.289895+0000","last_unstale":"2023-10-25T23:44:41.174268+0000","last_undegraded":"2023-10-25T23:44:41.174268+0000","last_fullsized":"2023-10-25T23:44:41.174268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041092534,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":8364,"num_write":1160,"num_write_kb":24700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.32","version":"40'2063","reported_seq":4693,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.173136+0000","last_change":"2023-10-25T23:44:39.647992+0000","last_active":"2023-10-25T23:44:41.173136+0000","last_peered":"2023-10-25T23:44:41.173136+0000","last_clean":"2023-10-25T23:44:41.173136+0000","last_became_active":"2023-10-25T23:36:09.283250+0000","last_became_peered":"2023-10-25T23:36:09.283250+0000","last_unstale":"2023-10-25T23:44:41.173136+0000","last_undegraded":"2023-10-25T23:44:41.173136+0000","last_fullsized":"2023-10-25T23:44:41.173136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2063,"log_dups_size":0,"ondisk_log_size":2063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18494869999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":4523,"num_write":1222,"num_write_kb":24181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.31","version":"40'2103","reported_seq":4719,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.165670+0000","last_change":"2023-10-25T23:44:39.124949+0000","last_active":"2023-10-25T23:44:41.165670+0000","last_peered":"2023-10-25T23:44:41.165670+0000","last_clean":"2023-10-25T23:44:41.165670+0000","last_became_active":"2023-10-25T23:36:09.286191+0000","last_became_peered":"2023-10-25T23:36:09.286191+0000","last_unstale":"2023-10-25T23:44:41.165670+0000","last_undegraded":"2023-10-25T23:44:41.165670+0000","last_fullsized":"2023-10-25T23:44:41.165670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2103,"log_dups_size":0,"ondisk_log_size":2103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.049576174000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":4088,"num_write":1280,"num_write_kb":29409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.30","version":"40'2074","reported_seq":4700,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.202581+0000","last_change":"2023-10-25T23:44:39.116703+0000","last_active":"2023-10-25T23:44:41.202581+0000","last_peered":"2023-10-25T23:44:41.202581+0000","last_clean":"2023-10-25T23:44:41.202581+0000","last_became_active":"2023-10-25T23:36:09.301040+0000","last_became_peered":"2023-10-25T23:36:09.301040+0000","last_unstale":"2023-10-25T23:44:41.202581+0000","last_undegraded":"2023-10-25T23:44:41.202581+0000","last_fullsized":"2023-10-25T23:44:41.202581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2074,"log_dups_size":0,"ondisk_log_size":2074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:07:11.314981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15382465100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":14548,"num_write":1224,"num_write_kb":47800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.2f","version":"40'2118","reported_seq":4759,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.187507+0000","last_change":"2023-10-25T23:44:38.906227+0000","last_active":"2023-10-25T23:44:41.187507+0000","last_peered":"2023-10-25T23:44:41.187507+0000","last_clean":"2023-10-25T23:44:41.187507+0000","last_became_active":"2023-10-25T23:36:50.103220+0000","last_became_peered":"2023-10-25T23:36:50.103220+0000","last_unstale":"2023-10-25T23:44:41.187507+0000","last_undegraded":"2023-10-25T23:44:41.187507+0000","last_fullsized":"2023-10-25T23:44:41.187507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2118,"log_dups_size":0,"ondisk_log_size":2118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033066291999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":8493,"num_write":1280,"num_write_kb":14868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.2e","version":"40'2009","reported_seq":4621,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.184477+0000","last_change":"2023-10-25T23:44:38.907165+0000","last_active":"2023-10-25T23:44:41.184477+0000","last_peered":"2023-10-25T23:44:41.184477+0000","last_clean":"2023-10-25T23:44:41.184477+0000","last_became_active":"2023-10-25T23:36:09.282282+0000","last_became_peered":"2023-10-25T23:36:09.282282+0000","last_unstale":"2023-10-25T23:44:41.184477+0000","last_undegraded":"2023-10-25T23:44:41.184477+0000","last_fullsized":"2023-10-25T23:44:41.184477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033856860000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":3064,"num_write":1152,"num_write_kb":24838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.2d","version":"40'2193","reported_seq":4801,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.176680+0000","last_change":"2023-10-25T23:44:39.028564+0000","last_active":"2023-10-25T23:44:41.176680+0000","last_peered":"2023-10-25T23:44:41.176680+0000","last_clean":"2023-10-25T23:44:41.176680+0000","last_became_active":"2023-10-25T23:36:09.289457+0000","last_became_peered":"2023-10-25T23:36:09.289457+0000","last_unstale":"2023-10-25T23:44:41.176680+0000","last_undegraded":"2023-10-25T23:44:41.176680+0000","last_fullsized":"2023-10-25T23:44:41.176680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2193,"log_dups_size":0,"ondisk_log_size":2193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:42:16.600805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041861184000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":8808,"num_write":1334,"num_write_kb":38138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.1f","version":"38'365","reported_seq":401,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.463057+0000","last_change":"2023-10-25T23:36:08.271164+0000","last_active":"2023-10-25T23:44:39.463057+0000","last_peered":"2023-10-25T23:44:39.463057+0000","last_clean":"2023-10-25T23:44:39.463057+0000","last_became_active":"2023-10-25T23:36:08.270911+0000","last_became_peered":"2023-10-25T23:36:08.270911+0000","last_unstale":"2023-10-25T23:44:39.463057+0000","last_undegraded":"2023-10-25T23:44:39.463057+0000","last_fullsized":"2023-10-25T23:44:39.463057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33555014,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":323,"num_write_kb":78531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"40'1985","reported_seq":4579,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.189308+0000","last_change":"2023-10-25T23:44:38.910905+0000","last_active":"2023-10-25T23:44:41.189308+0000","last_peered":"2023-10-25T23:44:41.189308+0000","last_clean":"2023-10-25T23:44:41.189308+0000","last_became_active":"2023-10-25T23:36:09.290260+0000","last_became_peered":"2023-10-25T23:36:09.290260+0000","last_unstale":"2023-10-25T23:44:41.189308+0000","last_undegraded":"2023-10-25T23:44:41.189308+0000","last_fullsized":"2023-10-25T23:44:41.189308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1985,"log_dups_size":0,"ondisk_log_size":1985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036898185999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":3083,"num_write":1169,"num_write_kb":11022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.1e","version":"34'636","reported_seq":672,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.874265+0000","last_change":"2023-10-25T23:36:08.269993+0000","last_active":"2023-10-25T23:44:38.874265+0000","last_peered":"2023-10-25T23:44:38.874265+0000","last_clean":"2023-10-25T23:44:38.874265+0000","last_became_active":"2023-10-25T23:36:08.269443+0000","last_became_peered":"2023-10-25T23:36:08.269443+0000","last_unstale":"2023-10-25T23:44:38.874265+0000","last_undegraded":"2023-10-25T23:44:38.874265+0000","last_fullsized":"2023-10-25T23:44:38.874265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":636,"log_dups_size":0,"ondisk_log_size":636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":598,"num_write_kb":86544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"40'1964","reported_seq":4600,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.175173+0000","last_change":"2023-10-25T23:44:39.629796+0000","last_active":"2023-10-25T23:44:41.175173+0000","last_peered":"2023-10-25T23:44:41.175173+0000","last_clean":"2023-10-25T23:44:41.175173+0000","last_became_active":"2023-10-25T23:36:09.299738+0000","last_became_peered":"2023-10-25T23:36:09.299738+0000","last_unstale":"2023-10-25T23:44:41.175173+0000","last_undegraded":"2023-10-25T23:44:41.175173+0000","last_fullsized":"2023-10-25T23:44:41.175173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1964,"log_dups_size":0,"ondisk_log_size":1964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16688098700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":3695,"num_write":1175,"num_write_kb":20733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.1d","version":"36'607","reported_seq":641,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.947990+0000","last_change":"2023-10-25T23:36:08.273879+0000","last_active":"2023-10-25T23:44:37.947990+0000","last_peered":"2023-10-25T23:44:37.947990+0000","last_clean":"2023-10-25T23:44:37.947990+0000","last_became_active":"2023-10-25T23:36:08.273574+0000","last_became_peered":"2023-10-25T23:36:08.273574+0000","last_unstale":"2023-10-25T23:44:37.947990+0000","last_undegraded":"2023-10-25T23:44:37.947990+0000","last_fullsized":"2023-10-25T23:44:37.947990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:27.340205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":582,"num_write_kb":140942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"40'2159","reported_seq":4760,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.193003+0000","last_change":"2023-10-25T23:44:39.102502+0000","last_active":"2023-10-25T23:44:41.193003+0000","last_peered":"2023-10-25T23:44:41.193003+0000","last_clean":"2023-10-25T23:44:41.193003+0000","last_became_active":"2023-10-25T23:36:09.299916+0000","last_became_peered":"2023-10-25T23:36:09.299916+0000","last_unstale":"2023-10-25T23:44:41.193003+0000","last_undegraded":"2023-10-25T23:44:41.193003+0000","last_fullsized":"2023-10-25T23:44:41.193003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:42:16.600805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14014327800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":4255,"num_write":1272,"num_write_kb":13349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.1c","version":"36'393","reported_seq":427,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.946945+0000","last_change":"2023-10-25T23:36:08.271714+0000","last_active":"2023-10-25T23:44:37.946945+0000","last_peered":"2023-10-25T23:44:37.946945+0000","last_clean":"2023-10-25T23:44:37.946945+0000","last_became_active":"2023-10-25T23:36:08.271442+0000","last_became_peered":"2023-10-25T23:36:08.271442+0000","last_unstale":"2023-10-25T23:44:37.946945+0000","last_undegraded":"2023-10-25T23:44:37.946945+0000","last_fullsized":"2023-10-25T23:44:37.946945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":379,"num_write_kb":83039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"40'2019","reported_seq":4649,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.201474+0000","last_change":"2023-10-25T23:44:39.109564+0000","last_active":"2023-10-25T23:44:41.201474+0000","last_peered":"2023-10-25T23:44:41.201474+0000","last_clean":"2023-10-25T23:44:41.201474+0000","last_became_active":"2023-10-25T23:36:09.299130+0000","last_became_peered":"2023-10-25T23:36:09.299130+0000","last_unstale":"2023-10-25T23:44:41.201474+0000","last_undegraded":"2023-10-25T23:44:41.201474+0000","last_fullsized":"2023-10-25T23:44:41.201474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2019,"log_dups_size":0,"ondisk_log_size":2019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:57:06.053396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14672489499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":3649,"num_write":1196,"num_write_kb":32686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.1b","version":"37'452","reported_seq":487,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.874318+0000","last_change":"2023-10-25T23:36:08.271119+0000","last_active":"2023-10-25T23:44:38.874318+0000","last_peered":"2023-10-25T23:44:38.874318+0000","last_clean":"2023-10-25T23:44:38.874318+0000","last_became_active":"2023-10-25T23:36:08.270138+0000","last_became_peered":"2023-10-25T23:36:08.270138+0000","last_unstale":"2023-10-25T23:44:38.874318+0000","last_undegraded":"2023-10-25T23:44:38.874318+0000","last_fullsized":"2023-10-25T23:44:38.874318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":475,"num_write_kb":111638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"40'2154","reported_seq":4764,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.144753+0000","last_change":"2023-10-25T23:44:38.965871+0000","last_active":"2023-10-25T23:44:41.144753+0000","last_peered":"2023-10-25T23:44:41.144753+0000","last_clean":"2023-10-25T23:44:41.144753+0000","last_became_active":"2023-10-25T23:36:09.287455+0000","last_became_peered":"2023-10-25T23:36:09.287455+0000","last_unstale":"2023-10-25T23:44:41.144753+0000","last_undegraded":"2023-10-25T23:44:41.144753+0000","last_fullsized":"2023-10-25T23:44:41.144753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:48:18.862050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.093404585999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":5171,"num_write":1282,"num_write_kb":34019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.1a","version":"37'538","reported_seq":572,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.948030+0000","last_change":"2023-10-25T23:36:08.272686+0000","last_active":"2023-10-25T23:44:37.948030+0000","last_peered":"2023-10-25T23:44:37.948030+0000","last_clean":"2023-10-25T23:44:37.948030+0000","last_became_active":"2023-10-25T23:36:08.271974+0000","last_became_peered":"2023-10-25T23:36:08.271974+0000","last_unstale":"2023-10-25T23:44:37.948030+0000","last_undegraded":"2023-10-25T23:44:37.948030+0000","last_fullsized":"2023-10-25T23:44:37.948030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":538,"log_dups_size":0,"ondisk_log_size":538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:07:00.434754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":503,"num_write_kb":90640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"40'2101","reported_seq":4691,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.175650+0000","last_change":"2023-10-25T23:44:39.666472+0000","last_active":"2023-10-25T23:44:41.175650+0000","last_peered":"2023-10-25T23:44:41.175650+0000","last_clean":"2023-10-25T23:44:41.175650+0000","last_became_active":"2023-10-25T23:36:09.294176+0000","last_became_peered":"2023-10-25T23:36:09.294176+0000","last_unstale":"2023-10-25T23:44:41.175650+0000","last_undegraded":"2023-10-25T23:44:41.175650+0000","last_fullsized":"2023-10-25T23:44:41.175650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2101,"log_dups_size":0,"ondisk_log_size":2101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20272068300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":27232,"num_write":1210,"num_write_kb":20727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.19","version":"40'297","reported_seq":332,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:42.148894+0000","last_change":"2023-10-25T23:36:08.273513+0000","last_active":"2023-10-25T23:44:42.148894+0000","last_peered":"2023-10-25T23:44:42.148894+0000","last_clean":"2023-10-25T23:44:42.148894+0000","last_became_active":"2023-10-25T23:36:08.273035+0000","last_became_peered":"2023-10-25T23:36:08.273035+0000","last_unstale":"2023-10-25T23:44:42.148894+0000","last_undegraded":"2023-10-25T23:44:42.148894+0000","last_fullsized":"2023-10-25T23:44:42.148894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20680260,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":271,"num_write_kb":79798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"40'2324","reported_seq":4917,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.181466+0000","last_change":"2023-10-25T23:44:38.909221+0000","last_active":"2023-10-25T23:44:41.181466+0000","last_peered":"2023-10-25T23:44:41.181466+0000","last_clean":"2023-10-25T23:44:41.181466+0000","last_became_active":"2023-10-25T23:36:09.292546+0000","last_became_peered":"2023-10-25T23:36:09.292546+0000","last_unstale":"2023-10-25T23:44:41.181466+0000","last_undegraded":"2023-10-25T23:44:41.181466+0000","last_fullsized":"2023-10-25T23:44:41.181466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035319162000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":23958,"num_write":1360,"num_write_kb":38473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.18","version":"36'1017","reported_seq":1051,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.947547+0000","last_change":"2023-10-25T23:36:08.277462+0000","last_active":"2023-10-25T23:44:37.947547+0000","last_peered":"2023-10-25T23:44:37.947547+0000","last_clean":"2023-10-25T23:44:37.947547+0000","last_became_active":"2023-10-25T23:36:08.277138+0000","last_became_peered":"2023-10-25T23:36:08.277138+0000","last_unstale":"2023-10-25T23:44:37.947547+0000","last_undegraded":"2023-10-25T23:44:37.947547+0000","last_fullsized":"2023-10-25T23:44:37.947547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:48:32.291671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":989,"num_write_kb":120913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"40'2067","reported_seq":4675,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.171886+0000","last_change":"2023-10-25T23:44:39.133918+0000","last_active":"2023-10-25T23:44:41.171886+0000","last_peered":"2023-10-25T23:44:41.171886+0000","last_clean":"2023-10-25T23:44:41.171886+0000","last_became_active":"2023-10-25T23:36:09.290456+0000","last_became_peered":"2023-10-25T23:36:09.290456+0000","last_unstale":"2023-10-25T23:44:41.171886+0000","last_undegraded":"2023-10-25T23:44:41.171886+0000","last_fullsized":"2023-10-25T23:44:41.171886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058251507000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":31667,"num_write":1204,"num_write_kb":33454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.17","version":"40'356","reported_seq":467,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.418563+0000","last_change":"2023-10-25T23:36:08.272869+0000","last_active":"2023-10-25T23:44:41.418563+0000","last_peered":"2023-10-25T23:44:41.418563+0000","last_clean":"2023-10-25T23:44:41.418563+0000","last_became_active":"2023-10-25T23:36:08.272120+0000","last_became_peered":"2023-10-25T23:36:08.272120+0000","last_unstale":"2023-10-25T23:44:41.418563+0000","last_undegraded":"2023-10-25T23:44:41.418563+0000","last_fullsized":"2023-10-25T23:44:41.418563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21516807,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":85,"num_read_kb":582,"num_write":349,"num_write_kb":84048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"40'2013","reported_seq":4624,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.198476+0000","last_change":"2023-10-25T23:44:39.130955+0000","last_active":"2023-10-25T23:44:41.198476+0000","last_peered":"2023-10-25T23:44:41.198476+0000","last_clean":"2023-10-25T23:44:41.198476+0000","last_became_active":"2023-10-25T23:36:09.293132+0000","last_became_peered":"2023-10-25T23:36:09.293132+0000","last_unstale":"2023-10-25T23:44:41.198476+0000","last_undegraded":"2023-10-25T23:44:41.198476+0000","last_fullsized":"2023-10-25T23:44:41.198476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:52:54.219284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.167893237,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":3351,"num_write":1194,"num_write_kb":12593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.16","version":"38'676","reported_seq":710,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.947737+0000","last_change":"2023-10-25T23:36:08.272920+0000","last_active":"2023-10-25T23:44:37.947737+0000","last_peered":"2023-10-25T23:44:37.947737+0000","last_clean":"2023-10-25T23:44:37.947737+0000","last_became_active":"2023-10-25T23:36:08.272596+0000","last_became_peered":"2023-10-25T23:36:08.272596+0000","last_unstale":"2023-10-25T23:44:37.947737+0000","last_undegraded":"2023-10-25T23:44:37.947737+0000","last_fullsized":"2023-10-25T23:44:37.947737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":681,"num_write_kb":114510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"40'2412","reported_seq":4884,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.175531+0000","last_change":"2023-10-25T23:44:39.666473+0000","last_active":"2023-10-25T23:44:41.175531+0000","last_peered":"2023-10-25T23:44:41.175531+0000","last_clean":"2023-10-25T23:44:41.175531+0000","last_became_active":"2023-10-25T23:36:09.299938+0000","last_became_peered":"2023-10-25T23:36:09.299938+0000","last_unstale":"2023-10-25T23:44:41.175531+0000","last_undegraded":"2023-10-25T23:44:41.175531+0000","last_fullsized":"2023-10-25T23:44:41.175531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2412,"log_dups_size":0,"ondisk_log_size":2412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20328459099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":3949,"num_write":1292,"num_write_kb":20710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.15","version":"40'672","reported_seq":707,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.422781+0000","last_change":"2023-10-25T23:36:08.279751+0000","last_active":"2023-10-25T23:44:41.422781+0000","last_peered":"2023-10-25T23:44:41.422781+0000","last_clean":"2023-10-25T23:44:41.422781+0000","last_became_active":"2023-10-25T23:36:08.279509+0000","last_became_peered":"2023-10-25T23:36:08.279509+0000","last_unstale":"2023-10-25T23:44:41.422781+0000","last_undegraded":"2023-10-25T23:44:41.422781+0000","last_fullsized":"2023-10-25T23:44:41.422781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":675,"num_write_kb":75678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"40'2111","reported_seq":4724,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.181124+0000","last_change":"2023-10-25T23:44:38.965806+0000","last_active":"2023-10-25T23:44:41.181124+0000","last_peered":"2023-10-25T23:44:41.181124+0000","last_clean":"2023-10-25T23:44:41.181124+0000","last_became_active":"2023-10-25T23:36:09.285196+0000","last_became_peered":"2023-10-25T23:36:09.285196+0000","last_unstale":"2023-10-25T23:44:41.181124+0000","last_undegraded":"2023-10-25T23:44:41.181124+0000","last_fullsized":"2023-10-25T23:44:41.181124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2111,"log_dups_size":0,"ondisk_log_size":2111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:57:33.172851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.093006917999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":5156,"num_write":1232,"num_write_kb":26142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.14","version":"37'525","reported_seq":559,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.948109+0000","last_change":"2023-10-25T23:36:08.272911+0000","last_active":"2023-10-25T23:44:37.948109+0000","last_peered":"2023-10-25T23:44:37.948109+0000","last_clean":"2023-10-25T23:44:37.948109+0000","last_became_active":"2023-10-25T23:36:08.272248+0000","last_became_peered":"2023-10-25T23:36:08.272248+0000","last_unstale":"2023-10-25T23:44:37.948109+0000","last_undegraded":"2023-10-25T23:44:37.948109+0000","last_fullsized":"2023-10-25T23:44:37.948109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":525,"log_dups_size":0,"ondisk_log_size":525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:18:45.178112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166496,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":486,"num_write_kb":123603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"40'2017","reported_seq":4642,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.176570+0000","last_change":"2023-10-25T23:44:39.028269+0000","last_active":"2023-10-25T23:44:41.176570+0000","last_peered":"2023-10-25T23:44:41.176570+0000","last_clean":"2023-10-25T23:44:41.176570+0000","last_became_active":"2023-10-25T23:36:09.292300+0000","last_became_peered":"2023-10-25T23:36:09.292300+0000","last_unstale":"2023-10-25T23:44:41.176570+0000","last_undegraded":"2023-10-25T23:44:41.176570+0000","last_fullsized":"2023-10-25T23:44:41.176570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2017,"log_dups_size":0,"ondisk_log_size":2017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:25:03.973201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041370048,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":2,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":211,"num_read_kb":3693,"num_write":1198,"num_write_kb":20850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.13","version":"40'229","reported_seq":272,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:44.810297+0000","last_change":"2023-10-25T23:44:44.810353+0000","last_active":"2023-10-25T23:44:44.810297+0000","last_peered":"2023-10-25T23:44:44.810297+0000","last_clean":"2023-10-25T23:44:44.810297+0000","last_became_active":"2023-10-25T23:36:08.274162+0000","last_became_peered":"2023-10-25T23:36:08.274162+0000","last_unstale":"2023-10-25T23:44:44.810297+0000","last_undegraded":"2023-10-25T23:44:44.810297+0000","last_fullsized":"2023-10-25T23:44:44.810297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'229","last_scrub_stamp":"2023-10-25T23:44:44.810222+0000","last_deep_scrub":"40'229","last_deep_scrub_stamp":"2023-10-25T23:44:44.810222+0000","last_clean_scrub_stamp":"2023-10-25T23:44:44.810222+0000","objects_scrubbed":19,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:05:42.612397+0000","scrub_duration":0.067816369000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360162,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":202,"num_write_kb":93162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2596919,"num_omap_keys":4542,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"40'2312","reported_seq":4810,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.177631+0000","last_change":"2023-10-25T23:44:39.638672+0000","last_active":"2023-10-25T23:44:41.177631+0000","last_peered":"2023-10-25T23:44:41.177631+0000","last_clean":"2023-10-25T23:44:41.177631+0000","last_became_active":"2023-10-25T23:36:09.284386+0000","last_became_peered":"2023-10-25T23:36:09.284386+0000","last_unstale":"2023-10-25T23:44:41.177631+0000","last_undegraded":"2023-10-25T23:44:41.177631+0000","last_fullsized":"2023-10-25T23:44:41.177631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2312,"log_dups_size":0,"ondisk_log_size":2312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17573393000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":8533,"num_write":1240,"num_write_kb":24417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.12","version":"35'180","reported_seq":214,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.949654+0000","last_change":"2023-10-25T23:36:08.271565+0000","last_active":"2023-10-25T23:44:37.949654+0000","last_peered":"2023-10-25T23:44:37.949654+0000","last_clean":"2023-10-25T23:44:37.949654+0000","last_became_active":"2023-10-25T23:36:08.271188+0000","last_became_peered":"2023-10-25T23:36:08.271188+0000","last_unstale":"2023-10-25T23:44:37.949654+0000","last_undegraded":"2023-10-25T23:44:37.949654+0000","last_fullsized":"2023-10-25T23:44:37.949654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:51:48.005011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":160,"num_write_kb":61795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"40'2163","reported_seq":4762,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.197240+0000","last_change":"2023-10-25T23:44:39.035067+0000","last_active":"2023-10-25T23:44:41.197240+0000","last_peered":"2023-10-25T23:44:41.197240+0000","last_clean":"2023-10-25T23:44:41.197240+0000","last_became_active":"2023-10-25T23:36:09.294200+0000","last_became_peered":"2023-10-25T23:36:09.294200+0000","last_unstale":"2023-10-25T23:44:41.197240+0000","last_undegraded":"2023-10-25T23:44:41.197240+0000","last_fullsized":"2023-10-25T23:44:41.197240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2163,"log_dups_size":0,"ondisk_log_size":2163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:11:27.861112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047064776000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":3992,"num_write":1263,"num_write_kb":18428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.11","version":"37'389","reported_seq":423,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.949534+0000","last_change":"2023-10-25T23:36:08.273427+0000","last_active":"2023-10-25T23:44:37.949534+0000","last_peered":"2023-10-25T23:44:37.949534+0000","last_clean":"2023-10-25T23:44:37.949534+0000","last_became_active":"2023-10-25T23:36:08.272301+0000","last_became_peered":"2023-10-25T23:36:08.272301+0000","last_unstale":"2023-10-25T23:44:37.949534+0000","last_undegraded":"2023-10-25T23:44:37.949534+0000","last_fullsized":"2023-10-25T23:44:37.949534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:25.995358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":376,"num_write_kb":99496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"40'2015","reported_seq":4637,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.162696+0000","last_change":"2023-10-25T23:44:39.507532+0000","last_active":"2023-10-25T23:44:41.162696+0000","last_peered":"2023-10-25T23:44:41.162696+0000","last_clean":"2023-10-25T23:44:41.162696+0000","last_became_active":"2023-10-25T23:36:09.291305+0000","last_became_peered":"2023-10-25T23:36:09.291305+0000","last_unstale":"2023-10-25T23:44:41.162696+0000","last_undegraded":"2023-10-25T23:44:41.162696+0000","last_fullsized":"2023-10-25T23:44:41.162696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:35:20.916506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044631746999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":3822,"num_write":1210,"num_write_kb":15603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.10","version":"36'336","reported_seq":371,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.872811+0000","last_change":"2023-10-25T23:36:08.277621+0000","last_active":"2023-10-25T23:44:38.872811+0000","last_peered":"2023-10-25T23:44:38.872811+0000","last_clean":"2023-10-25T23:44:38.872811+0000","last_became_active":"2023-10-25T23:36:08.277327+0000","last_became_peered":"2023-10-25T23:36:08.277327+0000","last_unstale":"2023-10-25T23:44:38.872811+0000","last_undegraded":"2023-10-25T23:44:38.872811+0000","last_fullsized":"2023-10-25T23:44:38.872811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":349,"num_write_kb":89245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"40'2084","reported_seq":4731,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.180050+0000","last_change":"2023-10-25T23:44:39.024433+0000","last_active":"2023-10-25T23:44:41.180050+0000","last_peered":"2023-10-25T23:44:41.180050+0000","last_clean":"2023-10-25T23:44:41.180050+0000","last_became_active":"2023-10-25T23:36:09.295231+0000","last_became_peered":"2023-10-25T23:36:09.295231+0000","last_unstale":"2023-10-25T23:44:41.180050+0000","last_undegraded":"2023-10-25T23:44:41.180050+0000","last_fullsized":"2023-10-25T23:44:41.180050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2084,"log_dups_size":0,"ondisk_log_size":2084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:26:02.661222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037920328000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":12104,"num_write":1268,"num_write_kb":24673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.f","version":"36'388","reported_seq":422,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.871300+0000","last_change":"2023-10-25T23:36:08.263573+0000","last_active":"2023-10-25T23:44:37.871300+0000","last_peered":"2023-10-25T23:44:37.871300+0000","last_clean":"2023-10-25T23:44:37.871300+0000","last_became_active":"2023-10-25T23:36:08.263264+0000","last_became_peered":"2023-10-25T23:36:08.263264+0000","last_unstale":"2023-10-25T23:44:37.871300+0000","last_undegraded":"2023-10-25T23:44:37.871300+0000","last_fullsized":"2023-10-25T23:44:37.871300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:35.330233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554454,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":368,"num_write_kb":90831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"40'2070","reported_seq":4697,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.178729+0000","last_change":"2023-10-25T23:44:39.026687+0000","last_active":"2023-10-25T23:44:41.178729+0000","last_peered":"2023-10-25T23:44:41.178729+0000","last_clean":"2023-10-25T23:44:41.178729+0000","last_became_active":"2023-10-25T23:36:09.294298+0000","last_became_peered":"2023-10-25T23:36:09.294298+0000","last_unstale":"2023-10-25T23:44:41.178729+0000","last_undegraded":"2023-10-25T23:44:41.178729+0000","last_fullsized":"2023-10-25T23:44:41.178729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:38:39.184295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040324974999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":8972,"num_write":1223,"num_write_kb":21636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.4","version":"40'339","reported_seq":383,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:45.236914+0000","last_change":"2023-10-25T23:44:45.236992+0000","last_active":"2023-10-25T23:44:45.236914+0000","last_peered":"2023-10-25T23:44:45.236914+0000","last_clean":"2023-10-25T23:44:45.236914+0000","last_became_active":"2023-10-25T23:36:08.277087+0000","last_became_peered":"2023-10-25T23:36:08.277087+0000","last_unstale":"2023-10-25T23:44:45.236914+0000","last_undegraded":"2023-10-25T23:44:45.236914+0000","last_fullsized":"2023-10-25T23:44:45.236914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'339","last_scrub_stamp":"2023-10-25T23:44:45.236835+0000","last_deep_scrub":"40'339","last_deep_scrub_stamp":"2023-10-25T23:44:45.236835+0000","last_clean_scrub_stamp":"2023-10-25T23:44:45.236835+0000","objects_scrubbed":23,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:38:57.739655+0000","scrub_duration":0.071032165999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":307,"num_write_kb":115956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":959437,"num_omap_keys":1709,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"40'2156","reported_seq":4763,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.200455+0000","last_change":"2023-10-25T23:44:39.123930+0000","last_active":"2023-10-25T23:44:41.200455+0000","last_peered":"2023-10-25T23:44:41.200455+0000","last_clean":"2023-10-25T23:44:41.200455+0000","last_became_active":"2023-10-25T23:36:50.069951+0000","last_became_peered":"2023-10-25T23:36:50.069951+0000","last_unstale":"2023-10-25T23:44:41.200455+0000","last_undegraded":"2023-10-25T23:44:41.200455+0000","last_fullsized":"2023-10-25T23:44:41.200455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2156,"log_dups_size":0,"ondisk_log_size":2156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:38:39.184295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.160884052,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":24659,"num_write":1256,"num_write_kb":46504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.2","version":"36'293","reported_seq":328,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.949553+0000","last_change":"2023-10-25T23:36:08.279568+0000","last_active":"2023-10-25T23:44:37.949553+0000","last_peered":"2023-10-25T23:44:37.949553+0000","last_clean":"2023-10-25T23:44:37.949553+0000","last_became_active":"2023-10-25T23:36:08.279302+0000","last_became_peered":"2023-10-25T23:36:08.279302+0000","last_unstale":"2023-10-25T23:44:37.949553+0000","last_undegraded":"2023-10-25T23:44:37.949553+0000","last_fullsized":"2023-10-25T23:44:37.949553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:17:27.340205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":257,"num_write_kb":101207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"40'2040","reported_seq":4670,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.156983+0000","last_change":"2023-10-25T23:44:38.976975+0000","last_active":"2023-10-25T23:44:41.156983+0000","last_peered":"2023-10-25T23:44:41.156983+0000","last_clean":"2023-10-25T23:44:41.156983+0000","last_became_active":"2023-10-25T23:36:09.292670+0000","last_became_peered":"2023-10-25T23:36:09.292670+0000","last_unstale":"2023-10-25T23:44:41.156983+0000","last_undegraded":"2023-10-25T23:44:41.156983+0000","last_fullsized":"2023-10-25T23:44:41.156983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:47:28.005164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.104196124,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":4275,"num_write":1236,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.0","version":"40'2118","reported_seq":4726,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.155636+0000","last_change":"2023-10-25T23:44:39.130861+0000","last_active":"2023-10-25T23:44:41.155636+0000","last_peered":"2023-10-25T23:44:41.155636+0000","last_clean":"2023-10-25T23:44:41.155636+0000","last_became_active":"2023-10-25T23:36:09.283766+0000","last_became_peered":"2023-10-25T23:36:09.283766+0000","last_unstale":"2023-10-25T23:44:41.155636+0000","last_undegraded":"2023-10-25T23:44:41.155636+0000","last_fullsized":"2023-10-25T23:44:41.155636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2118,"log_dups_size":0,"ondisk_log_size":2118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055043175999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":3969,"num_write":1247,"num_write_kb":17464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.1","version":"36'550","reported_seq":879,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.872822+0000","last_change":"2023-10-25T23:36:08.264050+0000","last_active":"2023-10-25T23:44:38.872822+0000","last_peered":"2023-10-25T23:44:38.872822+0000","last_clean":"2023-10-25T23:44:38.872822+0000","last_became_active":"2023-10-25T23:36:08.263842+0000","last_became_peered":"2023-10-25T23:36:08.263842+0000","last_unstale":"2023-10-25T23:44:38.872822+0000","last_undegraded":"2023-10-25T23:44:38.872822+0000","last_fullsized":"2023-10-25T23:44:38.872822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":301,"num_read_kb":4287,"num_write":520,"num_write_kb":107914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"40'2114","reported_seq":4705,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.200098+0000","last_change":"2023-10-25T23:44:38.912801+0000","last_active":"2023-10-25T23:44:41.200098+0000","last_peered":"2023-10-25T23:44:41.200098+0000","last_clean":"2023-10-25T23:44:41.200098+0000","last_became_active":"2023-10-25T23:36:09.295595+0000","last_became_peered":"2023-10-25T23:36:09.295595+0000","last_unstale":"2023-10-25T23:44:41.200098+0000","last_undegraded":"2023-10-25T23:44:41.200098+0000","last_fullsized":"2023-10-25T23:44:41.200098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2114,"log_dups_size":0,"ondisk_log_size":2114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038517528000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":3321,"num_write":1232,"num_write_kb":16686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.3","version":"36'221","reported_seq":256,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.947402+0000","last_change":"2023-10-25T23:36:08.272009+0000","last_active":"2023-10-25T23:44:37.947402+0000","last_peered":"2023-10-25T23:44:37.947402+0000","last_clean":"2023-10-25T23:44:37.947402+0000","last_became_active":"2023-10-25T23:36:08.271640+0000","last_became_peered":"2023-10-25T23:36:08.271640+0000","last_unstale":"2023-10-25T23:44:37.947402+0000","last_undegraded":"2023-10-25T23:44:37.947402+0000","last_fullsized":"2023-10-25T23:44:37.947402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:29:40.023263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":206,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.946905+0000","last_change":"2023-10-25T23:35:58.277542+0000","last_active":"2023-10-25T23:44:37.946905+0000","last_peered":"2023-10-25T23:44:37.946905+0000","last_clean":"2023-10-25T23:44:37.946905+0000","last_became_active":"2023-10-25T23:35:58.276606+0000","last_became_peered":"2023-10-25T23:35:58.276606+0000","last_unstale":"2023-10-25T23:44:37.946905+0000","last_undegraded":"2023-10-25T23:44:37.946905+0000","last_fullsized":"2023-10-25T23:44:37.946905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:35:57.197265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:35:57.197265+0000","last_clean_scrub_stamp":"2023-10-25T23:35:57.197265+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:53:55.116662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"40'1947","reported_seq":4558,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.166850+0000","last_change":"2023-10-25T23:44:39.649070+0000","last_active":"2023-10-25T23:44:41.166850+0000","last_peered":"2023-10-25T23:44:41.166850+0000","last_clean":"2023-10-25T23:44:41.166850+0000","last_became_active":"2023-10-25T23:36:09.291072+0000","last_became_peered":"2023-10-25T23:36:09.291072+0000","last_unstale":"2023-10-25T23:44:41.166850+0000","last_undegraded":"2023-10-25T23:44:41.166850+0000","last_fullsized":"2023-10-25T23:44:41.166850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1947,"log_dups_size":0,"ondisk_log_size":1947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.185957752,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":28650,"num_write":1164,"num_write_kb":22232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.0","version":"36'240","reported_seq":275,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.947008+0000","last_change":"2023-10-25T23:36:08.277937+0000","last_active":"2023-10-25T23:44:37.947008+0000","last_peered":"2023-10-25T23:44:37.947008+0000","last_clean":"2023-10-25T23:44:37.947008+0000","last_became_active":"2023-10-25T23:36:08.277663+0000","last_became_peered":"2023-10-25T23:36:08.277663+0000","last_unstale":"2023-10-25T23:44:37.947008+0000","last_undegraded":"2023-10-25T23:44:37.947008+0000","last_fullsized":"2023-10-25T23:44:37.947008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:57:04.918703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":226,"num_write_kb":82970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"38'485","reported_seq":520,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.947873+0000","last_change":"2023-10-25T23:36:08.270783+0000","last_active":"2023-10-25T23:44:37.947873+0000","last_peered":"2023-10-25T23:44:37.947873+0000","last_clean":"2023-10-25T23:44:37.947873+0000","last_became_active":"2023-10-25T23:36:08.269896+0000","last_became_peered":"2023-10-25T23:36:08.269896+0000","last_unstale":"2023-10-25T23:44:37.947873+0000","last_undegraded":"2023-10-25T23:44:37.947873+0000","last_fullsized":"2023-10-25T23:44:37.947873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:37:25.421407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":446,"num_write_kb":94912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"40'2036","reported_seq":4671,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.151625+0000","last_change":"2023-10-25T23:44:39.130825+0000","last_active":"2023-10-25T23:44:41.151625+0000","last_peered":"2023-10-25T23:44:41.151625+0000","last_clean":"2023-10-25T23:44:41.151625+0000","last_became_active":"2023-10-25T23:36:09.278967+0000","last_became_peered":"2023-10-25T23:36:09.278967+0000","last_unstale":"2023-10-25T23:44:41.151625+0000","last_undegraded":"2023-10-25T23:44:41.151625+0000","last_fullsized":"2023-10-25T23:44:41.151625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055404268,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":3903,"num_write":1243,"num_write_kb":26062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.6","version":"40'365","reported_seq":400,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:42.148578+0000","last_change":"2023-10-25T23:36:08.279363+0000","last_active":"2023-10-25T23:44:42.148578+0000","last_peered":"2023-10-25T23:44:42.148578+0000","last_clean":"2023-10-25T23:44:42.148578+0000","last_became_active":"2023-10-25T23:36:08.279082+0000","last_became_peered":"2023-10-25T23:36:08.279082+0000","last_unstale":"2023-10-25T23:44:42.148578+0000","last_undegraded":"2023-10-25T23:44:42.148578+0000","last_fullsized":"2023-10-25T23:44:42.148578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":468,"num_write_kb":81486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"40'1963","reported_seq":4572,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.182248+0000","last_change":"2023-10-25T23:44:38.913967+0000","last_active":"2023-10-25T23:44:41.182248+0000","last_peered":"2023-10-25T23:44:41.182248+0000","last_clean":"2023-10-25T23:44:41.182248+0000","last_became_active":"2023-10-25T23:36:09.289751+0000","last_became_peered":"2023-10-25T23:36:09.289751+0000","last_unstale":"2023-10-25T23:44:41.182248+0000","last_undegraded":"2023-10-25T23:44:41.182248+0000","last_fullsized":"2023-10-25T23:44:41.182248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1963,"log_dups_size":0,"ondisk_log_size":1963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039560708999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":4389,"num_write":1130,"num_write_kb":12211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.7","version":"38'408","reported_seq":442,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.947700+0000","last_change":"2023-10-25T23:36:08.274349+0000","last_active":"2023-10-25T23:44:37.947700+0000","last_peered":"2023-10-25T23:44:37.947700+0000","last_clean":"2023-10-25T23:44:37.947700+0000","last_became_active":"2023-10-25T23:36:08.273029+0000","last_became_peered":"2023-10-25T23:36:08.273029+0000","last_unstale":"2023-10-25T23:44:37.947700+0000","last_undegraded":"2023-10-25T23:44:37.947700+0000","last_fullsized":"2023-10-25T23:44:37.947700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":396,"num_write_kb":80384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"40'1994","reported_seq":4619,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.170063+0000","last_change":"2023-10-25T23:44:39.657320+0000","last_active":"2023-10-25T23:44:41.170063+0000","last_peered":"2023-10-25T23:44:41.170063+0000","last_clean":"2023-10-25T23:44:41.170063+0000","last_became_active":"2023-10-25T23:36:09.287532+0000","last_became_peered":"2023-10-25T23:36:09.287532+0000","last_unstale":"2023-10-25T23:44:41.170063+0000","last_undegraded":"2023-10-25T23:44:41.170063+0000","last_fullsized":"2023-10-25T23:44:41.170063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.194145863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":4941,"num_write":1181,"num_write_kb":9554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.8","version":"36'238","reported_seq":272,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.946807+0000","last_change":"2023-10-25T23:36:08.266963+0000","last_active":"2023-10-25T23:44:37.946807+0000","last_peered":"2023-10-25T23:44:37.946807+0000","last_clean":"2023-10-25T23:44:37.946807+0000","last_became_active":"2023-10-25T23:36:08.266648+0000","last_became_peered":"2023-10-25T23:36:08.266648+0000","last_unstale":"2023-10-25T23:44:37.946807+0000","last_undegraded":"2023-10-25T23:44:37.946807+0000","last_fullsized":"2023-10-25T23:44:37.946807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:57:31.130445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":194,"num_write_kb":95518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"40'2107","reported_seq":4728,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.159477+0000","last_change":"2023-10-25T23:44:38.947498+0000","last_active":"2023-10-25T23:44:41.159477+0000","last_peered":"2023-10-25T23:44:41.159477+0000","last_clean":"2023-10-25T23:44:41.159477+0000","last_became_active":"2023-10-25T23:36:09.284666+0000","last_became_peered":"2023-10-25T23:36:09.284666+0000","last_unstale":"2023-10-25T23:44:41.159477+0000","last_undegraded":"2023-10-25T23:44:41.159477+0000","last_fullsized":"2023-10-25T23:44:41.159477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2107,"log_dups_size":0,"ondisk_log_size":2107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:12:30.838027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.075073965000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":4417,"num_write":1270,"num_write_kb":29307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.9","version":"36'390","reported_seq":425,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.075350+0000","last_change":"2023-10-25T23:36:08.278162+0000","last_active":"2023-10-25T23:44:39.075350+0000","last_peered":"2023-10-25T23:44:39.075350+0000","last_clean":"2023-10-25T23:44:39.075350+0000","last_became_active":"2023-10-25T23:36:08.277873+0000","last_became_peered":"2023-10-25T23:36:08.277873+0000","last_unstale":"2023-10-25T23:44:39.075350+0000","last_undegraded":"2023-10-25T23:44:39.075350+0000","last_fullsized":"2023-10-25T23:44:39.075350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":385,"num_write_kb":96608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"40'2140","reported_seq":4758,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.181537+0000","last_change":"2023-10-25T23:44:38.911081+0000","last_active":"2023-10-25T23:44:41.181537+0000","last_peered":"2023-10-25T23:44:41.181537+0000","last_clean":"2023-10-25T23:44:41.181537+0000","last_became_active":"2023-10-25T23:36:09.289320+0000","last_became_peered":"2023-10-25T23:36:09.289320+0000","last_unstale":"2023-10-25T23:44:41.181537+0000","last_undegraded":"2023-10-25T23:44:41.181537+0000","last_fullsized":"2023-10-25T23:44:41.181537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2140,"log_dups_size":0,"ondisk_log_size":2140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037048923999999997,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":230,"num_read_kb":4443,"num_write":1269,"num_write_kb":26048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.a","version":"36'618","reported_seq":653,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.075935+0000","last_change":"2023-10-25T23:36:08.278921+0000","last_active":"2023-10-25T23:44:39.075935+0000","last_peered":"2023-10-25T23:44:39.075935+0000","last_clean":"2023-10-25T23:44:39.075935+0000","last_became_active":"2023-10-25T23:36:08.278656+0000","last_became_peered":"2023-10-25T23:36:08.278656+0000","last_unstale":"2023-10-25T23:44:39.075935+0000","last_undegraded":"2023-10-25T23:44:39.075935+0000","last_fullsized":"2023-10-25T23:44:39.075935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":618,"log_dups_size":0,"ondisk_log_size":618,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":598,"num_write_kb":115954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"40'2112","reported_seq":4707,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.175456+0000","last_change":"2023-10-25T23:44:38.914372+0000","last_active":"2023-10-25T23:44:41.175456+0000","last_peered":"2023-10-25T23:44:41.175456+0000","last_clean":"2023-10-25T23:44:41.175456+0000","last_became_active":"2023-10-25T23:36:09.292345+0000","last_became_peered":"2023-10-25T23:36:09.292345+0000","last_unstale":"2023-10-25T23:44:41.175456+0000","last_undegraded":"2023-10-25T23:44:41.175456+0000","last_fullsized":"2023-10-25T23:44:41.175456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2112,"log_dups_size":0,"ondisk_log_size":2112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039941503000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":8471,"num_write":1242,"num_write_kb":22974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.b","version":"38'416","reported_seq":450,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-25T23:44:37.948281+0000","last_change":"2023-10-25T23:36:08.270589+0000","last_active":"2023-10-25T23:44:37.948281+0000","last_peered":"2023-10-25T23:44:37.948281+0000","last_clean":"2023-10-25T23:44:37.948281+0000","last_became_active":"2023-10-25T23:36:08.268753+0000","last_became_peered":"2023-10-25T23:36:08.268753+0000","last_unstale":"2023-10-25T23:44:37.948281+0000","last_undegraded":"2023-10-25T23:44:37.948281+0000","last_fullsized":"2023-10-25T23:44:37.948281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:19.491102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":415,"num_write_kb":99792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"40'2029","reported_seq":4656,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.159338+0000","last_change":"2023-10-25T23:44:39.510909+0000","last_active":"2023-10-25T23:44:41.159338+0000","last_peered":"2023-10-25T23:44:41.159338+0000","last_clean":"2023-10-25T23:44:41.159338+0000","last_became_active":"2023-10-25T23:36:09.290151+0000","last_became_peered":"2023-10-25T23:36:09.290151+0000","last_unstale":"2023-10-25T23:44:41.159338+0000","last_undegraded":"2023-10-25T23:44:41.159338+0000","last_fullsized":"2023-10-25T23:44:41.159338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2029,"log_dups_size":0,"ondisk_log_size":2029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:56:59.222424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047955154,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":5633,"num_write":1198,"num_write_kb":13442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.c","version":"37'230","reported_seq":265,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:38.872988+0000","last_change":"2023-10-25T23:36:08.272161+0000","last_active":"2023-10-25T23:44:38.872988+0000","last_peered":"2023-10-25T23:44:38.872988+0000","last_clean":"2023-10-25T23:44:38.872988+0000","last_became_active":"2023-10-25T23:36:08.271846+0000","last_became_peered":"2023-10-25T23:36:08.271846+0000","last_unstale":"2023-10-25T23:44:38.872988+0000","last_undegraded":"2023-10-25T23:44:38.872988+0000","last_fullsized":"2023-10-25T23:44:38.872988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":230,"log_dups_size":0,"ondisk_log_size":230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":195,"num_write_kb":98810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"40'2031","reported_seq":4642,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.192128+0000","last_change":"2023-10-25T23:44:39.033539+0000","last_active":"2023-10-25T23:44:41.192128+0000","last_peered":"2023-10-25T23:44:41.192128+0000","last_clean":"2023-10-25T23:44:41.192128+0000","last_became_active":"2023-10-25T23:36:09.295635+0000","last_became_peered":"2023-10-25T23:36:09.295635+0000","last_unstale":"2023-10-25T23:44:41.192128+0000","last_undegraded":"2023-10-25T23:44:41.192128+0000","last_fullsized":"2023-10-25T23:44:41.192128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:46:01.376519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046467368000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":10038,"num_write":1186,"num_write_kb":32237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.d","version":"36'444","reported_seq":479,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:39.075514+0000","last_change":"2023-10-25T23:36:08.277618+0000","last_active":"2023-10-25T23:44:39.075514+0000","last_peered":"2023-10-25T23:44:39.075514+0000","last_clean":"2023-10-25T23:44:39.075514+0000","last_became_active":"2023-10-25T23:36:08.277344+0000","last_became_peered":"2023-10-25T23:36:08.277344+0000","last_unstale":"2023-10-25T23:44:39.075514+0000","last_undegraded":"2023-10-25T23:44:39.075514+0000","last_fullsized":"2023-10-25T23:44:39.075514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25170780,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":452,"num_write_kb":113081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"40'2042","reported_seq":4667,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.191144+0000","last_change":"2023-10-25T23:44:39.116670+0000","last_active":"2023-10-25T23:44:41.191144+0000","last_peered":"2023-10-25T23:44:41.191144+0000","last_clean":"2023-10-25T23:44:41.191144+0000","last_became_active":"2023-10-25T23:36:09.299234+0000","last_became_peered":"2023-10-25T23:36:09.299234+0000","last_unstale":"2023-10-25T23:44:41.191144+0000","last_undegraded":"2023-10-25T23:44:41.191144+0000","last_fullsized":"2023-10-25T23:44:41.191144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:20:26.505744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15372042599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":4213,"num_write":1231,"num_write_kb":8559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"2.e","version":"40'482","reported_seq":525,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:46.025204+0000","last_change":"2023-10-25T23:44:46.025275+0000","last_active":"2023-10-25T23:44:46.025204+0000","last_peered":"2023-10-25T23:44:46.025204+0000","last_clean":"2023-10-25T23:44:46.025204+0000","last_became_active":"2023-10-25T23:36:08.269065+0000","last_became_peered":"2023-10-25T23:36:08.269065+0000","last_unstale":"2023-10-25T23:44:46.025204+0000","last_undegraded":"2023-10-25T23:44:46.025204+0000","last_fullsized":"2023-10-25T23:44:46.025204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'482","last_scrub_stamp":"2023-10-25T23:44:46.025130+0000","last_deep_scrub":"40'482","last_deep_scrub_stamp":"2023-10-25T23:44:46.025130+0000","last_clean_scrub_stamp":"2023-10-25T23:44:46.025130+0000","objects_scrubbed":16,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:34:52.570294+0000","scrub_duration":0.049678989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":460,"num_write_kb":103224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":431890,"num_omap_keys":741,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"40'2036","reported_seq":4666,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.202656+0000","last_change":"2023-10-25T23:44:39.030671+0000","last_active":"2023-10-25T23:44:41.202656+0000","last_peered":"2023-10-25T23:44:41.202656+0000","last_clean":"2023-10-25T23:44:41.202656+0000","last_became_active":"2023-10-25T23:36:09.294494+0000","last_became_peered":"2023-10-25T23:36:09.294494+0000","last_unstale":"2023-10-25T23:44:41.202656+0000","last_undegraded":"2023-10-25T23:44:41.202656+0000","last_fullsized":"2023-10-25T23:44:41.202656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:13:10.218471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043914717999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":9037,"num_write":1232,"num_write_kb":21545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.20","version":"40'2057","reported_seq":4701,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.177964+0000","last_change":"2023-10-25T23:44:39.510985+0000","last_active":"2023-10-25T23:44:41.177964+0000","last_peered":"2023-10-25T23:44:41.177964+0000","last_clean":"2023-10-25T23:44:41.177964+0000","last_became_active":"2023-10-25T23:36:09.291665+0000","last_became_peered":"2023-10-25T23:36:09.291665+0000","last_unstale":"2023-10-25T23:44:41.177964+0000","last_undegraded":"2023-10-25T23:44:41.177964+0000","last_fullsized":"2023-10-25T23:44:41.177964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2057,"log_dups_size":0,"ondisk_log_size":2057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:23:16.256254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048033508000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":23343,"num_write":1242,"num_write_kb":29102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.21","version":"40'2179","reported_seq":4784,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.190779+0000","last_change":"2023-10-25T23:44:38.911392+0000","last_active":"2023-10-25T23:44:41.190779+0000","last_peered":"2023-10-25T23:44:41.190779+0000","last_clean":"2023-10-25T23:44:41.190779+0000","last_became_active":"2023-10-25T23:36:09.295817+0000","last_became_peered":"2023-10-25T23:36:09.295817+0000","last_unstale":"2023-10-25T23:44:41.190779+0000","last_undegraded":"2023-10-25T23:44:41.190779+0000","last_fullsized":"2023-10-25T23:44:41.190779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2179,"log_dups_size":0,"ondisk_log_size":2179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038422899000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":12397,"num_write":1283,"num_write_kb":33443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.22","version":"40'2078","reported_seq":4693,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.196817+0000","last_change":"2023-10-25T23:44:39.109561+0000","last_active":"2023-10-25T23:44:41.196817+0000","last_peered":"2023-10-25T23:44:41.196817+0000","last_clean":"2023-10-25T23:44:41.196817+0000","last_became_active":"2023-10-25T23:36:09.299024+0000","last_became_peered":"2023-10-25T23:36:09.299024+0000","last_unstale":"2023-10-25T23:44:41.196817+0000","last_undegraded":"2023-10-25T23:44:41.196817+0000","last_fullsized":"2023-10-25T23:44:41.196817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2078,"log_dups_size":0,"ondisk_log_size":2078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:09:03.392402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14682810099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":4357,"num_write":1220,"num_write_kb":7384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.23","version":"40'2239","reported_seq":4814,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.174300+0000","last_change":"2023-10-25T23:44:39.676541+0000","last_active":"2023-10-25T23:44:41.174300+0000","last_peered":"2023-10-25T23:44:41.174300+0000","last_clean":"2023-10-25T23:44:41.174300+0000","last_became_active":"2023-10-25T23:36:09.292344+0000","last_became_peered":"2023-10-25T23:36:09.292344+0000","last_unstale":"2023-10-25T23:44:41.174300+0000","last_undegraded":"2023-10-25T23:44:41.174300+0000","last_fullsized":"2023-10-25T23:44:41.174300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2239,"log_dups_size":0,"ondisk_log_size":2239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21297281000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":3547,"num_write":1298,"num_write_kb":27693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.24","version":"40'2020","reported_seq":4622,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.155161+0000","last_change":"2023-10-25T23:44:38.915453+0000","last_active":"2023-10-25T23:44:41.155161+0000","last_peered":"2023-10-25T23:44:41.155161+0000","last_clean":"2023-10-25T23:44:41.155161+0000","last_became_active":"2023-10-25T23:36:09.297202+0000","last_became_peered":"2023-10-25T23:36:09.297202+0000","last_unstale":"2023-10-25T23:44:41.155161+0000","last_undegraded":"2023-10-25T23:44:41.155161+0000","last_fullsized":"2023-10-25T23:44:41.155161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2020,"log_dups_size":0,"ondisk_log_size":2020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040736076000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":7838,"num_write":1164,"num_write_kb":15586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.25","version":"40'2026","reported_seq":4734,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.158108+0000","last_change":"2023-10-25T23:44:39.127944+0000","last_active":"2023-10-25T23:44:41.158108+0000","last_peered":"2023-10-25T23:44:41.158108+0000","last_clean":"2023-10-25T23:44:41.158108+0000","last_became_active":"2023-10-25T23:36:09.293157+0000","last_became_peered":"2023-10-25T23:36:09.293157+0000","last_unstale":"2023-10-25T23:44:41.158108+0000","last_undegraded":"2023-10-25T23:44:41.158108+0000","last_fullsized":"2023-10-25T23:44:41.158108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052457090999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":301,"num_read_kb":22462,"num_write":1198,"num_write_kb":27011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.26","version":"40'2171","reported_seq":4772,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.190039+0000","last_change":"2023-10-25T23:44:39.519493+0000","last_active":"2023-10-25T23:44:41.190039+0000","last_peered":"2023-10-25T23:44:41.190039+0000","last_clean":"2023-10-25T23:44:41.190039+0000","last_became_active":"2023-10-25T23:36:09.288127+0000","last_became_peered":"2023-10-25T23:36:09.288127+0000","last_unstale":"2023-10-25T23:44:41.190039+0000","last_undegraded":"2023-10-25T23:44:41.190039+0000","last_fullsized":"2023-10-25T23:44:41.190039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2171,"log_dups_size":0,"ondisk_log_size":2171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:13:42.350798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055712415000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":4655,"num_write":1304,"num_write_kb":14899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.27","version":"40'1998","reported_seq":4626,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.154769+0000","last_change":"2023-10-25T23:44:38.912556+0000","last_active":"2023-10-25T23:44:41.154769+0000","last_peered":"2023-10-25T23:44:41.154769+0000","last_clean":"2023-10-25T23:44:41.154769+0000","last_became_active":"2023-10-25T23:36:09.290160+0000","last_became_peered":"2023-10-25T23:36:09.290160+0000","last_unstale":"2023-10-25T23:44:41.154769+0000","last_undegraded":"2023-10-25T23:44:41.154769+0000","last_fullsized":"2023-10-25T23:44:41.154769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1998,"log_dups_size":0,"ondisk_log_size":1998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038380149000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":16054,"num_write":1171,"num_write_kb":30881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.28","version":"40'2015","reported_seq":4644,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.201887+0000","last_change":"2023-10-25T23:44:39.123926+0000","last_active":"2023-10-25T23:44:41.201887+0000","last_peered":"2023-10-25T23:44:41.201887+0000","last_clean":"2023-10-25T23:44:41.201887+0000","last_became_active":"2023-10-25T23:36:09.298637+0000","last_became_peered":"2023-10-25T23:36:09.298637+0000","last_unstale":"2023-10-25T23:44:41.201887+0000","last_undegraded":"2023-10-25T23:44:41.201887+0000","last_fullsized":"2023-10-25T23:44:41.201887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:36:46.829771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16094475499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":3413,"num_write":1198,"num_write_kb":11362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.29","version":"40'1990","reported_seq":4624,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.166495+0000","last_change":"2023-10-25T23:44:38.916920+0000","last_active":"2023-10-25T23:44:41.166495+0000","last_peered":"2023-10-25T23:44:41.166495+0000","last_clean":"2023-10-25T23:44:41.166495+0000","last_became_active":"2023-10-25T23:36:09.290546+0000","last_became_peered":"2023-10-25T23:36:09.290546+0000","last_unstale":"2023-10-25T23:44:41.166495+0000","last_undegraded":"2023-10-25T23:44:41.166495+0000","last_fullsized":"2023-10-25T23:44:41.166495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1990,"log_dups_size":0,"ondisk_log_size":1990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041791974000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":7180,"num_write":1206,"num_write_kb":23829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.2a","version":"40'2170","reported_seq":4753,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.181120+0000","last_change":"2023-10-25T23:44:39.133956+0000","last_active":"2023-10-25T23:44:41.181120+0000","last_peered":"2023-10-25T23:44:41.181120+0000","last_clean":"2023-10-25T23:44:41.181120+0000","last_became_active":"2023-10-25T23:36:50.102780+0000","last_became_peered":"2023-10-25T23:36:50.102780+0000","last_unstale":"2023-10-25T23:44:41.181120+0000","last_undegraded":"2023-10-25T23:44:41.181120+0000","last_fullsized":"2023-10-25T23:44:41.181120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2170,"log_dups_size":0,"ondisk_log_size":2170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058087943000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":4977,"num_write":1244,"num_write_kb":20718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.2b","version":"40'2082","reported_seq":4699,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.188681+0000","last_change":"2023-10-25T23:44:39.657317+0000","last_active":"2023-10-25T23:44:41.188681+0000","last_peered":"2023-10-25T23:44:41.188681+0000","last_clean":"2023-10-25T23:44:41.188681+0000","last_became_active":"2023-10-25T23:36:09.285610+0000","last_became_peered":"2023-10-25T23:36:09.285610+0000","last_unstale":"2023-10-25T23:44:41.188681+0000","last_undegraded":"2023-10-25T23:44:41.188681+0000","last_fullsized":"2023-10-25T23:44:41.188681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2082,"log_dups_size":0,"ondisk_log_size":2082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19375678499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":4129,"num_write":1211,"num_write_kb":11664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2ae","length":"4"}]},{"pgid":"3.2c","version":"40'2134","reported_seq":4754,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:41.158969+0000","last_change":"2023-10-25T23:44:39.516069+0000","last_active":"2023-10-25T23:44:41.158969+0000","last_peered":"2023-10-25T23:44:41.158969+0000","last_clean":"2023-10-25T23:44:41.158969+0000","last_became_active":"2023-10-25T23:36:09.291566+0000","last_became_peered":"2023-10-25T23:36:09.291566+0000","last_unstale":"2023-10-25T23:44:41.158969+0000","last_undegraded":"2023-10-25T23:44:41.158969+0000","last_fullsized":"2023-10-25T23:44:41.158969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2134,"log_dups_size":0,"ondisk_log_size":2134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:05:10.561911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052820837000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":9012,"num_write":1282,"num_write_kb":25857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2ae","length":"4"}]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":13919,"num_read_kb":527624,"num_write":78511,"num_write_kb":1459527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":40,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133209,"ondisk_log_size":133209,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":885258527,"num_objects":563,"num_object_clones":0,"num_object_copies":1126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":563,"num_whiteouts":0,"num_read":739,"num_read_kb":4869,"num_write":13291,"num_write_kb":3083354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":344,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3988246,"num_omap_keys":6992,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1770577920,"data_stored":1770517054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13775,"ondisk_log_size":13775,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574959,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":431188,"kb_used_data":295948,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":93940652,"statfs":{"total":96636764160,"available":96195227648,"internally_reserved":0,"allocated":303050752,"data_stored":302778778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":138475979},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.72999999999999998,"15min":0.59599999999999997},"min":{"1min":0.26800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.67100000000000004,"5min":34.116999999999997,"15min":34.116999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.50600000000000001},"min":{"1min":0.317,"5min":0.222,"15min":0.222},"max":{"1min":0.73899999999999999,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.56499999999999995}]},{"osd":1,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.76400000000000001,"15min":0.61399999999999999},"min":{"1min":0.29599999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65200000000000002,"5min":34.424999999999997,"15min":34.424999999999997},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.77300000000000002,"15min":0.62},"min":{"1min":0.35099999999999998,"5min":0.29599999999999999,"15min":0.28100000000000003},"max":{"1min":0.79900000000000004,"5min":32.781999999999996,"15min":32.781999999999996},"last":0.61299999999999999}]},{"osd":2,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48499999999999999,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60599999999999998,"5min":1.964,"15min":1.964},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.79200000000000004,"15min":0.63900000000000001},"min":{"1min":0.34399999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76600000000000001,"5min":34.066000000000003,"15min":34.066000000000003},"last":0.55300000000000005}]},{"osd":3,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.94899999999999995,"15min":0.68400000000000005},"min":{"1min":0.40699999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.622,"5min":50.606999999999999,"15min":50.606999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.89900000000000002,"15min":0.68899999999999995},"min":{"1min":0.41199999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.89200000000000002,"5min":41.027999999999999,"15min":41.027999999999999},"last":0.59799999999999998}]},{"osd":4,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.72999999999999998,"15min":0.55500000000000005},"min":{"1min":0.33400000000000002,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.82499999999999996,"5min":28,"15min":28},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.76000000000000001,"15min":0.59799999999999998},"min":{"1min":0.46899999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.177,"5min":28.25,"15min":28.25},"last":0.41099999999999998}]},{"osd":5,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.84499999999999997,"15min":0.63400000000000001},"min":{"1min":0.437,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.79200000000000004,"5min":34.393000000000001,"15min":34.393000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64200000000000002,"15min":0.58299999999999996},"min":{"1min":0.40500000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84499999999999997,"5min":10.099,"15min":10.099},"last":0.52000000000000002}]},{"osd":6,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.72999999999999998,"15min":0.621},"min":{"1min":0.45100000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.97999999999999998,"5min":18.271999999999998,"15min":18.271999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.98599999999999999,"15min":0.71599999999999997},"min":{"1min":0.53200000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.369,"5min":47.531999999999996,"15min":47.531999999999996},"last":0.495}]}]},{"osd":6,"up_from":13,"seq":55834574957,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":358084,"kb_used_data":246460,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94013756,"statfs":{"total":96636764160,"available":96270086144,"internally_reserved":0,"allocated":252375040,"data_stored":252110864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":114293191},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45000000000000001,"15min":0.51200000000000001},"min":{"1min":0.26400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.623,"5min":3.3140000000000001,"15min":3.3140000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.35499999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56599999999999995,"5min":11.619,"15min":11.619},"last":0.495}]},{"osd":1,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.5,"15min":0.53600000000000003},"min":{"1min":0.27500000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68899999999999995,"5min":3.468,"15min":3.468},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.56000000000000005},"min":{"1min":0.30599999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.64600000000000002,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.56299999999999994}]},{"osd":2,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.61199999999999999,"15min":0.57399999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":6.327,"5min":11.683999999999999,"15min":11.683999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.58899999999999997,"15min":0.55800000000000005},"min":{"1min":0.32800000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81399999999999995,"5min":11.784000000000001,"15min":11.784000000000001},"last":0.39900000000000002}]},{"osd":3,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":1.071,"15min":0.77300000000000002},"min":{"1min":0.33900000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84499999999999997,"5min":61.121000000000002,"15min":61.121000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.36499999999999999},"max":{"1min":0.80000000000000004,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.432}]},{"osd":4,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60299999999999998,"15min":0.54400000000000004},"min":{"1min":0.35099999999999998,"5min":0.27600000000000002,"15min":0.23200000000000001},"max":{"1min":0.91900000000000004,"5min":12.169,"15min":12.169},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.623,"15min":0.57699999999999996},"min":{"1min":0.44700000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85699999999999998,"5min":11.554,"15min":11.554},"last":0.46300000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.62,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.26100000000000001,"15min":0.245},"max":{"1min":0.77600000000000002,"5min":11.755000000000001,"15min":11.755000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.40300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.89000000000000001,"5min":3.2879999999999998,"15min":3.2879999999999998},"last":0.59499999999999997}]},{"osd":7,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.96099999999999997,"15min":0.71599999999999997},"min":{"1min":0.48099999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89500000000000002,"5min":29.977,"15min":29.977},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.97299999999999998,"15min":0.71599999999999997},"min":{"1min":0.42399999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.874,"5min":29.925000000000001,"15min":29.925000000000001},"last":0.55100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361872,"kb_used_data":254408,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94009968,"statfs":{"total":96636764160,"available":96266207232,"internally_reserved":0,"allocated":260513792,"data_stored":260249824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.378,"15min":0.36699999999999999},"min":{"1min":0.17799999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.44600000000000001,"5min":4.2839999999999998,"15min":6.9370000000000003},"last":0.374},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.94999999999999996,"15min":0.54900000000000004},"min":{"1min":0.22,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.48199999999999998,"5min":66.522000000000006,"15min":66.522000000000006},"last":0.29299999999999998}]},{"osd":2,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35299999999999998,"15min":0.34799999999999998},"min":{"1min":0.23999999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53200000000000003,"5min":4.9180000000000001,"15min":4.9180000000000001},"last":0.315},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41199999999999998,"15min":0.39000000000000001},"min":{"1min":0.247,"5min":0.186,"15min":0.186},"max":{"1min":0.54900000000000004,"5min":4.2060000000000004,"15min":4.2060000000000004},"last":0.39300000000000002}]},{"osd":3,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.60399999999999998,"15min":0.46800000000000003},"min":{"1min":0.26900000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.56999999999999995,"5min":21.943000000000001,"15min":21.943000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.379,"5min":0.60199999999999998,"15min":0.47699999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.55800000000000005,"5min":23.300999999999998,"15min":23.300999999999998},"last":0.33300000000000002}]},{"osd":4,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.67700000000000005,"15min":0.57899999999999996},"min":{"1min":0.35099999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.94999999999999996,"5min":14.066000000000001,"15min":14.066000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.622,"15min":0.58199999999999996},"min":{"1min":0.44,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.89700000000000002,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":0.57999999999999996}]},{"osd":5,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.33300000000000002},"max":{"1min":0.90500000000000003,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.39700000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82499999999999996,"5min":4.9960000000000004,"15min":9.7650000000000006},"last":0.70399999999999996}]},{"osd":6,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64600000000000002,"15min":0.60799999999999998},"min":{"1min":0.46999999999999997,"5min":0.313,"15min":0.313},"max":{"1min":0.83699999999999997,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.78200000000000003,"15min":0.65100000000000002},"min":{"1min":0.438,"5min":0.38400000000000001,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":21.876000000000001,"15min":21.876000000000001},"last":0.68899999999999995}]},{"osd":7,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93200000000000005,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.76100000000000001,"15min":0.65200000000000002},"min":{"1min":0.44,"5min":0.371,"15min":0.36399999999999999},"max":{"1min":1.6850000000000001,"5min":18.754999999999999,"15min":18.754999999999999},"last":0.746}]}]},{"osd":0,"up_from":13,"seq":55834574958,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":373968,"kb_used_data":230408,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":93997872,"statfs":{"total":96636764160,"available":96253820928,"internally_reserved":0,"allocated":235937792,"data_stored":235669955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.375,"15min":0.35899999999999999},"min":{"1min":0.26900000000000002,"5min":0.20200000000000001,"15min":0.17899999999999999},"max":{"1min":1.365,"5min":4.649,"15min":4.649},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39000000000000001,"15min":0.36399999999999999},"min":{"1min":0.23699999999999999,"5min":0.20499999999999999,"15min":0.19400000000000001},"max":{"1min":1.641,"5min":5.1589999999999998,"15min":5.1589999999999998},"last":0.38700000000000001}]},{"osd":2,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38200000000000001},"min":{"1min":0.23699999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.423,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.42899999999999999,"15min":0.40600000000000003},"min":{"1min":0.251,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53700000000000003,"5min":7.6870000000000003,"15min":7.6870000000000003},"last":0.34200000000000003}]},{"osd":3,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.435,"15min":0.39300000000000002},"min":{"1min":0.28000000000000003,"5min":0.23999999999999999,"15min":0.23899999999999999},"max":{"1min":2.0819999999999999,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.47299999999999998,"15min":0.442},"min":{"1min":0.313,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.954,"5min":5.0750000000000002,"15min":5.0750000000000002},"last":0.433}]},{"osd":4,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.58099999999999996},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67100000000000004,"5min":5.9729999999999999,"15min":5.9729999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.62,"15min":0.58799999999999997},"min":{"1min":0.35299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.3769999999999998,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.53800000000000003}]},{"osd":5,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63400000000000001,"15min":0.63200000000000001},"min":{"1min":0.438,"5min":0.375,"15min":0.32300000000000001},"max":{"1min":1.3939999999999999,"5min":5.1120000000000001,"15min":8.5169999999999995},"last":0.62},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65000000000000002,"15min":0.60399999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.84199999999999997,"5min":6.0199999999999996,"15min":6.0199999999999996},"last":0.64800000000000002}]},{"osd":6,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.624,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.4369999999999998,"5min":4.9850000000000003,"15min":4.9850000000000003},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.32200000000000001},"max":{"1min":1.4510000000000001,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.58199999999999996}]},{"osd":7,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66200000000000003,"15min":0.66300000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84899999999999998,"5min":6.0720000000000001,"15min":8.4979999999999993},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.65100000000000002,"15min":0.60699999999999998},"min":{"1min":0.47499999999999998,"5min":0.374,"15min":0.374},"max":{"1min":2.411,"5min":4.883,"15min":4.883},"last":0.59799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188100,"kb_used_data":102840,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94183740,"statfs":{"total":96636764160,"available":96444149760,"internally_reserved":0,"allocated":105308160,"data_stored":105055525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.32600000000000001,"15min":0.82799999999999996},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.79600000000000004,"5min":2.7269999999999999,"15min":18.052},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.371},"min":{"1min":0.222,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.0389999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.33400000000000002}]},{"osd":1,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33900000000000002,"15min":0.85199999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.82899999999999996,"5min":1.03,"15min":18.175000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.64500000000000002},"min":{"1min":0.251,"5min":0.22900000000000001,"15min":0.22700000000000001},"max":{"1min":0.49299999999999999,"5min":0.50800000000000001,"15min":10.23},"last":0.39100000000000001}]},{"osd":3,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.35999999999999999,"15min":0.89200000000000002},"min":{"1min":0.24099999999999999,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":0.84699999999999998,"5min":0.97999999999999998,"15min":18.236000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.42499999999999999,"15min":0.92300000000000004},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":18.004999999999999},"last":0.37}]},{"osd":4,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54600000000000004,"15min":0.76900000000000002},"min":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.32100000000000001},"max":{"1min":0.75700000000000001,"5min":1.2589999999999999,"15min":8.1839999999999993},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55500000000000005,"15min":0.58499999999999996},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.518,"5min":1.518,"15min":2.4580000000000002},"last":0.63700000000000001}]},{"osd":5,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54200000000000004,"15min":0.58799999999999997},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.31900000000000001},"max":{"1min":0.80200000000000005,"5min":0.85099999999999998,"15min":8.3520000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":1.075},"min":{"1min":0.38300000000000001,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.81100000000000005,"5min":1.4419999999999999,"15min":18.143999999999998},"last":0.56200000000000006}]},{"osd":6,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":1.1000000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.316},"max":{"1min":0.78100000000000003,"5min":1.012,"15min":18.206},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.77600000000000002},"min":{"1min":0.44,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86899999999999999,"5min":1.3240000000000001,"15min":7.0060000000000002},"last":0.65100000000000002}]},{"osd":7,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.84799999999999998,"5min":0.88100000000000001,"15min":2.3900000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68700000000000006,"15min":1.145},"min":{"1min":0.41799999999999998,"5min":0.40500000000000003,"15min":0.39500000000000002},"max":{"1min":2.0339999999999998,"5min":7.9850000000000003,"15min":18.109999999999999},"last":0.58499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574959,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314172,"kb_used_data":184500,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94057668,"statfs":{"total":96636764160,"available":96315052032,"internally_reserved":0,"allocated":188928000,"data_stored":188651037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":132774344},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.435,"15min":0.376},"min":{"1min":0.23999999999999999,"5min":0.17899999999999999,"15min":0.17799999999999999},"max":{"1min":0.65400000000000003,"5min":5.9560000000000004,"15min":5.9560000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.89400000000000002,"15min":0.54200000000000004},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.65400000000000003,"5min":55.152999999999999,"15min":55.152999999999999},"last":0.33200000000000002}]},{"osd":1,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.36599999999999999},"min":{"1min":0.217,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.294,"5min":2.323,"15min":2.323},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.52200000000000002,"15min":0.438},"min":{"1min":0.33800000000000002,"5min":0.245,"15min":0.24399999999999999},"max":{"1min":0.624,"5min":6.0609999999999999,"15min":6.0609999999999999},"last":0.38100000000000001}]},{"osd":2,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.46500000000000002,"15min":0.44},"min":{"1min":0.31900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59999999999999998,"5min":4.6840000000000002,"15min":4.6840000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.83699999999999997,"15min":0.55100000000000005},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.3260000000000001,"5min":40.789000000000001,"15min":40.789000000000001},"last":0.39400000000000002}]},{"osd":4,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.1319999999999999,"15min":0.77700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33000000000000002},"max":{"1min":1.1719999999999999,"5min":58.180999999999997,"15min":58.180999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.629,"15min":0.58199999999999996},"min":{"1min":0.39200000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.94799999999999995,"5min":4.6509999999999998,"15min":4.6509999999999998},"last":0.79600000000000004}]},{"osd":5,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":1.1990000000000001,"15min":0.80000000000000004},"min":{"1min":0.38500000000000001,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":1.21,"5min":60.893999999999998,"15min":60.893999999999998},"last":0.746},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66800000000000004,"15min":0.61299999999999999},"min":{"1min":0.43099999999999999,"5min":0.38300000000000001,"15min":0.378},"max":{"1min":1.3540000000000001,"5min":4.2489999999999997,"15min":4.2489999999999997},"last":0.63800000000000001}]},{"osd":6,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.385,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.62},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.71399999999999997,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.91800000000000004,"5min":6.1790000000000003,"15min":6.1790000000000003},"last":0.75700000000000001}]},{"osd":7,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.98699999999999999,"15min":0.74299999999999999},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88,"5min":33.006999999999998,"15min":33.006999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":1.175,"15min":0.80600000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":1.2509999999999999,"5min":56.667999999999999,"15min":56.667999999999999},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574958,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326544,"kb_used_data":209352,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94045296,"statfs":{"total":96636764160,"available":96302383104,"internally_reserved":0,"allocated":214376448,"data_stored":214112441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.495,"15min":0.89600000000000002},"min":{"1min":0.28799999999999998,"5min":0.26300000000000001,"15min":0.23999999999999999},"max":{"1min":3.0310000000000001,"5min":3.306,"15min":32.487000000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45300000000000001,"15min":0.51300000000000001},"min":{"1min":0.24399999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.65500000000000003,"5min":1.05,"15min":6.0670000000000002},"last":0.36199999999999999}]},{"osd":1,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.73399999999999999,"15min":0.71499999999999997},"min":{"1min":0.27400000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.66800000000000004,"5min":23.579000000000001,"15min":32.417000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.83099999999999996,"15min":0.96399999999999997},"min":{"1min":0.33100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.70399999999999996,"5min":22.800000000000001,"15min":22.800000000000001},"last":0.38600000000000001}]},{"osd":2,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.60199999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":0.745,"5min":2.6779999999999999,"15min":14.757999999999999},"last":0.502},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.72199999999999998,"15min":0.65900000000000003},"min":{"1min":0.35299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.72399999999999998,"5min":18.042999999999999,"15min":18.042999999999999},"last":0.42599999999999999}]},{"osd":3,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57699999999999996,"15min":0.73399999999999999},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66900000000000004,"5min":6.1360000000000001,"15min":55.222000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57399999999999995,"15min":0.64000000000000001},"min":{"1min":0.39100000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80600000000000005,"5min":6.3220000000000001,"15min":14.869999999999999},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.50800000000000001,"15min":0.56899999999999995},"min":{"1min":0.33300000000000002,"5min":0.26600000000000001,"15min":0.23699999999999999},"max":{"1min":0.77500000000000002,"5min":1.466,"15min":6.508},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.62},"min":{"1min":0.40799999999999997,"5min":0.26500000000000001,"15min":0.24199999999999999},"max":{"1min":0.72899999999999998,"5min":2.403,"15min":6.5270000000000001},"last":0.48399999999999999}]},{"osd":6,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.497,"15min":0.60399999999999998},"min":{"1min":0.36699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83599999999999997,"5min":0.89100000000000001,"15min":14.805999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.52000000000000002,"15min":0.58799999999999997},"min":{"1min":0.45600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45400000000000001}]},{"osd":7,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.67600000000000005,"15min":0.63500000000000001},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.79100000000000004,"5min":12.135999999999999,"15min":12.135999999999999},"last":0.437},{"interface":"front","average":{"1min":0.63,"5min":0.81299999999999994,"15min":0.74099999999999999},"min":{"1min":0.45700000000000002,"5min":0.33300000000000002,"15min":0.29699999999999999},"max":{"1min":0.86199999999999999,"5min":21.465,"15min":21.465},"last":0.442}]}]},{"osd":5,"up_from":13,"seq":55834574959,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339548,"kb_used_data":209876,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94032292,"statfs":{"total":96636764160,"available":96289067008,"internally_reserved":0,"allocated":214913024,"data_stored":214652806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132774342},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.88900000000000001,"15min":0.65900000000000003},"min":{"1min":0.30499999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.63600000000000001,"5min":48.045999999999999,"15min":48.045999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48599999999999999,"15min":0.52400000000000002},"min":{"1min":0.28899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60199999999999998,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.47999999999999998}]},{"osd":1,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65100000000000002,"5min":3.8959999999999999,"15min":3.8959999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.501,"5min":0.47499999999999998,"15min":0.54900000000000004},"min":{"1min":0.28999999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.755},"last":0.52900000000000003}]},{"osd":2,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.58499999999999996,"15min":0.56399999999999995},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59199999999999997,"5min":13.271000000000001,"15min":13.271000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.35899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63500000000000001,"5min":7.141,"15min":7.141},"last":0.46100000000000002}]},{"osd":3,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.93000000000000005,"15min":0.68999999999999995},"min":{"1min":0.33600000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.78200000000000003,"5min":47.875999999999998,"15min":47.875999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.66500000000000004,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.495}]},{"osd":4,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51300000000000001,"15min":0.498},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66700000000000004,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.38200000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.74199999999999999,"5min":2.657,"15min":2.657},"last":0.51800000000000002}]},{"osd":6,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57699999999999996,"15min":0.54100000000000004},"min":{"1min":0.374,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82299999999999995,"5min":6.9050000000000002,"15min":6.9050000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59199999999999997,"15min":0.55400000000000005},"min":{"1min":0.442,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70699999999999996,"5min":5.9770000000000003,"15min":5.9770000000000003},"last":0.54400000000000004}]},{"osd":7,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56899999999999995,"15min":0.55800000000000005},"min":{"1min":0.44700000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80200000000000005,"5min":3.8530000000000002,"15min":3.8530000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.49399999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76700000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":234893312,"data_stored":234881662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":260059136,"data_stored":260051894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":104857600,"data_stored":104857600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":188461056,"data_stored":188453092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":213925888,"data_stored":213914516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":214462464,"data_stored":214454881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":251924480,"data_stored":251912939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":301993984,"data_stored":301990470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":20,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":15,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-25T23:44:48.330 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.330 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.331 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.331 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.331 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.332 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.332 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.333 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.333 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.333 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.334 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.334 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.335 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.335 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.336 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.336 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.336 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.337 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.337 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.338 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.338 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.338 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.339 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.339 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.340 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.340 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.340 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.341 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.341 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.342 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.342 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.343 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.343 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.343 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.344 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.344 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.345 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.345 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.345 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.346 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.346 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.347 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.347 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.348 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.348 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.348 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.349 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.349 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.350 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.350 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.350 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.351 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.351 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.352 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.352 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.353 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.353 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.353 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.354 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.354 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-25T23:35:57.197265+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=35, tm_sec=57, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.355 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.355 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.355 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.356 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.356 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.357 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.357 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.358 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.358 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.358 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.359 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.359 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.360 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.360 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.360 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.361 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.361 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.362 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.362 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.363 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.363 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.363 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.364 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.364 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.365 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.365 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.366 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.366 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.366 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.367 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.367 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.368 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.368 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.369 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:44:48.369 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-25T23:45:08.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T23:45:08.518 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.516+0000 7fe99bddf700 1 -- 172.21.15.81:0/3756214113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe99414bd10 msgr2=0x7fe99406dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:08.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.516+0000 7fe99bddf700 1 --2- 172.21.15.81:0/3756214113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe99414bd10 0x7fe99406dff0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe994072940 tx=0x7fe990009c70 comp rx=0 tx=0).stop 2023-10-25T23:45:08.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.516+0000 7fe99bddf700 1 -- 172.21.15.81:0/3756214113 shutdown_connections 2023-10-25T23:45:08.519 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.516+0000 7fe99bddf700 1 --2- 172.21.15.81:0/3756214113 >> v2:172.21.15.89:3300/0 conn(0x7fe99406d060 0x7fe9940b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:08.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.516+0000 7fe99bddf700 1 --2- 172.21.15.81:0/3756214113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe99414bd10 0x7fe99406dff0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:08.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.516+0000 7fe99bddf700 1 -- 172.21.15.81:0/3756214113 >> 172.21.15.81:0/3756214113 conn(0x7fe9940c0ab0 msgr2=0x7fe9940c0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:08.520 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.516+0000 7fe99bddf700 1 -- 172.21.15.81:0/3756214113 shutdown_connections 2023-10-25T23:45:08.521 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.516+0000 7fe99bddf700 1 -- 172.21.15.81:0/3756214113 wait complete. 2023-10-25T23:45:08.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.518+0000 7fe99bddf700 1 Processor -- start 2023-10-25T23:45:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.518+0000 7fe99bddf700 1 -- start start 2023-10-25T23:45:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe99bddf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe99406d060 0x7fe9941e4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe99bddf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe994145040 0x7fe9941d7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:08.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe99bddf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe99414bd10 0x7fe9941d6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:08.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe99bddf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99412cbe0 con 0x7fe99406d060 2023-10-25T23:45:08.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe99bddf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99414b080 con 0x7fe994145040 2023-10-25T23:45:08.525 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe99bddf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9941e5320 con 0x7fe99414bd10 2023-10-25T23:45:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe999b7b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe99406d060 0x7fe9941e4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe999b7b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe99406d060 0x7fe9941e4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37384/0 (socket says 172.21.15.81:37384) 2023-10-25T23:45:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe999b7b700 1 -- 172.21.15.81:0/3971714584 learned_addr learned my addr 172.21.15.81:0/3971714584 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:45:08.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe99937a700 1 --2- 172.21.15.81:0/3971714584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe994145040 0x7fe9941d7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:08.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe999b7b700 1 -- 172.21.15.81:0/3971714584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe99414bd10 msgr2=0x7fe9941d6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:08.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe999b7b700 1 --2- 172.21.15.81:0/3971714584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe99414bd10 0x7fe9941d6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:08.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe999b7b700 1 -- 172.21.15.81:0/3971714584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe994145040 msgr2=0x7fe9941d7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:08.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe999b7b700 1 --2- 172.21.15.81:0/3971714584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe994145040 0x7fe9941d7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:08.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe999b7b700 1 -- 172.21.15.81:0/3971714584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9900095f0 con 0x7fe99406d060 2023-10-25T23:45:08.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe999b7b700 1 --2- 172.21.15.81:0/3971714584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe99406d060 0x7fe9941e4de0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe98400e9f0 tx=0x7fe98400edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:08.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe98a7fc700 1 -- 172.21.15.81:0/3971714584 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98400cbd0 con 0x7fe99406d060 2023-10-25T23:45:08.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe98a7fc700 1 -- 172.21.15.81:0/3971714584 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe98400ce20 con 0x7fe99406d060 2023-10-25T23:45:08.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe98a7fc700 1 -- 172.21.15.81:0/3971714584 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984010690 con 0x7fe99406d060 2023-10-25T23:45:08.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe99bddf700 1 -- 172.21.15.81:0/3971714584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe994149f70 con 0x7fe99406d060 2023-10-25T23:45:08.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.519+0000 7fe99bddf700 1 -- 172.21.15.81:0/3971714584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9941d8370 con 0x7fe99406d060 2023-10-25T23:45:08.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.520+0000 7fe99bddf700 1 -- 172.21.15.81:0/3971714584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99404e4c0 con 0x7fe99406d060 2023-10-25T23:45:08.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.521+0000 7fe98a7fc700 1 -- 172.21.15.81:0/3971714584 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe9840107f0 con 0x7fe99406d060 2023-10-25T23:45:08.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.521+0000 7fe98a7fc700 1 --2- 172.21.15.81:0/3971714584 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe97806aed0 0x7fe97806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:08.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.521+0000 7fe98a7fc700 1 -- 172.21.15.81:0/3971714584 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fe984014070 con 0x7fe99406d060 2023-10-25T23:45:08.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.521+0000 7fe99937a700 1 --2- 172.21.15.81:0/3971714584 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe97806aed0 0x7fe97806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:08.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.522+0000 7fe99937a700 1 --2- 172.21.15.81:0/3971714584 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe97806aed0 0x7fe97806d390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe9940b53e0 tx=0x7fe9900047c0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:08.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.525+0000 7fe98a7fc700 1 -- 172.21.15.81:0/3971714584 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe984051ca0 con 0x7fe99406d060 2023-10-25T23:45:08.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.712+0000 7fe99bddf700 1 -- 172.21.15.81:0/3971714584 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe9940b54b0 con 0x7fe97806aed0 2023-10-25T23:45:08.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.721+0000 7fe98a7fc700 1 -- 172.21.15.81:0/3971714584 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+292409 (secure 0 0 0) 0x7fe99001d040 con 0x7fe97806aed0 2023-10-25T23:45:08.729 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:45:08.732 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.724+0000 7fe99bddf700 1 -- 172.21.15.81:0/3971714584 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe97806aed0 msgr2=0x7fe97806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:08.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.724+0000 7fe99bddf700 1 --2- 172.21.15.81:0/3971714584 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe97806aed0 0x7fe97806d390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe9940b53e0 tx=0x7fe9900047c0 comp rx=0 tx=0).stop 2023-10-25T23:45:08.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.724+0000 7fe99bddf700 1 -- 172.21.15.81:0/3971714584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe99406d060 msgr2=0x7fe9941e4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:08.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.724+0000 7fe99bddf700 1 --2- 172.21.15.81:0/3971714584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe99406d060 0x7fe9941e4de0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe98400e9f0 tx=0x7fe98400edb0 comp rx=0 tx=0).stop 2023-10-25T23:45:08.733 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.724+0000 7fe99bddf700 1 -- 172.21.15.81:0/3971714584 shutdown_connections 2023-10-25T23:45:08.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.724+0000 7fe99bddf700 1 --2- 172.21.15.81:0/3971714584 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe99414bd10 0x7fe9941d6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:08.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.724+0000 7fe99bddf700 1 --2- 172.21.15.81:0/3971714584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe99406d060 0x7fe9941e4de0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:08.734 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.724+0000 7fe99bddf700 1 --2- 172.21.15.81:0/3971714584 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe97806aed0 0x7fe97806d390 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:08.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.724+0000 7fe99bddf700 1 --2- 172.21.15.81:0/3971714584 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe994145040 0x7fe9941d7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:08.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.724+0000 7fe99bddf700 1 -- 172.21.15.81:0/3971714584 >> 172.21.15.81:0/3971714584 conn(0x7fe9940c0ab0 msgr2=0x7fe994145470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:08.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.724+0000 7fe99bddf700 1 -- 172.21.15.81:0/3971714584 shutdown_connections 2023-10-25T23:45:08.735 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:08.724+0000 7fe99bddf700 1 -- 172.21.15.81:0/3971714584 wait complete. 2023-10-25T23:45:08.736 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-25T23:45:08.738 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2023-10-25T23:45:07.125968+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":886094309,"num_objects":569,"num_object_clones":2,"num_object_copies":1138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":569,"num_whiteouts":0,"num_read":14774,"num_read_kb":532593,"num_write":91968,"num_write_kb":4545540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":344,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31612910,"num_omap_keys":53111,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147536,"ondisk_log_size":147536,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2694048,"kb_used_data":1734368,"kb_used_omap":12,"kb_used_meta":959603,"kb_avail":752280672,"statfs":{"total":773094113280,"available":770335408128,"internally_reserved":0,"allocated":1775992832,"data_stored":1773821594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":982634040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18695067,"num_omap_keys":31340,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002966"},"pg_stats":[{"pgid":"3.3f","version":"40'1945","reported_seq":4566,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.873269+0000","last_change":"2023-10-25T23:44:39.031078+0000","last_active":"2023-10-25T23:44:47.873269+0000","last_peered":"2023-10-25T23:44:47.873269+0000","last_clean":"2023-10-25T23:44:47.873269+0000","last_became_active":"2023-10-25T23:36:09.292007+0000","last_became_peered":"2023-10-25T23:36:09.292007+0000","last_unstale":"2023-10-25T23:44:47.873269+0000","last_undegraded":"2023-10-25T23:44:47.873269+0000","last_fullsized":"2023-10-25T23:44:47.873269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1945,"log_dups_size":0,"ondisk_log_size":1945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0441538,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":3053,"num_write":1182,"num_write_kb":17288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"40'1938","reported_seq":4576,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.168056+0000","last_change":"2023-10-25T23:44:39.125143+0000","last_active":"2023-10-25T23:44:48.168056+0000","last_peered":"2023-10-25T23:44:48.168056+0000","last_clean":"2023-10-25T23:44:48.168056+0000","last_became_active":"2023-10-25T23:36:09.281890+0000","last_became_peered":"2023-10-25T23:36:09.281890+0000","last_unstale":"2023-10-25T23:44:48.168056+0000","last_undegraded":"2023-10-25T23:44:48.168056+0000","last_fullsized":"2023-10-25T23:44:48.168056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1938,"log_dups_size":0,"ondisk_log_size":1938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.049488604999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":12821,"num_write":1152,"num_write_kb":16010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"40'2038","reported_seq":4639,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.665442+0000","last_change":"2023-10-25T23:44:39.641700+0000","last_active":"2023-10-25T23:44:48.665442+0000","last_peered":"2023-10-25T23:44:48.665442+0000","last_clean":"2023-10-25T23:44:48.665442+0000","last_became_active":"2023-10-25T23:36:09.284066+0000","last_became_peered":"2023-10-25T23:36:09.284066+0000","last_unstale":"2023-10-25T23:44:48.665442+0000","last_undegraded":"2023-10-25T23:44:48.665442+0000","last_fullsized":"2023-10-25T23:44:48.665442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2038,"log_dups_size":0,"ondisk_log_size":2038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17887767900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":12209,"num_write":1200,"num_write_kb":24347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"40'2086","reported_seq":4787,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.990267+0000","last_change":"2023-10-25T23:44:39.130990+0000","last_active":"2023-10-25T23:44:47.990267+0000","last_peered":"2023-10-25T23:44:47.990267+0000","last_clean":"2023-10-25T23:44:47.990267+0000","last_became_active":"2023-10-25T23:36:09.299585+0000","last_became_peered":"2023-10-25T23:36:09.299585+0000","last_unstale":"2023-10-25T23:44:47.990267+0000","last_undegraded":"2023-10-25T23:44:47.990267+0000","last_fullsized":"2023-10-25T23:44:47.990267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2086,"log_dups_size":0,"ondisk_log_size":2086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16786652399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":4442,"num_write":1222,"num_write_kb":17071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"40'2222","reported_seq":4821,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.872513+0000","last_change":"2023-10-25T23:44:39.035458+0000","last_active":"2023-10-25T23:44:47.872513+0000","last_peered":"2023-10-25T23:44:47.872513+0000","last_clean":"2023-10-25T23:44:47.872513+0000","last_became_active":"2023-10-25T23:36:09.287403+0000","last_became_peered":"2023-10-25T23:36:09.287403+0000","last_unstale":"2023-10-25T23:44:47.872513+0000","last_undegraded":"2023-10-25T23:44:47.872513+0000","last_fullsized":"2023-10-25T23:44:47.872513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2222,"log_dups_size":0,"ondisk_log_size":2222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047660552000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":4323,"num_write":1325,"num_write_kb":21852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"40'1930","reported_seq":4563,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.989740+0000","last_change":"2023-10-25T23:44:39.102497+0000","last_active":"2023-10-25T23:44:47.989740+0000","last_peered":"2023-10-25T23:44:47.989740+0000","last_clean":"2023-10-25T23:44:47.989740+0000","last_became_active":"2023-10-25T23:36:09.301305+0000","last_became_peered":"2023-10-25T23:36:09.301305+0000","last_unstale":"2023-10-25T23:44:47.989740+0000","last_undegraded":"2023-10-25T23:44:47.989740+0000","last_fullsized":"2023-10-25T23:44:47.989740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1930,"log_dups_size":0,"ondisk_log_size":1930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.139844156,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":4600,"num_write":1162,"num_write_kb":16604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"40'2105","reported_seq":4709,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.872701+0000","last_change":"2023-10-25T23:44:39.026668+0000","last_active":"2023-10-25T23:44:47.872701+0000","last_peered":"2023-10-25T23:44:47.872701+0000","last_clean":"2023-10-25T23:44:47.872701+0000","last_became_active":"2023-10-25T23:36:09.293173+0000","last_became_peered":"2023-10-25T23:36:09.293173+0000","last_unstale":"2023-10-25T23:44:47.872701+0000","last_undegraded":"2023-10-25T23:44:47.872701+0000","last_fullsized":"2023-10-25T23:44:47.872701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2105,"log_dups_size":0,"ondisk_log_size":2105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040145588000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":4028,"num_write":1252,"num_write_kb":24067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"40'1952","reported_seq":4589,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.047408+0000","last_change":"2023-10-25T23:44:38.909560+0000","last_active":"2023-10-25T23:44:48.047408+0000","last_peered":"2023-10-25T23:44:48.047408+0000","last_clean":"2023-10-25T23:44:48.047408+0000","last_became_active":"2023-10-25T23:36:09.295518+0000","last_became_peered":"2023-10-25T23:36:09.295518+0000","last_unstale":"2023-10-25T23:44:48.047408+0000","last_undegraded":"2023-10-25T23:44:48.047408+0000","last_fullsized":"2023-10-25T23:44:48.047408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035739239999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":4005,"num_write":1156,"num_write_kb":40374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"40'2141","reported_seq":4765,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.872931+0000","last_change":"2023-10-25T23:44:39.033197+0000","last_active":"2023-10-25T23:44:47.872931+0000","last_peered":"2023-10-25T23:44:47.872931+0000","last_clean":"2023-10-25T23:44:47.872931+0000","last_became_active":"2023-10-25T23:36:09.297036+0000","last_became_peered":"2023-10-25T23:36:09.297036+0000","last_unstale":"2023-10-25T23:44:47.872931+0000","last_undegraded":"2023-10-25T23:44:47.872931+0000","last_fullsized":"2023-10-25T23:44:47.872931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2141,"log_dups_size":0,"ondisk_log_size":2141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046296174000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":8236,"num_write":1280,"num_write_kb":21230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"40'1990","reported_seq":4607,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.665819+0000","last_change":"2023-10-25T23:44:39.516062+0000","last_active":"2023-10-25T23:44:48.665819+0000","last_peered":"2023-10-25T23:44:48.665819+0000","last_clean":"2023-10-25T23:44:48.665819+0000","last_became_active":"2023-10-25T23:36:09.297713+0000","last_became_peered":"2023-10-25T23:36:09.297713+0000","last_unstale":"2023-10-25T23:44:48.665819+0000","last_undegraded":"2023-10-25T23:44:48.665819+0000","last_fullsized":"2023-10-25T23:44:48.665819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1990,"log_dups_size":0,"ondisk_log_size":1990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052261503000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":4128,"num_write":1151,"num_write_kb":8179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"40'2162","reported_seq":4760,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.665466+0000","last_change":"2023-10-25T23:44:39.519698+0000","last_active":"2023-10-25T23:44:48.665466+0000","last_peered":"2023-10-25T23:44:48.665466+0000","last_clean":"2023-10-25T23:44:48.665466+0000","last_became_active":"2023-10-25T23:36:50.071605+0000","last_became_peered":"2023-10-25T23:36:50.071605+0000","last_unstale":"2023-10-25T23:44:48.665466+0000","last_undegraded":"2023-10-25T23:44:48.665466+0000","last_fullsized":"2023-10-25T23:44:48.665466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2162,"log_dups_size":0,"ondisk_log_size":2162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056199102000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":4889,"num_write":1231,"num_write_kb":19417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"40'2105","reported_seq":4720,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:01.541640+0000","last_change":"2023-10-25T23:45:01.541723+0000","last_active":"2023-10-25T23:45:01.541640+0000","last_peered":"2023-10-25T23:45:01.541640+0000","last_clean":"2023-10-25T23:45:01.541640+0000","last_became_active":"2023-10-25T23:36:09.291351+0000","last_became_peered":"2023-10-25T23:36:09.291351+0000","last_unstale":"2023-10-25T23:45:01.541640+0000","last_undegraded":"2023-10-25T23:45:01.541640+0000","last_fullsized":"2023-10-25T23:45:01.541640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2105","last_scrub_stamp":"2023-10-25T23:45:01.541514+0000","last_deep_scrub":"40'2105","last_deep_scrub_stamp":"2023-10-25T23:45:01.541514+0000","last_clean_scrub_stamp":"2023-10-25T23:45:01.541514+0000","objects_scrubbed":0,"log_size":2105,"log_dups_size":0,"ondisk_log_size":2105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:23:34.365717+0000","scrub_duration":0.0060231190000000004,"objects_trimmed":0,"snaptrim_duration":0.104157445,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":4997,"num_write":1220,"num_write_kb":33278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"40'2041","reported_seq":4665,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:05.023879+0000","last_change":"2023-10-25T23:45:05.023966+0000","last_active":"2023-10-25T23:45:05.023879+0000","last_peered":"2023-10-25T23:45:05.023879+0000","last_clean":"2023-10-25T23:45:05.023879+0000","last_became_active":"2023-10-25T23:36:09.289895+0000","last_became_peered":"2023-10-25T23:36:09.289895+0000","last_unstale":"2023-10-25T23:45:05.023879+0000","last_undegraded":"2023-10-25T23:45:05.023879+0000","last_fullsized":"2023-10-25T23:45:05.023879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2041","last_scrub_stamp":"2023-10-25T23:45:05.023771+0000","last_deep_scrub":"40'2041","last_deep_scrub_stamp":"2023-10-25T23:45:05.023771+0000","last_clean_scrub_stamp":"2023-10-25T23:45:05.023771+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:12:05.963637+0000","scrub_duration":0.0041081449999999997,"objects_trimmed":0,"snaptrim_duration":0.041092534,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":8364,"num_write":1160,"num_write_kb":24700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"40'2063","reported_seq":4703,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:54.785942+0000","last_change":"2023-10-25T23:44:54.786036+0000","last_active":"2023-10-25T23:44:54.785942+0000","last_peered":"2023-10-25T23:44:54.785942+0000","last_clean":"2023-10-25T23:44:54.785942+0000","last_became_active":"2023-10-25T23:36:09.283250+0000","last_became_peered":"2023-10-25T23:36:09.283250+0000","last_unstale":"2023-10-25T23:44:54.785942+0000","last_undegraded":"2023-10-25T23:44:54.785942+0000","last_fullsized":"2023-10-25T23:44:54.785942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2063","last_scrub_stamp":"2023-10-25T23:44:54.785822+0000","last_deep_scrub":"40'2063","last_deep_scrub_stamp":"2023-10-25T23:44:54.785822+0000","last_clean_scrub_stamp":"2023-10-25T23:44:54.785822+0000","objects_scrubbed":0,"log_size":2063,"log_dups_size":0,"ondisk_log_size":2063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:33:50.507803+0000","scrub_duration":0.0058257480000000004,"objects_trimmed":0,"snaptrim_duration":0.18494869999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":4523,"num_write":1222,"num_write_kb":24181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"40'2103","reported_seq":4721,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.166868+0000","last_change":"2023-10-25T23:44:39.124949+0000","last_active":"2023-10-25T23:44:48.166868+0000","last_peered":"2023-10-25T23:44:48.166868+0000","last_clean":"2023-10-25T23:44:48.166868+0000","last_became_active":"2023-10-25T23:36:09.286191+0000","last_became_peered":"2023-10-25T23:36:09.286191+0000","last_unstale":"2023-10-25T23:44:48.166868+0000","last_undegraded":"2023-10-25T23:44:48.166868+0000","last_fullsized":"2023-10-25T23:44:48.166868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2103,"log_dups_size":0,"ondisk_log_size":2103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.049576174000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":4088,"num_write":1280,"num_write_kb":29409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"40'2074","reported_seq":4703,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.989661+0000","last_change":"2023-10-25T23:44:39.116703+0000","last_active":"2023-10-25T23:44:47.989661+0000","last_peered":"2023-10-25T23:44:47.989661+0000","last_clean":"2023-10-25T23:44:47.989661+0000","last_became_active":"2023-10-25T23:36:09.301040+0000","last_became_peered":"2023-10-25T23:36:09.301040+0000","last_unstale":"2023-10-25T23:44:47.989661+0000","last_undegraded":"2023-10-25T23:44:47.989661+0000","last_fullsized":"2023-10-25T23:44:47.989661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2074,"log_dups_size":0,"ondisk_log_size":2074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15382465100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":14548,"num_write":1224,"num_write_kb":47800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"40'2118","reported_seq":4769,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:54.066379+0000","last_change":"2023-10-25T23:44:54.066449+0000","last_active":"2023-10-25T23:44:54.066379+0000","last_peered":"2023-10-25T23:44:54.066379+0000","last_clean":"2023-10-25T23:44:54.066379+0000","last_became_active":"2023-10-25T23:36:50.103220+0000","last_became_peered":"2023-10-25T23:36:50.103220+0000","last_unstale":"2023-10-25T23:44:54.066379+0000","last_undegraded":"2023-10-25T23:44:54.066379+0000","last_fullsized":"2023-10-25T23:44:54.066379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2118","last_scrub_stamp":"2023-10-25T23:44:54.066263+0000","last_deep_scrub":"40'2118","last_deep_scrub_stamp":"2023-10-25T23:44:54.066263+0000","last_clean_scrub_stamp":"2023-10-25T23:44:54.066263+0000","objects_scrubbed":0,"log_size":2118,"log_dups_size":0,"ondisk_log_size":2118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:10:22.153336+0000","scrub_duration":0.0035887580000000001,"objects_trimmed":0,"snaptrim_duration":0.033066291999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":8493,"num_write":1280,"num_write_kb":14868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"40'2009","reported_seq":4631,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:51.045918+0000","last_change":"2023-10-25T23:44:51.045966+0000","last_active":"2023-10-25T23:44:51.045918+0000","last_peered":"2023-10-25T23:44:51.045918+0000","last_clean":"2023-10-25T23:44:51.045918+0000","last_became_active":"2023-10-25T23:36:09.282282+0000","last_became_peered":"2023-10-25T23:36:09.282282+0000","last_unstale":"2023-10-25T23:44:51.045918+0000","last_undegraded":"2023-10-25T23:44:51.045918+0000","last_fullsized":"2023-10-25T23:44:51.045918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2009","last_scrub_stamp":"2023-10-25T23:44:51.045757+0000","last_deep_scrub":"40'2009","last_deep_scrub_stamp":"2023-10-25T23:44:51.045757+0000","last_clean_scrub_stamp":"2023-10-25T23:44:51.045757+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:26:50.500449+0000","scrub_duration":0.0054215599999999997,"objects_trimmed":0,"snaptrim_duration":0.033856860000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":3064,"num_write":1152,"num_write_kb":24838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"40'2193","reported_seq":4812,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:56.023556+0000","last_change":"2023-10-25T23:44:56.023652+0000","last_active":"2023-10-25T23:44:56.023556+0000","last_peered":"2023-10-25T23:44:56.023556+0000","last_clean":"2023-10-25T23:44:56.023556+0000","last_became_active":"2023-10-25T23:36:09.289457+0000","last_became_peered":"2023-10-25T23:36:09.289457+0000","last_unstale":"2023-10-25T23:44:56.023556+0000","last_undegraded":"2023-10-25T23:44:56.023556+0000","last_fullsized":"2023-10-25T23:44:56.023556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2193","last_scrub_stamp":"2023-10-25T23:44:56.023426+0000","last_deep_scrub":"40'2193","last_deep_scrub_stamp":"2023-10-25T23:44:56.023426+0000","last_clean_scrub_stamp":"2023-10-25T23:44:56.023426+0000","objects_scrubbed":0,"log_size":2193,"log_dups_size":0,"ondisk_log_size":2193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:50:13.161520+0000","scrub_duration":0.0054959659999999997,"objects_trimmed":0,"snaptrim_duration":0.041861184000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":8808,"num_write":1334,"num_write_kb":38138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"41'383","reported_seq":428,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:51.809605+0000","last_change":"2023-10-25T23:44:51.809669+0000","last_active":"2023-10-25T23:44:51.809605+0000","last_peered":"2023-10-25T23:44:51.809605+0000","last_clean":"2023-10-25T23:44:51.809605+0000","last_became_active":"2023-10-25T23:36:08.270911+0000","last_became_peered":"2023-10-25T23:36:08.270911+0000","last_unstale":"2023-10-25T23:44:51.809605+0000","last_undegraded":"2023-10-25T23:44:51.809605+0000","last_fullsized":"2023-10-25T23:44:51.809605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'383","last_scrub_stamp":"2023-10-25T23:44:51.809528+0000","last_deep_scrub":"41'383","last_deep_scrub_stamp":"2023-10-25T23:44:51.809528+0000","last_clean_scrub_stamp":"2023-10-25T23:44:51.809528+0000","objects_scrubbed":20,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:01:37.777592+0000","scrub_duration":0.059215088999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33555014,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":323,"num_write_kb":78531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":351082,"num_omap_keys":627,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"40'1985","reported_seq":4581,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.047939+0000","last_change":"2023-10-25T23:44:38.910905+0000","last_active":"2023-10-25T23:44:48.047939+0000","last_peered":"2023-10-25T23:44:48.047939+0000","last_clean":"2023-10-25T23:44:48.047939+0000","last_became_active":"2023-10-25T23:36:09.290260+0000","last_became_peered":"2023-10-25T23:36:09.290260+0000","last_unstale":"2023-10-25T23:44:48.047939+0000","last_undegraded":"2023-10-25T23:44:48.047939+0000","last_fullsized":"2023-10-25T23:44:48.047939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1985,"log_dups_size":0,"ondisk_log_size":1985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036898185999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":3083,"num_write":1169,"num_write_kb":11022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"41'649","reported_seq":694,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:56.146522+0000","last_change":"2023-10-25T23:44:56.146628+0000","last_active":"2023-10-25T23:44:56.146522+0000","last_peered":"2023-10-25T23:44:56.146522+0000","last_clean":"2023-10-25T23:44:56.146522+0000","last_became_active":"2023-10-25T23:36:08.269443+0000","last_became_peered":"2023-10-25T23:36:08.269443+0000","last_unstale":"2023-10-25T23:44:56.146522+0000","last_undegraded":"2023-10-25T23:44:56.146522+0000","last_fullsized":"2023-10-25T23:44:56.146522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'649","last_scrub_stamp":"2023-10-25T23:44:56.146419+0000","last_deep_scrub":"41'649","last_deep_scrub_stamp":"2023-10-25T23:44:56.146419+0000","last_clean_scrub_stamp":"2023-10-25T23:44:56.146419+0000","objects_scrubbed":13,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:50:13.284513+0000","scrub_duration":0.054388904000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":598,"num_write_kb":86544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149116,"num_omap_keys":265,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"40'1964","reported_seq":4602,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.665532+0000","last_change":"2023-10-25T23:44:39.629796+0000","last_active":"2023-10-25T23:44:48.665532+0000","last_peered":"2023-10-25T23:44:48.665532+0000","last_clean":"2023-10-25T23:44:48.665532+0000","last_became_active":"2023-10-25T23:36:09.299738+0000","last_became_peered":"2023-10-25T23:36:09.299738+0000","last_unstale":"2023-10-25T23:44:48.665532+0000","last_undegraded":"2023-10-25T23:44:48.665532+0000","last_fullsized":"2023-10-25T23:44:48.665532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1964,"log_dups_size":0,"ondisk_log_size":1964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.16688098700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":3695,"num_write":1175,"num_write_kb":20733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"36'607","reported_seq":643,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.873223+0000","last_change":"2023-10-25T23:36:08.273879+0000","last_active":"2023-10-25T23:44:47.873223+0000","last_peered":"2023-10-25T23:44:47.873223+0000","last_clean":"2023-10-25T23:44:47.873223+0000","last_became_active":"2023-10-25T23:36:08.273574+0000","last_became_peered":"2023-10-25T23:36:08.273574+0000","last_unstale":"2023-10-25T23:44:47.873223+0000","last_undegraded":"2023-10-25T23:44:47.873223+0000","last_fullsized":"2023-10-25T23:44:47.873223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":582,"num_write_kb":140942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"40'2159","reported_seq":4763,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.989840+0000","last_change":"2023-10-25T23:44:39.102502+0000","last_active":"2023-10-25T23:44:47.989840+0000","last_peered":"2023-10-25T23:44:47.989840+0000","last_clean":"2023-10-25T23:44:47.989840+0000","last_became_active":"2023-10-25T23:36:09.299916+0000","last_became_peered":"2023-10-25T23:36:09.299916+0000","last_unstale":"2023-10-25T23:44:47.989840+0000","last_undegraded":"2023-10-25T23:44:47.989840+0000","last_fullsized":"2023-10-25T23:44:47.989840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14014327800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":4255,"num_write":1272,"num_write_kb":13349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"41'414","reported_seq":458,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:06.063739+0000","last_change":"2023-10-25T23:45:06.063862+0000","last_active":"2023-10-25T23:45:06.063739+0000","last_peered":"2023-10-25T23:45:06.063739+0000","last_clean":"2023-10-25T23:45:06.063739+0000","last_became_active":"2023-10-25T23:36:08.271442+0000","last_became_peered":"2023-10-25T23:36:08.271442+0000","last_unstale":"2023-10-25T23:45:06.063739+0000","last_undegraded":"2023-10-25T23:45:06.063739+0000","last_fullsized":"2023-10-25T23:45:06.063739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'414","last_scrub_stamp":"2023-10-25T23:45:06.063634+0000","last_deep_scrub":"41'414","last_deep_scrub_stamp":"2023-10-25T23:45:06.063634+0000","last_clean_scrub_stamp":"2023-10-25T23:45:06.063634+0000","objects_scrubbed":21,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:14:32.889839+0000","scrub_duration":0.052590801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":379,"num_write_kb":83039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":393616,"num_omap_keys":682,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"40'2019","reported_seq":4652,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.990393+0000","last_change":"2023-10-25T23:44:39.109564+0000","last_active":"2023-10-25T23:44:47.990393+0000","last_peered":"2023-10-25T23:44:47.990393+0000","last_clean":"2023-10-25T23:44:47.990393+0000","last_became_active":"2023-10-25T23:36:09.299130+0000","last_became_peered":"2023-10-25T23:36:09.299130+0000","last_unstale":"2023-10-25T23:44:47.990393+0000","last_undegraded":"2023-10-25T23:44:47.990393+0000","last_fullsized":"2023-10-25T23:44:47.990393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2019,"log_dups_size":0,"ondisk_log_size":2019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14672489499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":3649,"num_write":1196,"num_write_kb":32686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"41'472","reported_seq":516,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:54.120320+0000","last_change":"2023-10-25T23:44:54.120431+0000","last_active":"2023-10-25T23:44:54.120320+0000","last_peered":"2023-10-25T23:44:54.120320+0000","last_clean":"2023-10-25T23:44:54.120320+0000","last_became_active":"2023-10-25T23:36:08.270138+0000","last_became_peered":"2023-10-25T23:36:08.270138+0000","last_unstale":"2023-10-25T23:44:54.120320+0000","last_undegraded":"2023-10-25T23:44:54.120320+0000","last_fullsized":"2023-10-25T23:44:54.120320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'472","last_scrub_stamp":"2023-10-25T23:44:54.120211+0000","last_deep_scrub":"41'472","last_deep_scrub_stamp":"2023-10-25T23:44:54.120211+0000","last_clean_scrub_stamp":"2023-10-25T23:44:54.120211+0000","objects_scrubbed":20,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:27:28.414292+0000","scrub_duration":0.071562769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":475,"num_write_kb":111638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4150944,"num_omap_keys":7343,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"40'2154","reported_seq":4775,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:58.501870+0000","last_change":"2023-10-25T23:44:58.501940+0000","last_active":"2023-10-25T23:44:58.501870+0000","last_peered":"2023-10-25T23:44:58.501870+0000","last_clean":"2023-10-25T23:44:58.501870+0000","last_became_active":"2023-10-25T23:36:09.287455+0000","last_became_peered":"2023-10-25T23:36:09.287455+0000","last_unstale":"2023-10-25T23:44:58.501870+0000","last_undegraded":"2023-10-25T23:44:58.501870+0000","last_fullsized":"2023-10-25T23:44:58.501870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2154","last_scrub_stamp":"2023-10-25T23:44:58.501771+0000","last_deep_scrub":"40'2154","last_deep_scrub_stamp":"2023-10-25T23:44:58.501771+0000","last_clean_scrub_stamp":"2023-10-25T23:44:58.501771+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:20:18.363567+0000","scrub_duration":0.0049148270000000001,"objects_trimmed":0,"snaptrim_duration":0.093404585999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":5171,"num_write":1282,"num_write_kb":34019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"41'545","reported_seq":589,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:50.958967+0000","last_change":"2023-10-25T23:44:50.959038+0000","last_active":"2023-10-25T23:44:50.958967+0000","last_peered":"2023-10-25T23:44:50.958967+0000","last_clean":"2023-10-25T23:44:50.958967+0000","last_became_active":"2023-10-25T23:36:08.271974+0000","last_became_peered":"2023-10-25T23:36:08.271974+0000","last_unstale":"2023-10-25T23:44:50.958967+0000","last_undegraded":"2023-10-25T23:44:50.958967+0000","last_fullsized":"2023-10-25T23:44:50.958967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'545","last_scrub_stamp":"2023-10-25T23:44:50.958861+0000","last_deep_scrub":"41'545","last_deep_scrub_stamp":"2023-10-25T23:44:50.958861+0000","last_clean_scrub_stamp":"2023-10-25T23:44:50.958861+0000","objects_scrubbed":8,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:21:29.815599+0000","scrub_duration":0.037452547000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":503,"num_write_kb":90640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":126186,"num_omap_keys":226,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"40'2101","reported_seq":4693,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.665179+0000","last_change":"2023-10-25T23:44:39.666472+0000","last_active":"2023-10-25T23:44:48.665179+0000","last_peered":"2023-10-25T23:44:48.665179+0000","last_clean":"2023-10-25T23:44:48.665179+0000","last_became_active":"2023-10-25T23:36:09.294176+0000","last_became_peered":"2023-10-25T23:36:09.294176+0000","last_unstale":"2023-10-25T23:44:48.665179+0000","last_undegraded":"2023-10-25T23:44:48.665179+0000","last_fullsized":"2023-10-25T23:44:48.665179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2101,"log_dups_size":0,"ondisk_log_size":2101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20272068300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":27232,"num_write":1210,"num_write_kb":20727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"41'313","reported_seq":357,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:51.150889+0000","last_change":"2023-10-25T23:44:51.150961+0000","last_active":"2023-10-25T23:44:51.150889+0000","last_peered":"2023-10-25T23:44:51.150889+0000","last_clean":"2023-10-25T23:44:51.150889+0000","last_became_active":"2023-10-25T23:36:08.273035+0000","last_became_peered":"2023-10-25T23:36:08.273035+0000","last_unstale":"2023-10-25T23:44:51.150889+0000","last_undegraded":"2023-10-25T23:44:51.150889+0000","last_fullsized":"2023-10-25T23:44:51.150889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'313","last_scrub_stamp":"2023-10-25T23:44:51.150805+0000","last_deep_scrub":"41'313","last_deep_scrub_stamp":"2023-10-25T23:44:51.150805+0000","last_clean_scrub_stamp":"2023-10-25T23:44:51.150805+0000","objects_scrubbed":13,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:58:17.029784+0000","scrub_duration":0.051535087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20925654,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":275,"num_write_kb":80040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1602763,"num_omap_keys":2447,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"40'2324","reported_seq":4919,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.047619+0000","last_change":"2023-10-25T23:44:38.909221+0000","last_active":"2023-10-25T23:44:48.047619+0000","last_peered":"2023-10-25T23:44:48.047619+0000","last_clean":"2023-10-25T23:44:48.047619+0000","last_became_active":"2023-10-25T23:36:09.292546+0000","last_became_peered":"2023-10-25T23:36:09.292546+0000","last_unstale":"2023-10-25T23:44:48.047619+0000","last_undegraded":"2023-10-25T23:44:48.047619+0000","last_fullsized":"2023-10-25T23:44:48.047619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035319162000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":23958,"num_write":1360,"num_write_kb":38473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"41'1039","reported_seq":1083,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:58.509448+0000","last_change":"2023-10-25T23:44:58.509524+0000","last_active":"2023-10-25T23:44:58.509448+0000","last_peered":"2023-10-25T23:44:58.509448+0000","last_clean":"2023-10-25T23:44:58.509448+0000","last_became_active":"2023-10-25T23:36:08.277138+0000","last_became_peered":"2023-10-25T23:36:08.277138+0000","last_unstale":"2023-10-25T23:44:58.509448+0000","last_undegraded":"2023-10-25T23:44:58.509448+0000","last_fullsized":"2023-10-25T23:44:58.509448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1039","last_scrub_stamp":"2023-10-25T23:44:58.509365+0000","last_deep_scrub":"41'1039","last_deep_scrub_stamp":"2023-10-25T23:44:58.509365+0000","last_clean_scrub_stamp":"2023-10-25T23:44:58.509365+0000","objects_scrubbed":22,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:29:10.829596+0000","scrub_duration":0.093800564000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":989,"num_write_kb":120913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1331763,"num_omap_keys":2391,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"40'2067","reported_seq":4677,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.166990+0000","last_change":"2023-10-25T23:44:39.133918+0000","last_active":"2023-10-25T23:44:48.166990+0000","last_peered":"2023-10-25T23:44:48.166990+0000","last_clean":"2023-10-25T23:44:48.166990+0000","last_became_active":"2023-10-25T23:36:09.290456+0000","last_became_peered":"2023-10-25T23:36:09.290456+0000","last_unstale":"2023-10-25T23:44:48.166990+0000","last_undegraded":"2023-10-25T23:44:48.166990+0000","last_fullsized":"2023-10-25T23:44:48.166990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058251507000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":31667,"num_write":1204,"num_write_kb":33454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"41'372","reported_seq":493,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:58.089431+0000","last_change":"2023-10-25T23:44:58.089534+0000","last_active":"2023-10-25T23:44:58.089431+0000","last_peered":"2023-10-25T23:44:58.089431+0000","last_clean":"2023-10-25T23:44:58.089431+0000","last_became_active":"2023-10-25T23:36:08.272120+0000","last_became_peered":"2023-10-25T23:36:08.272120+0000","last_unstale":"2023-10-25T23:44:58.089431+0000","last_undegraded":"2023-10-25T23:44:58.089431+0000","last_fullsized":"2023-10-25T23:44:58.089431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'372","last_scrub_stamp":"2023-10-25T23:44:58.089308+0000","last_deep_scrub":"41'372","last_deep_scrub_stamp":"2023-10-25T23:44:58.089308+0000","last_clean_scrub_stamp":"2023-10-25T23:44:58.089308+0000","objects_scrubbed":17,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:17:25.802848+0000","scrub_duration":0.058194296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21516807,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":85,"num_read_kb":582,"num_write":349,"num_write_kb":84048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":536150,"num_omap_keys":952,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"40'2013","reported_seq":4635,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:05.451533+0000","last_change":"2023-10-25T23:45:05.451575+0000","last_active":"2023-10-25T23:45:05.451533+0000","last_peered":"2023-10-25T23:45:05.451533+0000","last_clean":"2023-10-25T23:45:05.451533+0000","last_became_active":"2023-10-25T23:36:09.293132+0000","last_became_peered":"2023-10-25T23:36:09.293132+0000","last_unstale":"2023-10-25T23:45:05.451533+0000","last_undegraded":"2023-10-25T23:45:05.451533+0000","last_fullsized":"2023-10-25T23:45:05.451533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2013","last_scrub_stamp":"2023-10-25T23:45:05.451437+0000","last_deep_scrub":"40'2013","last_deep_scrub_stamp":"2023-10-25T23:45:05.451437+0000","last_clean_scrub_stamp":"2023-10-25T23:45:05.451437+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:14:32.277642+0000","scrub_duration":0.0046978360000000004,"objects_trimmed":0,"snaptrim_duration":0.167893237,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":3351,"num_write":1194,"num_write_kb":12593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"41'695","reported_seq":739,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:50.371199+0000","last_change":"2023-10-25T23:44:50.371272+0000","last_active":"2023-10-25T23:44:50.371199+0000","last_peered":"2023-10-25T23:44:50.371199+0000","last_clean":"2023-10-25T23:44:50.371199+0000","last_became_active":"2023-10-25T23:36:08.272596+0000","last_became_peered":"2023-10-25T23:36:08.272596+0000","last_unstale":"2023-10-25T23:44:50.371199+0000","last_undegraded":"2023-10-25T23:44:50.371199+0000","last_fullsized":"2023-10-25T23:44:50.371199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'695","last_scrub_stamp":"2023-10-25T23:44:50.371115+0000","last_deep_scrub":"41'695","last_deep_scrub_stamp":"2023-10-25T23:44:50.371115+0000","last_clean_scrub_stamp":"2023-10-25T23:44:50.371115+0000","objects_scrubbed":19,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:58:16.250094+0000","scrub_duration":0.077208414000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":681,"num_write_kb":114510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3072130,"num_omap_keys":5404,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"40'2412","reported_seq":4886,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.665562+0000","last_change":"2023-10-25T23:44:39.666473+0000","last_active":"2023-10-25T23:44:48.665562+0000","last_peered":"2023-10-25T23:44:48.665562+0000","last_clean":"2023-10-25T23:44:48.665562+0000","last_became_active":"2023-10-25T23:36:09.299938+0000","last_became_peered":"2023-10-25T23:36:09.299938+0000","last_unstale":"2023-10-25T23:44:48.665562+0000","last_undegraded":"2023-10-25T23:44:48.665562+0000","last_fullsized":"2023-10-25T23:44:48.665562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2412,"log_dups_size":0,"ondisk_log_size":2412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20328459099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":3949,"num_write":1292,"num_write_kb":20710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"41'684","reported_seq":728,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:54.301455+0000","last_change":"2023-10-25T23:44:54.301510+0000","last_active":"2023-10-25T23:44:54.301455+0000","last_peered":"2023-10-25T23:44:54.301455+0000","last_clean":"2023-10-25T23:44:54.301455+0000","last_became_active":"2023-10-25T23:36:08.279509+0000","last_became_peered":"2023-10-25T23:36:08.279509+0000","last_unstale":"2023-10-25T23:44:54.301455+0000","last_undegraded":"2023-10-25T23:44:54.301455+0000","last_fullsized":"2023-10-25T23:44:54.301455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'684","last_scrub_stamp":"2023-10-25T23:44:54.301377+0000","last_deep_scrub":"41'684","last_deep_scrub_stamp":"2023-10-25T23:44:54.301377+0000","last_clean_scrub_stamp":"2023-10-25T23:44:54.301377+0000","objects_scrubbed":14,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:24:35.077752+0000","scrub_duration":0.039027157,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":675,"num_write_kb":75678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":833477,"num_omap_keys":1408,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"40'2111","reported_seq":4735,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:03.536532+0000","last_change":"2023-10-25T23:45:03.536599+0000","last_active":"2023-10-25T23:45:03.536532+0000","last_peered":"2023-10-25T23:45:03.536532+0000","last_clean":"2023-10-25T23:45:03.536532+0000","last_became_active":"2023-10-25T23:36:09.285196+0000","last_became_peered":"2023-10-25T23:36:09.285196+0000","last_unstale":"2023-10-25T23:45:03.536532+0000","last_undegraded":"2023-10-25T23:45:03.536532+0000","last_fullsized":"2023-10-25T23:45:03.536532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2111","last_scrub_stamp":"2023-10-25T23:45:03.536397+0000","last_deep_scrub":"40'2111","last_deep_scrub_stamp":"2023-10-25T23:45:03.536397+0000","last_clean_scrub_stamp":"2023-10-25T23:45:03.536397+0000","objects_scrubbed":0,"log_size":2111,"log_dups_size":0,"ondisk_log_size":2111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:31:40.764015+0000","scrub_duration":0.0051017290000000002,"objects_trimmed":0,"snaptrim_duration":0.093006917999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":5156,"num_write":1232,"num_write_kb":26142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"41'539","reported_seq":583,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:57.032937+0000","last_change":"2023-10-25T23:44:57.033037+0000","last_active":"2023-10-25T23:44:57.032937+0000","last_peered":"2023-10-25T23:44:57.032937+0000","last_clean":"2023-10-25T23:44:57.032937+0000","last_became_active":"2023-10-25T23:36:08.272248+0000","last_became_peered":"2023-10-25T23:36:08.272248+0000","last_unstale":"2023-10-25T23:44:57.032937+0000","last_undegraded":"2023-10-25T23:44:57.032937+0000","last_fullsized":"2023-10-25T23:44:57.032937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'539","last_scrub_stamp":"2023-10-25T23:44:57.032834+0000","last_deep_scrub":"41'539","last_deep_scrub_stamp":"2023-10-25T23:44:57.032834+0000","last_clean_scrub_stamp":"2023-10-25T23:44:57.032834+0000","objects_scrubbed":14,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:24:37.809209+0000","scrub_duration":0.047065255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166496,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":487,"num_write_kb":123604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":275248,"num_omap_keys":407,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"40'2017","reported_seq":4653,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.113462+0000","last_change":"2023-10-25T23:44:48.113512+0000","last_active":"2023-10-25T23:44:48.113462+0000","last_peered":"2023-10-25T23:44:48.113462+0000","last_clean":"2023-10-25T23:44:48.113462+0000","last_became_active":"2023-10-25T23:36:09.292300+0000","last_became_peered":"2023-10-25T23:36:09.292300+0000","last_unstale":"2023-10-25T23:44:48.113462+0000","last_undegraded":"2023-10-25T23:44:48.113462+0000","last_fullsized":"2023-10-25T23:44:48.113462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2017","last_scrub_stamp":"2023-10-25T23:44:48.113376+0000","last_deep_scrub":"40'2017","last_deep_scrub_stamp":"2023-10-25T23:44:48.113376+0000","last_clean_scrub_stamp":"2023-10-25T23:44:48.113376+0000","objects_scrubbed":3,"log_size":2017,"log_dups_size":0,"ondisk_log_size":2017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:14:52.977935+0000","scrub_duration":0.0058894630000000002,"objects_trimmed":0,"snaptrim_duration":0.041370048,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":2,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":211,"num_read_kb":3693,"num_write":1198,"num_write_kb":20850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"40'229","reported_seq":273,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:44.810353+0000","last_change":"2023-10-25T23:44:44.810353+0000","last_active":"2023-10-25T23:44:44.810353+0000","last_peered":"2023-10-25T23:44:44.810353+0000","last_clean":"2023-10-25T23:44:44.810353+0000","last_became_active":"2023-10-25T23:36:08.274162+0000","last_became_peered":"2023-10-25T23:36:08.274162+0000","last_unstale":"2023-10-25T23:44:44.810353+0000","last_undegraded":"2023-10-25T23:44:44.810353+0000","last_fullsized":"2023-10-25T23:44:44.810353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'229","last_scrub_stamp":"2023-10-25T23:44:44.810222+0000","last_deep_scrub":"40'229","last_deep_scrub_stamp":"2023-10-25T23:44:44.810222+0000","last_clean_scrub_stamp":"2023-10-25T23:44:44.810222+0000","objects_scrubbed":19,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:05:42.612397+0000","scrub_duration":0.067816369000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360162,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":202,"num_write_kb":93162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2596919,"num_omap_keys":4542,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"40'2312","reported_seq":4820,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:01.645542+0000","last_change":"2023-10-25T23:45:01.645594+0000","last_active":"2023-10-25T23:45:01.645542+0000","last_peered":"2023-10-25T23:45:01.645542+0000","last_clean":"2023-10-25T23:45:01.645542+0000","last_became_active":"2023-10-25T23:36:09.284386+0000","last_became_peered":"2023-10-25T23:36:09.284386+0000","last_unstale":"2023-10-25T23:45:01.645542+0000","last_undegraded":"2023-10-25T23:45:01.645542+0000","last_fullsized":"2023-10-25T23:45:01.645542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2312","last_scrub_stamp":"2023-10-25T23:45:01.645430+0000","last_deep_scrub":"40'2312","last_deep_scrub_stamp":"2023-10-25T23:45:01.645430+0000","last_clean_scrub_stamp":"2023-10-25T23:45:01.645430+0000","objects_scrubbed":0,"log_size":2312,"log_dups_size":0,"ondisk_log_size":2312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:02:03.581760+0000","scrub_duration":0.0060352870000000003,"objects_trimmed":0,"snaptrim_duration":0.17573393000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":8533,"num_write":1240,"num_write_kb":24417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"41'191","reported_seq":235,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:49.302476+0000","last_change":"2023-10-25T23:44:49.302547+0000","last_active":"2023-10-25T23:44:49.302476+0000","last_peered":"2023-10-25T23:44:49.302476+0000","last_clean":"2023-10-25T23:44:49.302476+0000","last_became_active":"2023-10-25T23:36:08.271188+0000","last_became_peered":"2023-10-25T23:36:08.271188+0000","last_unstale":"2023-10-25T23:44:49.302476+0000","last_undegraded":"2023-10-25T23:44:49.302476+0000","last_fullsized":"2023-10-25T23:44:49.302476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'191","last_scrub_stamp":"2023-10-25T23:44:49.302368+0000","last_deep_scrub":"41'191","last_deep_scrub_stamp":"2023-10-25T23:44:49.302368+0000","last_clean_scrub_stamp":"2023-10-25T23:44:49.302368+0000","objects_scrubbed":11,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:20:08.912260+0000","scrub_duration":0.028664325000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":160,"num_write_kb":61795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":145850,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"40'2163","reported_seq":4765,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.872822+0000","last_change":"2023-10-25T23:44:39.035067+0000","last_active":"2023-10-25T23:44:47.872822+0000","last_peered":"2023-10-25T23:44:47.872822+0000","last_clean":"2023-10-25T23:44:47.872822+0000","last_became_active":"2023-10-25T23:36:09.294200+0000","last_became_peered":"2023-10-25T23:36:09.294200+0000","last_unstale":"2023-10-25T23:44:47.872822+0000","last_undegraded":"2023-10-25T23:44:47.872822+0000","last_fullsized":"2023-10-25T23:44:47.872822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2163,"log_dups_size":0,"ondisk_log_size":2163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047064776000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":3992,"num_write":1263,"num_write_kb":18428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"41'415","reported_seq":460,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:55.046562+0000","last_change":"2023-10-25T23:44:55.046636+0000","last_active":"2023-10-25T23:44:55.046562+0000","last_peered":"2023-10-25T23:44:55.046562+0000","last_clean":"2023-10-25T23:44:55.046562+0000","last_became_active":"2023-10-25T23:36:08.272301+0000","last_became_peered":"2023-10-25T23:36:08.272301+0000","last_unstale":"2023-10-25T23:44:55.046562+0000","last_undegraded":"2023-10-25T23:44:55.046562+0000","last_fullsized":"2023-10-25T23:44:55.046562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'415","last_scrub_stamp":"2023-10-25T23:44:55.046459+0000","last_deep_scrub":"41'415","last_deep_scrub_stamp":"2023-10-25T23:44:55.046459+0000","last_clean_scrub_stamp":"2023-10-25T23:44:55.046459+0000","objects_scrubbed":27,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:04:17.601081+0000","scrub_duration":0.103266866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":376,"num_write_kb":99496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":428421,"num_omap_keys":766,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"40'2015","reported_seq":4640,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.664869+0000","last_change":"2023-10-25T23:44:39.507532+0000","last_active":"2023-10-25T23:44:48.664869+0000","last_peered":"2023-10-25T23:44:48.664869+0000","last_clean":"2023-10-25T23:44:48.664869+0000","last_became_active":"2023-10-25T23:36:09.291305+0000","last_became_peered":"2023-10-25T23:36:09.291305+0000","last_unstale":"2023-10-25T23:44:48.664869+0000","last_undegraded":"2023-10-25T23:44:48.664869+0000","last_fullsized":"2023-10-25T23:44:48.664869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.044631746999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":3822,"num_write":1210,"num_write_kb":15603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"41'353","reported_seq":397,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:49.036360+0000","last_change":"2023-10-25T23:44:49.036427+0000","last_active":"2023-10-25T23:44:49.036360+0000","last_peered":"2023-10-25T23:44:49.036360+0000","last_clean":"2023-10-25T23:44:49.036360+0000","last_became_active":"2023-10-25T23:36:08.277327+0000","last_became_peered":"2023-10-25T23:36:08.277327+0000","last_unstale":"2023-10-25T23:44:49.036360+0000","last_undegraded":"2023-10-25T23:44:49.036360+0000","last_fullsized":"2023-10-25T23:44:49.036360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'353","last_scrub_stamp":"2023-10-25T23:44:49.036269+0000","last_deep_scrub":"41'353","last_deep_scrub_stamp":"2023-10-25T23:44:49.036269+0000","last_clean_scrub_stamp":"2023-10-25T23:44:49.036269+0000","objects_scrubbed":19,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:59:01.177225+0000","scrub_duration":0.043642932000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":349,"num_write_kb":89245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":985085,"num_omap_keys":1249,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"40'2084","reported_seq":4734,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.872412+0000","last_change":"2023-10-25T23:44:39.024433+0000","last_active":"2023-10-25T23:44:47.872412+0000","last_peered":"2023-10-25T23:44:47.872412+0000","last_clean":"2023-10-25T23:44:47.872412+0000","last_became_active":"2023-10-25T23:36:09.295231+0000","last_became_peered":"2023-10-25T23:36:09.295231+0000","last_unstale":"2023-10-25T23:44:47.872412+0000","last_undegraded":"2023-10-25T23:44:47.872412+0000","last_fullsized":"2023-10-25T23:44:47.872412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2084,"log_dups_size":0,"ondisk_log_size":2084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037920328000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":12104,"num_write":1268,"num_write_kb":24673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"41'408","reported_seq":452,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:51.531914+0000","last_change":"2023-10-25T23:44:51.531995+0000","last_active":"2023-10-25T23:44:51.531914+0000","last_peered":"2023-10-25T23:44:51.531914+0000","last_clean":"2023-10-25T23:44:51.531914+0000","last_became_active":"2023-10-25T23:36:08.263264+0000","last_became_peered":"2023-10-25T23:36:08.263264+0000","last_unstale":"2023-10-25T23:44:51.531914+0000","last_undegraded":"2023-10-25T23:44:51.531914+0000","last_fullsized":"2023-10-25T23:44:51.531914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'408","last_scrub_stamp":"2023-10-25T23:44:51.531833+0000","last_deep_scrub":"41'408","last_deep_scrub_stamp":"2023-10-25T23:44:51.531833+0000","last_clean_scrub_stamp":"2023-10-25T23:44:51.531833+0000","objects_scrubbed":21,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:14:41.177258+0000","scrub_duration":0.064666293999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554454,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":368,"num_write_kb":90831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":303629,"num_omap_keys":534,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"40'2070","reported_seq":4700,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.873422+0000","last_change":"2023-10-25T23:44:39.026687+0000","last_active":"2023-10-25T23:44:47.873422+0000","last_peered":"2023-10-25T23:44:47.873422+0000","last_clean":"2023-10-25T23:44:47.873422+0000","last_became_active":"2023-10-25T23:36:09.294298+0000","last_became_peered":"2023-10-25T23:36:09.294298+0000","last_unstale":"2023-10-25T23:44:47.873422+0000","last_undegraded":"2023-10-25T23:44:47.873422+0000","last_fullsized":"2023-10-25T23:44:47.873422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040324974999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":8972,"num_write":1223,"num_write_kb":21636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"40'339","reported_seq":384,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:45.236992+0000","last_change":"2023-10-25T23:44:45.236992+0000","last_active":"2023-10-25T23:44:45.236992+0000","last_peered":"2023-10-25T23:44:45.236992+0000","last_clean":"2023-10-25T23:44:45.236992+0000","last_became_active":"2023-10-25T23:36:08.277087+0000","last_became_peered":"2023-10-25T23:36:08.277087+0000","last_unstale":"2023-10-25T23:44:45.236992+0000","last_undegraded":"2023-10-25T23:44:45.236992+0000","last_fullsized":"2023-10-25T23:44:45.236992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'339","last_scrub_stamp":"2023-10-25T23:44:45.236835+0000","last_deep_scrub":"40'339","last_deep_scrub_stamp":"2023-10-25T23:44:45.236835+0000","last_clean_scrub_stamp":"2023-10-25T23:44:45.236835+0000","objects_scrubbed":23,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:38:57.739655+0000","scrub_duration":0.071032165999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":307,"num_write_kb":115956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":959437,"num_omap_keys":1709,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"40'2156","reported_seq":4774,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:02.409958+0000","last_change":"2023-10-25T23:45:02.410009+0000","last_active":"2023-10-25T23:45:02.409958+0000","last_peered":"2023-10-25T23:45:02.409958+0000","last_clean":"2023-10-25T23:45:02.409958+0000","last_became_active":"2023-10-25T23:36:50.069951+0000","last_became_peered":"2023-10-25T23:36:50.069951+0000","last_unstale":"2023-10-25T23:45:02.409958+0000","last_undegraded":"2023-10-25T23:45:02.409958+0000","last_fullsized":"2023-10-25T23:45:02.409958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2156","last_scrub_stamp":"2023-10-25T23:45:02.409846+0000","last_deep_scrub":"40'2156","last_deep_scrub_stamp":"2023-10-25T23:45:02.409846+0000","last_clean_scrub_stamp":"2023-10-25T23:45:02.409846+0000","objects_scrubbed":0,"log_size":2156,"log_dups_size":0,"ondisk_log_size":2156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:19:24.191246+0000","scrub_duration":0.0063092230000000001,"objects_trimmed":0,"snaptrim_duration":0.160884052,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":24659,"num_write":1256,"num_write_kb":46504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"41'308","reported_seq":353,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:51.399474+0000","last_change":"2023-10-25T23:44:51.399552+0000","last_active":"2023-10-25T23:44:51.399474+0000","last_peered":"2023-10-25T23:44:51.399474+0000","last_clean":"2023-10-25T23:44:51.399474+0000","last_became_active":"2023-10-25T23:36:08.279302+0000","last_became_peered":"2023-10-25T23:36:08.279302+0000","last_unstale":"2023-10-25T23:44:51.399474+0000","last_undegraded":"2023-10-25T23:44:51.399474+0000","last_fullsized":"2023-10-25T23:44:51.399474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'308","last_scrub_stamp":"2023-10-25T23:44:51.399374+0000","last_deep_scrub":"41'308","last_deep_scrub_stamp":"2023-10-25T23:44:51.399374+0000","last_clean_scrub_stamp":"2023-10-25T23:44:51.399374+0000","objects_scrubbed":16,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:25.858112+0000","scrub_duration":0.073867762000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":257,"num_write_kb":101207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2453176,"num_omap_keys":4372,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"40'2040","reported_seq":4681,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:04.566238+0000","last_change":"2023-10-25T23:45:04.566311+0000","last_active":"2023-10-25T23:45:04.566238+0000","last_peered":"2023-10-25T23:45:04.566238+0000","last_clean":"2023-10-25T23:45:04.566238+0000","last_became_active":"2023-10-25T23:36:09.292670+0000","last_became_peered":"2023-10-25T23:36:09.292670+0000","last_unstale":"2023-10-25T23:45:04.566238+0000","last_undegraded":"2023-10-25T23:45:04.566238+0000","last_fullsized":"2023-10-25T23:45:04.566238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2040","last_scrub_stamp":"2023-10-25T23:45:04.566100+0000","last_deep_scrub":"40'2040","last_deep_scrub_stamp":"2023-10-25T23:45:04.566100+0000","last_clean_scrub_stamp":"2023-10-25T23:45:04.566100+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:26:33.627605+0000","scrub_duration":0.0053032269999999998,"objects_trimmed":0,"snaptrim_duration":0.104196124,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":4275,"num_write":1236,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"40'2118","reported_seq":4728,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.166869+0000","last_change":"2023-10-25T23:44:39.130861+0000","last_active":"2023-10-25T23:44:48.166869+0000","last_peered":"2023-10-25T23:44:48.166869+0000","last_clean":"2023-10-25T23:44:48.166869+0000","last_became_active":"2023-10-25T23:36:09.283766+0000","last_became_peered":"2023-10-25T23:36:09.283766+0000","last_unstale":"2023-10-25T23:44:48.166869+0000","last_undegraded":"2023-10-25T23:44:48.166869+0000","last_fullsized":"2023-10-25T23:44:48.166869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2118,"log_dups_size":0,"ondisk_log_size":2118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055043175999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":3969,"num_write":1247,"num_write_kb":17464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"41'565","reported_seq":903,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:50.098163+0000","last_change":"2023-10-25T23:44:50.098228+0000","last_active":"2023-10-25T23:44:50.098163+0000","last_peered":"2023-10-25T23:44:50.098163+0000","last_clean":"2023-10-25T23:44:50.098163+0000","last_became_active":"2023-10-25T23:36:08.263842+0000","last_became_peered":"2023-10-25T23:36:08.263842+0000","last_unstale":"2023-10-25T23:44:50.098163+0000","last_undegraded":"2023-10-25T23:44:50.098163+0000","last_fullsized":"2023-10-25T23:44:50.098163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'565","last_scrub_stamp":"2023-10-25T23:44:50.098069+0000","last_deep_scrub":"41'565","last_deep_scrub_stamp":"2023-10-25T23:44:50.098069+0000","last_clean_scrub_stamp":"2023-10-25T23:44:50.098069+0000","objects_scrubbed":15,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:37:16.219278+0000","scrub_duration":0.058695506000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":301,"num_read_kb":4287,"num_write":520,"num_write_kb":107914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":890223,"num_omap_keys":1552,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"40'2114","reported_seq":4715,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:02.137087+0000","last_change":"2023-10-25T23:45:02.137146+0000","last_active":"2023-10-25T23:45:02.137087+0000","last_peered":"2023-10-25T23:45:02.137087+0000","last_clean":"2023-10-25T23:45:02.137087+0000","last_became_active":"2023-10-25T23:36:09.295595+0000","last_became_peered":"2023-10-25T23:36:09.295595+0000","last_unstale":"2023-10-25T23:45:02.137087+0000","last_undegraded":"2023-10-25T23:45:02.137087+0000","last_fullsized":"2023-10-25T23:45:02.137087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2114","last_scrub_stamp":"2023-10-25T23:45:02.136918+0000","last_deep_scrub":"40'2114","last_deep_scrub_stamp":"2023-10-25T23:45:02.136918+0000","last_clean_scrub_stamp":"2023-10-25T23:45:02.136918+0000","objects_scrubbed":0,"log_size":2114,"log_dups_size":0,"ondisk_log_size":2114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:26.116142+0000","scrub_duration":0.0051631990000000003,"objects_trimmed":0,"snaptrim_duration":0.038517528000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":3321,"num_write":1232,"num_write_kb":16686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"41'231","reported_seq":276,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:53.344277+0000","last_change":"2023-10-25T23:44:53.344346+0000","last_active":"2023-10-25T23:44:53.344277+0000","last_peered":"2023-10-25T23:44:53.344277+0000","last_clean":"2023-10-25T23:44:53.344277+0000","last_became_active":"2023-10-25T23:36:08.271640+0000","last_became_peered":"2023-10-25T23:36:08.271640+0000","last_unstale":"2023-10-25T23:44:53.344277+0000","last_undegraded":"2023-10-25T23:44:53.344277+0000","last_fullsized":"2023-10-25T23:44:53.344277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'231","last_scrub_stamp":"2023-10-25T23:44:53.344188+0000","last_deep_scrub":"41'231","last_deep_scrub_stamp":"2023-10-25T23:44:53.344188+0000","last_clean_scrub_stamp":"2023-10-25T23:44:53.344188+0000","objects_scrubbed":11,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:50:10.482282+0000","scrub_duration":0.021348121000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":206,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":827399,"num_omap_keys":1449,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"41'119","reported_seq":200,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:57.051874+0000","last_change":"2023-10-25T23:44:57.051994+0000","last_active":"2023-10-25T23:44:57.051874+0000","last_peered":"2023-10-25T23:44:57.051874+0000","last_clean":"2023-10-25T23:44:57.051874+0000","last_became_active":"2023-10-25T23:35:58.276606+0000","last_became_peered":"2023-10-25T23:35:58.276606+0000","last_unstale":"2023-10-25T23:44:57.051874+0000","last_undegraded":"2023-10-25T23:44:57.051874+0000","last_fullsized":"2023-10-25T23:44:57.051874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'119","last_scrub_stamp":"2023-10-25T23:44:57.051784+0000","last_deep_scrub":"41'119","last_deep_scrub_stamp":"2023-10-25T23:44:57.051784+0000","last_clean_scrub_stamp":"2023-10-25T23:44:57.051784+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:35:34.943703+0000","scrub_duration":0.0053083490000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"40'1947","reported_seq":4568,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:53.768499+0000","last_change":"2023-10-25T23:44:53.768591+0000","last_active":"2023-10-25T23:44:53.768499+0000","last_peered":"2023-10-25T23:44:53.768499+0000","last_clean":"2023-10-25T23:44:53.768499+0000","last_became_active":"2023-10-25T23:36:09.291072+0000","last_became_peered":"2023-10-25T23:36:09.291072+0000","last_unstale":"2023-10-25T23:44:53.768499+0000","last_undegraded":"2023-10-25T23:44:53.768499+0000","last_fullsized":"2023-10-25T23:44:53.768499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1947","last_scrub_stamp":"2023-10-25T23:44:53.768341+0000","last_deep_scrub":"40'1947","last_deep_scrub_stamp":"2023-10-25T23:44:53.768341+0000","last_clean_scrub_stamp":"2023-10-25T23:44:53.768341+0000","objects_scrubbed":0,"log_size":1947,"log_dups_size":0,"ondisk_log_size":1947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:51:02.117926+0000","scrub_duration":0.0055393680000000002,"objects_trimmed":0,"snaptrim_duration":0.185957752,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":28650,"num_write":1164,"num_write_kb":22232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"41'257","reported_seq":302,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:04.095508+0000","last_change":"2023-10-25T23:45:04.095628+0000","last_active":"2023-10-25T23:45:04.095508+0000","last_peered":"2023-10-25T23:45:04.095508+0000","last_clean":"2023-10-25T23:45:04.095508+0000","last_became_active":"2023-10-25T23:36:08.277663+0000","last_became_peered":"2023-10-25T23:36:08.277663+0000","last_unstale":"2023-10-25T23:45:04.095508+0000","last_undegraded":"2023-10-25T23:45:04.095508+0000","last_fullsized":"2023-10-25T23:45:04.095508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'257","last_scrub_stamp":"2023-10-25T23:45:04.095393+0000","last_deep_scrub":"41'257","last_deep_scrub_stamp":"2023-10-25T23:45:04.095393+0000","last_clean_scrub_stamp":"2023-10-25T23:45:04.095393+0000","objects_scrubbed":17,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:19:25.876792+0000","scrub_duration":0.044802369000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":226,"num_write_kb":82970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":343372,"num_omap_keys":597,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"38'485","reported_seq":522,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.873124+0000","last_change":"2023-10-25T23:36:08.270783+0000","last_active":"2023-10-25T23:44:47.873124+0000","last_peered":"2023-10-25T23:44:47.873124+0000","last_clean":"2023-10-25T23:44:47.873124+0000","last_became_active":"2023-10-25T23:36:08.269896+0000","last_became_peered":"2023-10-25T23:36:08.269896+0000","last_unstale":"2023-10-25T23:44:47.873124+0000","last_undegraded":"2023-10-25T23:44:47.873124+0000","last_fullsized":"2023-10-25T23:44:47.873124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":446,"num_write_kb":94912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"40'2036","reported_seq":4673,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.167245+0000","last_change":"2023-10-25T23:44:39.130825+0000","last_active":"2023-10-25T23:44:48.167245+0000","last_peered":"2023-10-25T23:44:48.167245+0000","last_clean":"2023-10-25T23:44:48.167245+0000","last_became_active":"2023-10-25T23:36:09.278967+0000","last_became_peered":"2023-10-25T23:36:09.278967+0000","last_unstale":"2023-10-25T23:44:48.167245+0000","last_undegraded":"2023-10-25T23:44:48.167245+0000","last_fullsized":"2023-10-25T23:44:48.167245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055404268,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":3903,"num_write":1243,"num_write_kb":26062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"41'379","reported_seq":424,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:04.342729+0000","last_change":"2023-10-25T23:45:04.342838+0000","last_active":"2023-10-25T23:45:04.342729+0000","last_peered":"2023-10-25T23:45:04.342729+0000","last_clean":"2023-10-25T23:45:04.342729+0000","last_became_active":"2023-10-25T23:36:08.279082+0000","last_became_peered":"2023-10-25T23:36:08.279082+0000","last_unstale":"2023-10-25T23:45:04.342729+0000","last_undegraded":"2023-10-25T23:45:04.342729+0000","last_fullsized":"2023-10-25T23:45:04.342729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'379","last_scrub_stamp":"2023-10-25T23:45:04.342644+0000","last_deep_scrub":"41'379","last_deep_scrub_stamp":"2023-10-25T23:45:04.342644+0000","last_clean_scrub_stamp":"2023-10-25T23:45:04.342644+0000","objects_scrubbed":14,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:44:05.654623+0000","scrub_duration":0.051811070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":470,"num_write_kb":81486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":175294,"num_omap_keys":314,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"40'1963","reported_seq":4575,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.048032+0000","last_change":"2023-10-25T23:44:38.913967+0000","last_active":"2023-10-25T23:44:48.048032+0000","last_peered":"2023-10-25T23:44:48.048032+0000","last_clean":"2023-10-25T23:44:48.048032+0000","last_became_active":"2023-10-25T23:36:09.289751+0000","last_became_peered":"2023-10-25T23:36:09.289751+0000","last_unstale":"2023-10-25T23:44:48.048032+0000","last_undegraded":"2023-10-25T23:44:48.048032+0000","last_fullsized":"2023-10-25T23:44:48.048032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1963,"log_dups_size":0,"ondisk_log_size":1963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039560708999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":4389,"num_write":1130,"num_write_kb":12211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"41'425","reported_seq":470,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:05.052342+0000","last_change":"2023-10-25T23:45:05.052420+0000","last_active":"2023-10-25T23:45:05.052342+0000","last_peered":"2023-10-25T23:45:05.052342+0000","last_clean":"2023-10-25T23:45:05.052342+0000","last_became_active":"2023-10-25T23:36:08.273029+0000","last_became_peered":"2023-10-25T23:36:08.273029+0000","last_unstale":"2023-10-25T23:45:05.052342+0000","last_undegraded":"2023-10-25T23:45:05.052342+0000","last_fullsized":"2023-10-25T23:45:05.052342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'425","last_scrub_stamp":"2023-10-25T23:45:05.052255+0000","last_deep_scrub":"41'425","last_deep_scrub_stamp":"2023-10-25T23:45:05.052255+0000","last_clean_scrub_stamp":"2023-10-25T23:45:05.052255+0000","objects_scrubbed":17,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:44:06.364234+0000","scrub_duration":0.089985721000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":396,"num_write_kb":80384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1784242,"num_omap_keys":3118,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"40'1994","reported_seq":4622,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.665646+0000","last_change":"2023-10-25T23:44:39.657320+0000","last_active":"2023-10-25T23:44:48.665646+0000","last_peered":"2023-10-25T23:44:48.665646+0000","last_clean":"2023-10-25T23:44:48.665646+0000","last_became_active":"2023-10-25T23:36:09.287532+0000","last_became_peered":"2023-10-25T23:36:09.287532+0000","last_unstale":"2023-10-25T23:44:48.665646+0000","last_undegraded":"2023-10-25T23:44:48.665646+0000","last_fullsized":"2023-10-25T23:44:48.665646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.194145863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":4941,"num_write":1181,"num_write_kb":9554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"41'262","reported_seq":307,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:58.158213+0000","last_change":"2023-10-25T23:44:58.158287+0000","last_active":"2023-10-25T23:44:58.158213+0000","last_peered":"2023-10-25T23:44:58.158213+0000","last_clean":"2023-10-25T23:44:58.158213+0000","last_became_active":"2023-10-25T23:36:08.266648+0000","last_became_peered":"2023-10-25T23:36:08.266648+0000","last_unstale":"2023-10-25T23:44:58.158213+0000","last_undegraded":"2023-10-25T23:44:58.158213+0000","last_fullsized":"2023-10-25T23:44:58.158213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'262","last_scrub_stamp":"2023-10-25T23:44:58.158124+0000","last_deep_scrub":"41'262","last_deep_scrub_stamp":"2023-10-25T23:44:58.158124+0000","last_clean_scrub_stamp":"2023-10-25T23:44:58.158124+0000","objects_scrubbed":24,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:39:03.956788+0000","scrub_duration":0.103703136,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":194,"num_write_kb":95518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3191637,"num_omap_keys":4061,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"40'2107","reported_seq":4740,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:54.474516+0000","last_change":"2023-10-25T23:44:54.474641+0000","last_active":"2023-10-25T23:44:54.474516+0000","last_peered":"2023-10-25T23:44:54.474516+0000","last_clean":"2023-10-25T23:44:54.474516+0000","last_became_active":"2023-10-25T23:36:09.284666+0000","last_became_peered":"2023-10-25T23:36:09.284666+0000","last_unstale":"2023-10-25T23:44:54.474516+0000","last_undegraded":"2023-10-25T23:44:54.474516+0000","last_fullsized":"2023-10-25T23:44:54.474516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2107","last_scrub_stamp":"2023-10-25T23:44:54.474411+0000","last_deep_scrub":"40'2107","last_deep_scrub_stamp":"2023-10-25T23:44:54.474411+0000","last_clean_scrub_stamp":"2023-10-25T23:44:54.474411+0000","objects_scrubbed":0,"log_size":2107,"log_dups_size":0,"ondisk_log_size":2107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:59:09.268570+0000","scrub_duration":0.0048174560000000003,"objects_trimmed":0,"snaptrim_duration":0.075073965000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":4417,"num_write":1270,"num_write_kb":29307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"36'390","reported_seq":427,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.166909+0000","last_change":"2023-10-25T23:36:08.278162+0000","last_active":"2023-10-25T23:44:48.166909+0000","last_peered":"2023-10-25T23:44:48.166909+0000","last_clean":"2023-10-25T23:44:48.166909+0000","last_became_active":"2023-10-25T23:36:08.277873+0000","last_became_peered":"2023-10-25T23:36:08.277873+0000","last_unstale":"2023-10-25T23:44:48.166909+0000","last_undegraded":"2023-10-25T23:44:48.166909+0000","last_fullsized":"2023-10-25T23:44:48.166909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:07.244986+0000","last_clean_scrub_stamp":"2023-10-25T23:36:07.244986+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":385,"num_write_kb":96608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"40'2140","reported_seq":4761,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.047944+0000","last_change":"2023-10-25T23:44:38.911081+0000","last_active":"2023-10-25T23:44:48.047944+0000","last_peered":"2023-10-25T23:44:48.047944+0000","last_clean":"2023-10-25T23:44:48.047944+0000","last_became_active":"2023-10-25T23:36:09.289320+0000","last_became_peered":"2023-10-25T23:36:09.289320+0000","last_unstale":"2023-10-25T23:44:48.047944+0000","last_undegraded":"2023-10-25T23:44:48.047944+0000","last_fullsized":"2023-10-25T23:44:48.047944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2140,"log_dups_size":0,"ondisk_log_size":2140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037048923999999997,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":230,"num_read_kb":4443,"num_write":1269,"num_write_kb":26048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"41'641","reported_seq":686,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:58.338708+0000","last_change":"2023-10-25T23:44:58.338811+0000","last_active":"2023-10-25T23:44:58.338708+0000","last_peered":"2023-10-25T23:44:58.338708+0000","last_clean":"2023-10-25T23:44:58.338708+0000","last_became_active":"2023-10-25T23:36:08.278656+0000","last_became_peered":"2023-10-25T23:36:08.278656+0000","last_unstale":"2023-10-25T23:44:58.338708+0000","last_undegraded":"2023-10-25T23:44:58.338708+0000","last_fullsized":"2023-10-25T23:44:58.338708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'641","last_scrub_stamp":"2023-10-25T23:44:58.338617+0000","last_deep_scrub":"41'641","last_deep_scrub_stamp":"2023-10-25T23:44:58.338617+0000","last_clean_scrub_stamp":"2023-10-25T23:44:58.338617+0000","objects_scrubbed":23,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:34:14.170088+0000","scrub_duration":0.089561260000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":598,"num_write_kb":115954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":812553,"num_omap_keys":1430,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"40'2112","reported_seq":4717,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:57.063618+0000","last_change":"2023-10-25T23:44:57.063664+0000","last_active":"2023-10-25T23:44:57.063618+0000","last_peered":"2023-10-25T23:44:57.063618+0000","last_clean":"2023-10-25T23:44:57.063618+0000","last_became_active":"2023-10-25T23:36:09.292345+0000","last_became_peered":"2023-10-25T23:36:09.292345+0000","last_unstale":"2023-10-25T23:44:57.063618+0000","last_undegraded":"2023-10-25T23:44:57.063618+0000","last_fullsized":"2023-10-25T23:44:57.063618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2112","last_scrub_stamp":"2023-10-25T23:44:57.063525+0000","last_deep_scrub":"40'2112","last_deep_scrub_stamp":"2023-10-25T23:44:57.063525+0000","last_clean_scrub_stamp":"2023-10-25T23:44:57.063525+0000","objects_scrubbed":0,"log_size":2112,"log_dups_size":0,"ondisk_log_size":2112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:35:34.955444+0000","scrub_duration":0.0042181479999999997,"objects_trimmed":0,"snaptrim_duration":0.039941503000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":8471,"num_write":1242,"num_write_kb":22974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"41'431","reported_seq":475,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:05.082146+0000","last_change":"2023-10-25T23:45:05.082243+0000","last_active":"2023-10-25T23:45:05.082146+0000","last_peered":"2023-10-25T23:45:05.082146+0000","last_clean":"2023-10-25T23:45:05.082146+0000","last_became_active":"2023-10-25T23:36:08.268753+0000","last_became_peered":"2023-10-25T23:36:08.268753+0000","last_unstale":"2023-10-25T23:45:05.082146+0000","last_undegraded":"2023-10-25T23:45:05.082146+0000","last_fullsized":"2023-10-25T23:45:05.082146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'431","last_scrub_stamp":"2023-10-25T23:45:05.082053+0000","last_deep_scrub":"41'431","last_deep_scrub_stamp":"2023-10-25T23:45:05.082053+0000","last_clean_scrub_stamp":"2023-10-25T23:45:05.082053+0000","objects_scrubbed":15,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:24.276423+0000","scrub_duration":0.047061694000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":415,"num_write_kb":99792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":353948,"num_omap_keys":624,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"40'2029","reported_seq":4660,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.665116+0000","last_change":"2023-10-25T23:44:39.510909+0000","last_active":"2023-10-25T23:44:48.665116+0000","last_peered":"2023-10-25T23:44:48.665116+0000","last_clean":"2023-10-25T23:44:48.665116+0000","last_became_active":"2023-10-25T23:36:09.290151+0000","last_became_peered":"2023-10-25T23:36:09.290151+0000","last_unstale":"2023-10-25T23:44:48.665116+0000","last_undegraded":"2023-10-25T23:44:48.665116+0000","last_fullsized":"2023-10-25T23:44:48.665116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2029,"log_dups_size":0,"ondisk_log_size":2029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.047955154,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":5633,"num_write":1198,"num_write_kb":13442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"41'239","reported_seq":283,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.059552+0000","last_change":"2023-10-25T23:44:48.059663+0000","last_active":"2023-10-25T23:44:48.059552+0000","last_peered":"2023-10-25T23:44:48.059552+0000","last_clean":"2023-10-25T23:44:48.059552+0000","last_became_active":"2023-10-25T23:36:08.271846+0000","last_became_peered":"2023-10-25T23:36:08.271846+0000","last_unstale":"2023-10-25T23:44:48.059552+0000","last_undegraded":"2023-10-25T23:44:48.059552+0000","last_fullsized":"2023-10-25T23:44:48.059552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'239","last_scrub_stamp":"2023-10-25T23:44:48.059439+0000","last_deep_scrub":"41'239","last_deep_scrub_stamp":"2023-10-25T23:44:48.059439+0000","last_clean_scrub_stamp":"2023-10-25T23:44:48.059439+0000","objects_scrubbed":13,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:23:30.202942+0000","scrub_duration":0.071935235,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":195,"num_write_kb":98810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":281074,"num_omap_keys":484,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"40'2031","reported_seq":4645,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.873101+0000","last_change":"2023-10-25T23:44:39.033539+0000","last_active":"2023-10-25T23:44:47.873101+0000","last_peered":"2023-10-25T23:44:47.873101+0000","last_clean":"2023-10-25T23:44:47.873101+0000","last_became_active":"2023-10-25T23:36:09.295635+0000","last_became_peered":"2023-10-25T23:36:09.295635+0000","last_unstale":"2023-10-25T23:44:47.873101+0000","last_undegraded":"2023-10-25T23:44:47.873101+0000","last_fullsized":"2023-10-25T23:44:47.873101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.046467368000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":10038,"num_write":1186,"num_write_kb":32237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"41'466","reported_seq":510,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.225625+0000","last_change":"2023-10-25T23:44:48.225686+0000","last_active":"2023-10-25T23:44:48.225625+0000","last_peered":"2023-10-25T23:44:48.225625+0000","last_clean":"2023-10-25T23:44:48.225625+0000","last_became_active":"2023-10-25T23:36:08.277344+0000","last_became_peered":"2023-10-25T23:36:08.277344+0000","last_unstale":"2023-10-25T23:44:48.225625+0000","last_undegraded":"2023-10-25T23:44:48.225625+0000","last_fullsized":"2023-10-25T23:44:48.225625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'466","last_scrub_stamp":"2023-10-25T23:44:48.225545+0000","last_deep_scrub":"41'466","last_deep_scrub_stamp":"2023-10-25T23:44:48.225545+0000","last_clean_scrub_stamp":"2023-10-25T23:44:48.225545+0000","objects_scrubbed":24,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:28:40.923648+0000","scrub_duration":0.059957362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25170780,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":452,"num_write_kb":113081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1826286,"num_omap_keys":3161,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"40'2042","reported_seq":4670,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.989933+0000","last_change":"2023-10-25T23:44:39.116670+0000","last_active":"2023-10-25T23:44:47.989933+0000","last_peered":"2023-10-25T23:44:47.989933+0000","last_clean":"2023-10-25T23:44:47.989933+0000","last_became_active":"2023-10-25T23:36:09.299234+0000","last_became_peered":"2023-10-25T23:36:09.299234+0000","last_unstale":"2023-10-25T23:44:47.989933+0000","last_undegraded":"2023-10-25T23:44:47.989933+0000","last_fullsized":"2023-10-25T23:44:47.989933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.15372042599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":4213,"num_write":1231,"num_write_kb":8559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"40'482","reported_seq":526,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:46.025275+0000","last_change":"2023-10-25T23:44:46.025275+0000","last_active":"2023-10-25T23:44:46.025275+0000","last_peered":"2023-10-25T23:44:46.025275+0000","last_clean":"2023-10-25T23:44:46.025275+0000","last_became_active":"2023-10-25T23:36:08.269065+0000","last_became_peered":"2023-10-25T23:36:08.269065+0000","last_unstale":"2023-10-25T23:44:46.025275+0000","last_undegraded":"2023-10-25T23:44:46.025275+0000","last_fullsized":"2023-10-25T23:44:46.025275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'482","last_scrub_stamp":"2023-10-25T23:44:46.025130+0000","last_deep_scrub":"40'482","last_deep_scrub_stamp":"2023-10-25T23:44:46.025130+0000","last_clean_scrub_stamp":"2023-10-25T23:44:46.025130+0000","objects_scrubbed":16,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:34:52.570294+0000","scrub_duration":0.049678989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":460,"num_write_kb":103224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":431890,"num_omap_keys":741,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"40'2036","reported_seq":4669,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.872871+0000","last_change":"2023-10-25T23:44:39.030671+0000","last_active":"2023-10-25T23:44:47.872871+0000","last_peered":"2023-10-25T23:44:47.872871+0000","last_clean":"2023-10-25T23:44:47.872871+0000","last_became_active":"2023-10-25T23:36:09.294494+0000","last_became_peered":"2023-10-25T23:36:09.294494+0000","last_unstale":"2023-10-25T23:44:47.872871+0000","last_undegraded":"2023-10-25T23:44:47.872871+0000","last_fullsized":"2023-10-25T23:44:47.872871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043914717999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":9037,"num_write":1232,"num_write_kb":21545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"40'2057","reported_seq":4704,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.664833+0000","last_change":"2023-10-25T23:44:39.510985+0000","last_active":"2023-10-25T23:44:48.664833+0000","last_peered":"2023-10-25T23:44:48.664833+0000","last_clean":"2023-10-25T23:44:48.664833+0000","last_became_active":"2023-10-25T23:36:09.291665+0000","last_became_peered":"2023-10-25T23:36:09.291665+0000","last_unstale":"2023-10-25T23:44:48.664833+0000","last_undegraded":"2023-10-25T23:44:48.664833+0000","last_fullsized":"2023-10-25T23:44:48.664833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2057,"log_dups_size":0,"ondisk_log_size":2057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048033508000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":23343,"num_write":1242,"num_write_kb":29102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"40'2179","reported_seq":4794,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:53.099051+0000","last_change":"2023-10-25T23:44:53.099104+0000","last_active":"2023-10-25T23:44:53.099051+0000","last_peered":"2023-10-25T23:44:53.099051+0000","last_clean":"2023-10-25T23:44:53.099051+0000","last_became_active":"2023-10-25T23:36:09.295817+0000","last_became_peered":"2023-10-25T23:36:09.295817+0000","last_unstale":"2023-10-25T23:44:53.099051+0000","last_undegraded":"2023-10-25T23:44:53.099051+0000","last_fullsized":"2023-10-25T23:44:53.099051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2179","last_scrub_stamp":"2023-10-25T23:44:53.098932+0000","last_deep_scrub":"40'2179","last_deep_scrub_stamp":"2023-10-25T23:44:53.098932+0000","last_clean_scrub_stamp":"2023-10-25T23:44:53.098932+0000","objects_scrubbed":0,"log_size":2179,"log_dups_size":0,"ondisk_log_size":2179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:52:57.502348+0000","scrub_duration":0.006673806,"objects_trimmed":0,"snaptrim_duration":0.038422899000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":12397,"num_write":1283,"num_write_kb":33443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"40'2078","reported_seq":4696,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.989981+0000","last_change":"2023-10-25T23:44:39.109561+0000","last_active":"2023-10-25T23:44:47.989981+0000","last_peered":"2023-10-25T23:44:47.989981+0000","last_clean":"2023-10-25T23:44:47.989981+0000","last_became_active":"2023-10-25T23:36:09.299024+0000","last_became_peered":"2023-10-25T23:36:09.299024+0000","last_unstale":"2023-10-25T23:44:47.989981+0000","last_undegraded":"2023-10-25T23:44:47.989981+0000","last_fullsized":"2023-10-25T23:44:47.989981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2078,"log_dups_size":0,"ondisk_log_size":2078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14682810099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":4357,"num_write":1220,"num_write_kb":7384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"40'2239","reported_seq":4816,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.665107+0000","last_change":"2023-10-25T23:44:39.676541+0000","last_active":"2023-10-25T23:44:48.665107+0000","last_peered":"2023-10-25T23:44:48.665107+0000","last_clean":"2023-10-25T23:44:48.665107+0000","last_became_active":"2023-10-25T23:36:09.292344+0000","last_became_peered":"2023-10-25T23:36:09.292344+0000","last_unstale":"2023-10-25T23:44:48.665107+0000","last_undegraded":"2023-10-25T23:44:48.665107+0000","last_fullsized":"2023-10-25T23:44:48.665107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2239,"log_dups_size":0,"ondisk_log_size":2239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21297281000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":3547,"num_write":1298,"num_write_kb":27693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"40'2020","reported_seq":4633,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:06.023530+0000","last_change":"2023-10-25T23:45:06.023588+0000","last_active":"2023-10-25T23:45:06.023530+0000","last_peered":"2023-10-25T23:45:06.023530+0000","last_clean":"2023-10-25T23:45:06.023530+0000","last_became_active":"2023-10-25T23:36:09.297202+0000","last_became_peered":"2023-10-25T23:36:09.297202+0000","last_unstale":"2023-10-25T23:45:06.023530+0000","last_undegraded":"2023-10-25T23:45:06.023530+0000","last_fullsized":"2023-10-25T23:45:06.023530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2020","last_scrub_stamp":"2023-10-25T23:45:06.023406+0000","last_deep_scrub":"40'2020","last_deep_scrub_stamp":"2023-10-25T23:45:06.023406+0000","last_clean_scrub_stamp":"2023-10-25T23:45:06.023406+0000","objects_scrubbed":0,"log_size":2020,"log_dups_size":0,"ondisk_log_size":2020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:25.217776+0000","scrub_duration":0.0053996699999999996,"objects_trimmed":0,"snaptrim_duration":0.040736076000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":7838,"num_write":1164,"num_write_kb":15586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"40'2026","reported_seq":4737,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.167472+0000","last_change":"2023-10-25T23:44:39.127944+0000","last_active":"2023-10-25T23:44:48.167472+0000","last_peered":"2023-10-25T23:44:48.167472+0000","last_clean":"2023-10-25T23:44:48.167472+0000","last_became_active":"2023-10-25T23:36:09.293157+0000","last_became_peered":"2023-10-25T23:36:09.293157+0000","last_unstale":"2023-10-25T23:44:48.167472+0000","last_undegraded":"2023-10-25T23:44:48.167472+0000","last_fullsized":"2023-10-25T23:44:48.167472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052457090999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":301,"num_read_kb":22462,"num_write":1198,"num_write_kb":27011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"40'2171","reported_seq":4776,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.666198+0000","last_change":"2023-10-25T23:44:39.519493+0000","last_active":"2023-10-25T23:44:48.666198+0000","last_peered":"2023-10-25T23:44:48.666198+0000","last_clean":"2023-10-25T23:44:48.666198+0000","last_became_active":"2023-10-25T23:36:09.288127+0000","last_became_peered":"2023-10-25T23:36:09.288127+0000","last_unstale":"2023-10-25T23:44:48.666198+0000","last_undegraded":"2023-10-25T23:44:48.666198+0000","last_fullsized":"2023-10-25T23:44:48.666198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2171,"log_dups_size":0,"ondisk_log_size":2171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.055712415000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":4655,"num_write":1304,"num_write_kb":14899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"40'1998","reported_seq":4629,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.047861+0000","last_change":"2023-10-25T23:44:38.912556+0000","last_active":"2023-10-25T23:44:48.047861+0000","last_peered":"2023-10-25T23:44:48.047861+0000","last_clean":"2023-10-25T23:44:48.047861+0000","last_became_active":"2023-10-25T23:36:09.290160+0000","last_became_peered":"2023-10-25T23:36:09.290160+0000","last_unstale":"2023-10-25T23:44:48.047861+0000","last_undegraded":"2023-10-25T23:44:48.047861+0000","last_fullsized":"2023-10-25T23:44:48.047861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1998,"log_dups_size":0,"ondisk_log_size":1998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038380149000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":16054,"num_write":1171,"num_write_kb":30881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"40'2015","reported_seq":4656,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:01.359181+0000","last_change":"2023-10-25T23:45:01.359231+0000","last_active":"2023-10-25T23:45:01.359181+0000","last_peered":"2023-10-25T23:45:01.359181+0000","last_clean":"2023-10-25T23:45:01.359181+0000","last_became_active":"2023-10-25T23:36:09.298637+0000","last_became_peered":"2023-10-25T23:36:09.298637+0000","last_unstale":"2023-10-25T23:45:01.359181+0000","last_undegraded":"2023-10-25T23:45:01.359181+0000","last_fullsized":"2023-10-25T23:45:01.359181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2015","last_scrub_stamp":"2023-10-25T23:45:01.359064+0000","last_deep_scrub":"40'2015","last_deep_scrub_stamp":"2023-10-25T23:45:01.359064+0000","last_clean_scrub_stamp":"2023-10-25T23:45:01.359064+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:40:54.188454+0000","scrub_duration":0.0052526810000000004,"objects_trimmed":0,"snaptrim_duration":0.16094475499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":3413,"num_write":1198,"num_write_kb":11362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"40'1990","reported_seq":4626,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.047488+0000","last_change":"2023-10-25T23:44:38.916920+0000","last_active":"2023-10-25T23:44:48.047488+0000","last_peered":"2023-10-25T23:44:48.047488+0000","last_clean":"2023-10-25T23:44:48.047488+0000","last_became_active":"2023-10-25T23:36:09.290546+0000","last_became_peered":"2023-10-25T23:36:09.290546+0000","last_unstale":"2023-10-25T23:44:48.047488+0000","last_undegraded":"2023-10-25T23:44:48.047488+0000","last_fullsized":"2023-10-25T23:44:48.047488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1990,"log_dups_size":0,"ondisk_log_size":1990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041791974000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":7180,"num_write":1206,"num_write_kb":23829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"40'2170","reported_seq":4755,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.166984+0000","last_change":"2023-10-25T23:44:39.133956+0000","last_active":"2023-10-25T23:44:48.166984+0000","last_peered":"2023-10-25T23:44:48.166984+0000","last_clean":"2023-10-25T23:44:48.166984+0000","last_became_active":"2023-10-25T23:36:50.102780+0000","last_became_peered":"2023-10-25T23:36:50.102780+0000","last_unstale":"2023-10-25T23:44:48.166984+0000","last_undegraded":"2023-10-25T23:44:48.166984+0000","last_fullsized":"2023-10-25T23:44:48.166984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2170,"log_dups_size":0,"ondisk_log_size":2170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058087943000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":4977,"num_write":1244,"num_write_kb":20718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"40'2082","reported_seq":4701,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.664967+0000","last_change":"2023-10-25T23:44:39.657317+0000","last_active":"2023-10-25T23:44:48.664967+0000","last_peered":"2023-10-25T23:44:48.664967+0000","last_clean":"2023-10-25T23:44:48.664967+0000","last_became_active":"2023-10-25T23:36:09.285610+0000","last_became_peered":"2023-10-25T23:36:09.285610+0000","last_unstale":"2023-10-25T23:44:48.664967+0000","last_undegraded":"2023-10-25T23:44:48.664967+0000","last_fullsized":"2023-10-25T23:44:48.664967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2082,"log_dups_size":0,"ondisk_log_size":2082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19375678499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":4129,"num_write":1211,"num_write_kb":11664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"40'2134","reported_seq":4757,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.665158+0000","last_change":"2023-10-25T23:44:39.516069+0000","last_active":"2023-10-25T23:44:48.665158+0000","last_peered":"2023-10-25T23:44:48.665158+0000","last_clean":"2023-10-25T23:44:48.665158+0000","last_became_active":"2023-10-25T23:36:09.291566+0000","last_became_peered":"2023-10-25T23:36:09.291566+0000","last_unstale":"2023-10-25T23:44:48.665158+0000","last_undegraded":"2023-10-25T23:44:48.665158+0000","last_fullsized":"2023-10-25T23:44:48.665158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2134,"log_dups_size":0,"ondisk_log_size":2134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052820837000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":9012,"num_write":1282,"num_write_kb":25857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":13919,"num_read_kb":527624,"num_write":78511,"num_write_kb":1459527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":40,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133209,"ondisk_log_size":133209,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":885503921,"num_objects":563,"num_object_clones":0,"num_object_copies":1126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":563,"num_whiteouts":0,"num_read":739,"num_read_kb":4869,"num_write":13298,"num_write_kb":3083597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":344,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31612910,"num_omap_keys":53111,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1771069440,"data_stored":1771007842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14208,"ondisk_log_size":14208,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574963,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":431200,"kb_used_data":295960,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":93940640,"statfs":{"total":96636764160,"available":96195215360,"internally_reserved":0,"allocated":303063040,"data_stored":302784975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":138475979},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.72999999999999998,"15min":0.59599999999999997},"min":{"1min":0.26800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.67100000000000004,"5min":34.116999999999997,"15min":34.116999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.50600000000000001},"min":{"1min":0.317,"5min":0.222,"15min":0.222},"max":{"1min":0.73899999999999999,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.60399999999999998}]},{"osd":1,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.76400000000000001,"15min":0.61399999999999999},"min":{"1min":0.29599999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65200000000000002,"5min":34.424999999999997,"15min":34.424999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.77300000000000002,"15min":0.62},"min":{"1min":0.35099999999999998,"5min":0.29599999999999999,"15min":0.28100000000000003},"max":{"1min":0.79900000000000004,"5min":32.781999999999996,"15min":32.781999999999996},"last":0.626}]},{"osd":2,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48499999999999999,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60599999999999998,"5min":1.964,"15min":1.964},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.79200000000000004,"15min":0.63900000000000001},"min":{"1min":0.34399999999999997,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.76600000000000001,"5min":34.066000000000003,"15min":34.066000000000003},"last":0.54300000000000004}]},{"osd":3,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.94899999999999995,"15min":0.68400000000000005},"min":{"1min":0.40699999999999997,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.622,"5min":50.606999999999999,"15min":50.606999999999999},"last":0.442},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.89900000000000002,"15min":0.68899999999999995},"min":{"1min":0.41199999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.89200000000000002,"5min":41.027999999999999,"15min":41.027999999999999},"last":0.58199999999999996}]},{"osd":4,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.72999999999999998,"15min":0.55500000000000005},"min":{"1min":0.33400000000000002,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.82499999999999996,"5min":28,"15min":28},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.76000000000000001,"15min":0.59799999999999998},"min":{"1min":0.46899999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.177,"5min":28.25,"15min":28.25},"last":0.50800000000000001}]},{"osd":5,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.84499999999999997,"15min":0.63400000000000001},"min":{"1min":0.437,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.79200000000000004,"5min":34.393000000000001,"15min":34.393000000000001},"last":0.375},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64200000000000002,"15min":0.58299999999999996},"min":{"1min":0.40500000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.84499999999999997,"5min":10.099,"15min":10.099},"last":0.56799999999999995}]},{"osd":6,"last update":"Wed Oct 25 23:44:15 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.72999999999999998,"15min":0.621},"min":{"1min":0.45100000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.97999999999999998,"5min":18.271999999999998,"15min":18.271999999999998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.98599999999999999,"15min":0.71599999999999997},"min":{"1min":0.53200000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.369,"5min":47.531999999999996,"15min":47.531999999999996},"last":0.46500000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574961,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":358336,"kb_used_data":246712,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94013504,"statfs":{"total":96636764160,"available":96269828096,"internally_reserved":0,"allocated":252633088,"data_stored":252362455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":114293191},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45000000000000001,"15min":0.51200000000000001},"min":{"1min":0.26400000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.623,"5min":3.3140000000000001,"15min":3.3140000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.53900000000000003,"15min":0.54400000000000004},"min":{"1min":0.35499999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56599999999999995,"5min":11.619,"15min":11.619},"last":0.47399999999999998}]},{"osd":1,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.5,"15min":0.53600000000000003},"min":{"1min":0.27500000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.68899999999999995,"5min":3.468,"15min":3.468},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.51200000000000001,"15min":0.56000000000000005},"min":{"1min":0.30599999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.64600000000000002,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.622}]},{"osd":2,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.61199999999999999,"15min":0.57399999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":6.327,"5min":11.683999999999999,"15min":11.683999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.58899999999999997,"15min":0.55800000000000005},"min":{"1min":0.32800000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81399999999999995,"5min":11.784000000000001,"15min":11.784000000000001},"last":0.58099999999999996}]},{"osd":3,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":1.071,"15min":0.77300000000000002},"min":{"1min":0.33900000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84499999999999997,"5min":61.121000000000002,"15min":61.121000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54200000000000004,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.374,"15min":0.36499999999999999},"max":{"1min":0.80000000000000004,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.67700000000000005}]},{"osd":4,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60299999999999998,"15min":0.54400000000000004},"min":{"1min":0.35099999999999998,"5min":0.27600000000000002,"15min":0.23200000000000001},"max":{"1min":0.91900000000000004,"5min":12.169,"15min":12.169},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.623,"15min":0.57699999999999996},"min":{"1min":0.44700000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85699999999999998,"5min":11.554,"15min":11.554},"last":0.60699999999999998}]},{"osd":5,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.62,"15min":0.55800000000000005},"min":{"1min":0.33400000000000002,"5min":0.26100000000000001,"15min":0.245},"max":{"1min":0.77600000000000002,"5min":11.755000000000001,"15min":11.755000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.40300000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.89000000000000001,"5min":3.2879999999999998,"15min":3.2879999999999998},"last":0.53800000000000003}]},{"osd":7,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.96099999999999997,"15min":0.71599999999999997},"min":{"1min":0.48099999999999998,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.89500000000000002,"5min":29.977,"15min":29.977},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.97299999999999998,"15min":0.71599999999999997},"min":{"1min":0.42399999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.874,"5min":29.925000000000001,"15min":29.925000000000001},"last":0.69099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361884,"kb_used_data":254420,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94009956,"statfs":{"total":96636764160,"available":96266194944,"internally_reserved":0,"allocated":260526080,"data_stored":260256021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.378,"15min":0.36699999999999999},"min":{"1min":0.17799999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.44600000000000001,"5min":4.2839999999999998,"15min":6.9370000000000003},"last":0.502},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.94999999999999996,"15min":0.54900000000000004},"min":{"1min":0.22,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.48199999999999998,"5min":66.522000000000006,"15min":66.522000000000006},"last":0.375}]},{"osd":2,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35299999999999998,"15min":0.34799999999999998},"min":{"1min":0.23999999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.53200000000000003,"5min":4.9180000000000001,"15min":4.9180000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41199999999999998,"15min":0.39000000000000001},"min":{"1min":0.247,"5min":0.186,"15min":0.186},"max":{"1min":0.54900000000000004,"5min":4.2060000000000004,"15min":4.2060000000000004},"last":0.55500000000000005}]},{"osd":3,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.60399999999999998,"15min":0.46800000000000003},"min":{"1min":0.26900000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.56999999999999995,"5min":21.943000000000001,"15min":21.943000000000001},"last":0.434},{"interface":"front","average":{"1min":0.379,"5min":0.60199999999999998,"15min":0.47699999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.55800000000000005,"5min":23.300999999999998,"15min":23.300999999999998},"last":0.48199999999999998}]},{"osd":4,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.67700000000000005,"15min":0.57899999999999996},"min":{"1min":0.35099999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.94999999999999996,"5min":14.066000000000001,"15min":14.066000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.622,"15min":0.58199999999999996},"min":{"1min":0.44,"5min":0.35199999999999998,"15min":0.32500000000000001},"max":{"1min":0.89700000000000002,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":0.76400000000000001}]},{"osd":5,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.57099999999999995},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.33300000000000002},"max":{"1min":0.90500000000000003,"5min":2.0830000000000002,"15min":2.0830000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.39700000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82499999999999996,"5min":4.9960000000000004,"15min":9.7650000000000006},"last":0.88600000000000001}]},{"osd":6,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64600000000000002,"15min":0.60799999999999998},"min":{"1min":0.46999999999999997,"5min":0.313,"15min":0.313},"max":{"1min":0.83699999999999997,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.78200000000000003,"15min":0.65100000000000002},"min":{"1min":0.438,"5min":0.38400000000000001,"15min":0.35399999999999998},"max":{"1min":0.86599999999999999,"5min":21.876000000000001,"15min":21.876000000000001},"last":0.77500000000000002}]},{"osd":7,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93200000000000005,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.76100000000000001,"15min":0.65200000000000002},"min":{"1min":0.44,"5min":0.371,"15min":0.36399999999999999},"max":{"1min":1.6850000000000001,"5min":18.754999999999999,"15min":18.754999999999999},"last":0.91700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574962,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":373980,"kb_used_data":230420,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":93997860,"statfs":{"total":96636764160,"available":96253808640,"internally_reserved":0,"allocated":235950080,"data_stored":235676152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.375,"15min":0.35899999999999999},"min":{"1min":0.26900000000000002,"5min":0.20200000000000001,"15min":0.17899999999999999},"max":{"1min":1.365,"5min":4.649,"15min":4.649},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39000000000000001,"15min":0.36399999999999999},"min":{"1min":0.23699999999999999,"5min":0.20499999999999999,"15min":0.19400000000000001},"max":{"1min":1.641,"5min":5.1589999999999998,"15min":5.1589999999999998},"last":0.36099999999999999}]},{"osd":2,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.38200000000000001},"min":{"1min":0.23699999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":1.423,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.42899999999999999,"15min":0.40600000000000003},"min":{"1min":0.251,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53700000000000003,"5min":7.6870000000000003,"15min":7.6870000000000003},"last":0.443}]},{"osd":3,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.435,"15min":0.39300000000000002},"min":{"1min":0.28000000000000003,"5min":0.23999999999999999,"15min":0.23899999999999999},"max":{"1min":2.0819999999999999,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.312},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.47299999999999998,"15min":0.442},"min":{"1min":0.313,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":1.954,"5min":5.0750000000000002,"15min":5.0750000000000002},"last":0.46100000000000002}]},{"osd":4,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59999999999999998,"15min":0.58099999999999996},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.67100000000000004,"5min":5.9729999999999999,"15min":5.9729999999999999},"last":0.621},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.62,"15min":0.58799999999999997},"min":{"1min":0.35299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.3769999999999998,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.55600000000000005}]},{"osd":5,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63400000000000001,"15min":0.63200000000000001},"min":{"1min":0.438,"5min":0.375,"15min":0.32300000000000001},"max":{"1min":1.3939999999999999,"5min":5.1120000000000001,"15min":8.5169999999999995},"last":0.503},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.65000000000000002,"15min":0.60399999999999998},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.84199999999999997,"5min":6.0199999999999996,"15min":6.0199999999999996},"last":0.53700000000000003}]},{"osd":6,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.624,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.4369999999999998,"5min":4.9850000000000003,"15min":4.9850000000000003},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.46899999999999997,"5min":0.38100000000000001,"15min":0.32200000000000001},"max":{"1min":1.4510000000000001,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.56899999999999995}]},{"osd":7,"last update":"Wed Oct 25 23:44:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.66200000000000003,"15min":0.66300000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84899999999999998,"5min":6.0720000000000001,"15min":8.4979999999999993},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.65100000000000002,"15min":0.60699999999999998},"min":{"1min":0.47499999999999998,"5min":0.374,"15min":0.374},"max":{"1min":2.411,"5min":4.883,"15min":4.883},"last":0.47899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574964,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188108,"kb_used_data":102852,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94183732,"statfs":{"total":96636764160,"available":96444141568,"internally_reserved":0,"allocated":105320448,"data_stored":105061722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.32600000000000001,"15min":0.82799999999999996},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.79600000000000004,"5min":2.7269999999999999,"15min":18.052},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.371},"min":{"1min":0.222,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.0389999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.55000000000000004}]},{"osd":1,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33900000000000002,"15min":0.85199999999999998},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.82899999999999996,"5min":1.03,"15min":18.175000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33300000000000002,"15min":0.64500000000000002},"min":{"1min":0.251,"5min":0.22900000000000001,"15min":0.22700000000000001},"max":{"1min":0.49299999999999999,"5min":0.50800000000000001,"15min":10.23},"last":0.60699999999999998}]},{"osd":3,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.35999999999999999,"15min":0.89200000000000002},"min":{"1min":0.24099999999999999,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":0.84699999999999998,"5min":0.97999999999999998,"15min":18.236000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.42499999999999999,"15min":0.92300000000000004},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":18.004999999999999},"last":0.432}]},{"osd":4,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54600000000000004,"15min":0.76900000000000002},"min":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.32100000000000001},"max":{"1min":0.75700000000000001,"5min":1.2589999999999999,"15min":8.1839999999999993},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55500000000000005,"15min":0.58499999999999996},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.518,"5min":1.518,"15min":2.4580000000000002},"last":0.70399999999999996}]},{"osd":5,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54200000000000004,"15min":0.58799999999999997},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.31900000000000001},"max":{"1min":0.80200000000000005,"5min":0.85099999999999998,"15min":8.3520000000000003},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56599999999999995,"15min":1.075},"min":{"1min":0.38300000000000001,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.81100000000000005,"5min":1.4419999999999999,"15min":18.143999999999998},"last":0.57499999999999996}]},{"osd":6,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56200000000000006,"15min":1.1000000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.316},"max":{"1min":0.78100000000000003,"5min":1.012,"15min":18.206},"last":0.63},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.77600000000000002},"min":{"1min":0.44,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86899999999999999,"5min":1.3240000000000001,"15min":7.0060000000000002},"last":0.58699999999999997}]},{"osd":7,"last update":"Wed Oct 25 23:44:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":0.84799999999999998,"5min":0.88100000000000001,"15min":2.3900000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68700000000000006,"15min":1.145},"min":{"1min":0.41799999999999998,"5min":0.40500000000000003,"15min":0.39500000000000002},"max":{"1min":2.0339999999999998,"5min":7.9850000000000003,"15min":18.109999999999999},"last":0.68799999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574963,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314424,"kb_used_data":184752,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94057416,"statfs":{"total":96636764160,"available":96314793984,"internally_reserved":0,"allocated":189186048,"data_stored":188902628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":132774344},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.435,"15min":0.376},"min":{"1min":0.23999999999999999,"5min":0.17899999999999999,"15min":0.17799999999999999},"max":{"1min":0.65400000000000003,"5min":5.9560000000000004,"15min":5.9560000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.311,"5min":0.89400000000000002,"15min":0.54200000000000004},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.65400000000000003,"5min":55.152999999999999,"15min":55.152999999999999},"last":0.34799999999999998}]},{"osd":1,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38200000000000001,"15min":0.36599999999999999},"min":{"1min":0.217,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":1.294,"5min":2.323,"15min":2.323},"last":0.441},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.52200000000000002,"15min":0.438},"min":{"1min":0.33800000000000002,"5min":0.245,"15min":0.24399999999999999},"max":{"1min":0.624,"5min":6.0609999999999999,"15min":6.0609999999999999},"last":0.42199999999999999}]},{"osd":2,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.46500000000000002,"15min":0.44},"min":{"1min":0.31900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59999999999999998,"5min":4.6840000000000002,"15min":4.6840000000000002},"last":0.378},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.83699999999999997,"15min":0.55100000000000005},"min":{"1min":0.28799999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.3260000000000001,"5min":40.789000000000001,"15min":40.789000000000001},"last":0.39400000000000002}]},{"osd":4,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.1319999999999999,"15min":0.77700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33000000000000002},"max":{"1min":1.1719999999999999,"5min":58.180999999999997,"15min":58.180999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.629,"15min":0.58199999999999996},"min":{"1min":0.39200000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.94799999999999995,"5min":4.6509999999999998,"15min":4.6509999999999998},"last":0.55400000000000005}]},{"osd":5,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":1.1990000000000001,"15min":0.80000000000000004},"min":{"1min":0.38500000000000001,"5min":0.317,"15min":0.29999999999999999},"max":{"1min":1.21,"5min":60.893999999999998,"15min":60.893999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66800000000000004,"15min":0.61299999999999999},"min":{"1min":0.43099999999999999,"5min":0.38300000000000001,"15min":0.378},"max":{"1min":1.3540000000000001,"5min":4.2489999999999997,"15min":4.2489999999999997},"last":0.623}]},{"osd":6,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.64300000000000002,"15min":0.59899999999999998},"min":{"1min":0.46100000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.385,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.71399999999999997,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.372,"15min":0.372},"max":{"1min":0.91800000000000004,"5min":6.1790000000000003,"15min":6.1790000000000003},"last":0.63700000000000001}]},{"osd":7,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.98699999999999999,"15min":0.74299999999999999},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88,"5min":33.006999999999998,"15min":33.006999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":1.175,"15min":0.80600000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39600000000000002},"max":{"1min":1.2509999999999999,"5min":56.667999999999999,"15min":56.667999999999999},"last":0.67900000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574962,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326556,"kb_used_data":209364,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94045284,"statfs":{"total":96636764160,"available":96302370816,"internally_reserved":0,"allocated":214388736,"data_stored":214118638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.495,"15min":0.89600000000000002},"min":{"1min":0.28799999999999998,"5min":0.26300000000000001,"15min":0.23999999999999999},"max":{"1min":3.0310000000000001,"5min":3.306,"15min":32.487000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45300000000000001,"15min":0.51300000000000001},"min":{"1min":0.24399999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.65500000000000003,"5min":1.05,"15min":6.0670000000000002},"last":0.63900000000000001}]},{"osd":1,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.73399999999999999,"15min":0.71499999999999997},"min":{"1min":0.27400000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.66800000000000004,"5min":23.579000000000001,"15min":32.417000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.83099999999999996,"15min":0.96399999999999997},"min":{"1min":0.33100000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.70399999999999996,"5min":22.800000000000001,"15min":22.800000000000001},"last":0.53700000000000003}]},{"osd":2,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.60199999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":0.745,"5min":2.6779999999999999,"15min":14.757999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.72199999999999998,"15min":0.65900000000000003},"min":{"1min":0.35299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.72399999999999998,"5min":18.042999999999999,"15min":18.042999999999999},"last":0.67300000000000004}]},{"osd":3,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.57699999999999996,"15min":0.73399999999999999},"min":{"1min":0.314,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66900000000000004,"5min":6.1360000000000001,"15min":55.222000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57399999999999995,"15min":0.64000000000000001},"min":{"1min":0.39100000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80600000000000005,"5min":6.3220000000000001,"15min":14.869999999999999},"last":0.60299999999999998}]},{"osd":5,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.50800000000000001,"15min":0.56899999999999995},"min":{"1min":0.33300000000000002,"5min":0.26600000000000001,"15min":0.23699999999999999},"max":{"1min":0.77500000000000002,"5min":1.466,"15min":6.508},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.62},"min":{"1min":0.40799999999999997,"5min":0.26500000000000001,"15min":0.24199999999999999},"max":{"1min":0.72899999999999998,"5min":2.403,"15min":6.5270000000000001},"last":0.49399999999999999}]},{"osd":6,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.497,"15min":0.60399999999999998},"min":{"1min":0.36699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.83599999999999997,"5min":0.89100000000000001,"15min":14.805999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.52000000000000002,"15min":0.58799999999999997},"min":{"1min":0.45600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.41599999999999998}]},{"osd":7,"last update":"Wed Oct 25 23:44:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.67600000000000005,"15min":0.63500000000000001},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.79100000000000004,"5min":12.135999999999999,"15min":12.135999999999999},"last":0.434},{"interface":"front","average":{"1min":0.63,"5min":0.81299999999999994,"15min":0.74099999999999999},"min":{"1min":0.45700000000000002,"5min":0.33300000000000002,"15min":0.29699999999999999},"max":{"1min":0.86199999999999999,"5min":21.465,"15min":21.465},"last":0.39500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574963,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339560,"kb_used_data":209888,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94032280,"statfs":{"total":96636764160,"available":96289054720,"internally_reserved":0,"allocated":214925312,"data_stored":214659003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132774342},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.88900000000000001,"15min":0.65900000000000003},"min":{"1min":0.30499999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.63600000000000001,"5min":48.045999999999999,"15min":48.045999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48599999999999999,"15min":0.52400000000000002},"min":{"1min":0.28899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60199999999999998,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.35999999999999999}]},{"osd":1,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47299999999999998,"15min":0.50900000000000001},"min":{"1min":0.313,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.65100000000000002,"5min":3.8959999999999999,"15min":3.8959999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.47499999999999998,"15min":0.54900000000000004},"min":{"1min":0.28999999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.755},"last":0.499}]},{"osd":2,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.58499999999999996,"15min":0.56399999999999995},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59199999999999997,"5min":13.271000000000001,"15min":13.271000000000001},"last":0.432},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.35899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.63500000000000001,"5min":7.141,"15min":7.141},"last":0.51200000000000001}]},{"osd":3,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.93000000000000005,"15min":0.68999999999999995},"min":{"1min":0.33600000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.78200000000000003,"5min":47.875999999999998,"15min":47.875999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.378,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.66500000000000004,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.52300000000000002}]},{"osd":4,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51300000000000001,"15min":0.498},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.66700000000000004,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52400000000000002,"15min":0.52000000000000002},"min":{"1min":0.38200000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.74199999999999999,"5min":2.657,"15min":2.657},"last":0.377}]},{"osd":6,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57699999999999996,"15min":0.54100000000000004},"min":{"1min":0.374,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.82299999999999995,"5min":6.9050000000000002,"15min":6.9050000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59199999999999997,"15min":0.55400000000000005},"min":{"1min":0.442,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.70699999999999996,"5min":5.9770000000000003,"15min":5.9770000000000003},"last":0.47299999999999998}]},{"osd":7,"last update":"Wed Oct 25 23:44:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56899999999999995,"15min":0.55800000000000005},"min":{"1min":0.44700000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.80200000000000005,"5min":3.8530000000000002,"15min":3.8530000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59299999999999997,"15min":0.59799999999999998},"min":{"1min":0.49399999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76700000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.54700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":234893312,"data_stored":234881662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":260059136,"data_stored":260051894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":104857600,"data_stored":104857600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":188706816,"data_stored":188698486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":213925888,"data_stored":213914516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":214462464,"data_stored":214454881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":252170240,"data_stored":252158333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":301993984,"data_stored":301990470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":20,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":15,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-25T23:45:08.746 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.746 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.747 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.747 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.748 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.748 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.748 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.749 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.749 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.750 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.750 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.750 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.751 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.751 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.752 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.752 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.752 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.753 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.753 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.754 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.754 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.755 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.755 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.755 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.756 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.756 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.757 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.757 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.758 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.759 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.759 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.760 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2023-10-25T23:36:07.244986+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=7, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.760 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.761 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.761 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.762 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.762 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.762 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.763 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.763 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.764 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.764 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.764 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.765 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.765 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.765 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.766 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:08.766 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-25T23:45:17.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:45:17.581 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:45:28.768 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T23:45:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.902+0000 7fc48e58a700 1 -- 172.21.15.81:0/1495817620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc48814ea80 msgr2=0x7fc488145120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.902+0000 7fc48e58a700 1 --2- 172.21.15.81:0/1495817620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc48814ea80 0x7fc488145120 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc478005fd0 tx=0x7fc478009c70 comp rx=0 tx=0).stop 2023-10-25T23:45:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.902+0000 7fc48e58a700 1 -- 172.21.15.81:0/1495817620 shutdown_connections 2023-10-25T23:45:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.902+0000 7fc48e58a700 1 --2- 172.21.15.81:0/1495817620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc48814ea80 0x7fc488145120 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.902+0000 7fc48e58a700 1 -- 172.21.15.81:0/1495817620 >> 172.21.15.81:0/1495817620 conn(0x7fc4880c0a60 msgr2=0x7fc4880c0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.902+0000 7fc48e58a700 1 -- 172.21.15.81:0/1495817620 shutdown_connections 2023-10-25T23:45:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.902+0000 7fc48e58a700 1 -- 172.21.15.81:0/1495817620 wait complete. 2023-10-25T23:45:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.903+0000 7fc48e58a700 1 Processor -- start 2023-10-25T23:45:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.903+0000 7fc48e58a700 1 -- start start 2023-10-25T23:45:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc48e58a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4880b4ed0 0x7fc4881d64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc48e58a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc488145660 0x7fc488138990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc48e58a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc48814ea80 0x7fc4881e12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:28.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc48e58a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4881e51c0 con 0x7fc488145660 2023-10-25T23:45:28.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc48e58a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4881d6a10 con 0x7fc4880b4ed0 2023-10-25T23:45:28.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc48e58a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc488138ed0 con 0x7fc48814ea80 2023-10-25T23:45:28.911 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc4877fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc488145660 0x7fc488138990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:28.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc4877fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc488145660 0x7fc488138990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37400/0 (socket says 172.21.15.81:37400) 2023-10-25T23:45:28.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc4877fe700 1 -- 172.21.15.81:0/416390924 learned_addr learned my addr 172.21.15.81:0/416390924 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:45:28.912 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc487fff700 1 --2- 172.21.15.81:0/416390924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4880b4ed0 0x7fc4881d64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc48cb27700 1 --2- 172.21.15.81:0/416390924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc48814ea80 0x7fc4881e12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc4877fe700 1 -- 172.21.15.81:0/416390924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc48814ea80 msgr2=0x7fc4881e12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc4877fe700 1 --2- 172.21.15.81:0/416390924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc48814ea80 0x7fc4881e12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc4877fe700 1 -- 172.21.15.81:0/416390924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4880b4ed0 msgr2=0x7fc4881d64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc4877fe700 1 --2- 172.21.15.81:0/416390924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4880b4ed0 0x7fc4881d64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc4877fe700 1 -- 172.21.15.81:0/416390924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4780095f0 con 0x7fc488145660 2023-10-25T23:45:28.914 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc48cb27700 1 --2- 172.21.15.81:0/416390924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc48814ea80 0x7fc4881e12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:45:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc487fff700 1 --2- 172.21.15.81:0/416390924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4880b4ed0 0x7fc4881d64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:45:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc4877fe700 1 --2- 172.21.15.81:0/416390924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc488145660 0x7fc488138990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc47000c4e0 tx=0x7fc47000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:28.915 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc484ff9700 1 -- 172.21.15.81:0/416390924 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700052d0 con 0x7fc488145660 2023-10-25T23:45:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc484ff9700 1 -- 172.21.15.81:0/416390924 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc470005520 con 0x7fc488145660 2023-10-25T23:45:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc48e58a700 1 -- 172.21.15.81:0/416390924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4881d59e0 con 0x7fc488145660 2023-10-25T23:45:28.916 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc484ff9700 1 -- 172.21.15.81:0/416390924 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700038e0 con 0x7fc488145660 2023-10-25T23:45:28.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.904+0000 7fc48e58a700 1 -- 172.21.15.81:0/416390924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4881e4b00 con 0x7fc488145660 2023-10-25T23:45:28.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.905+0000 7fc48e58a700 1 -- 172.21.15.81:0/416390924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4881e5300 con 0x7fc488145660 2023-10-25T23:45:28.917 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.906+0000 7fc484ff9700 1 -- 172.21.15.81:0/416390924 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc470003a40 con 0x7fc488145660 2023-10-25T23:45:28.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.906+0000 7fc484ff9700 1 --2- 172.21.15.81:0/416390924 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc46806aed0 0x7fc46806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:28.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.906+0000 7fc484ff9700 1 -- 172.21.15.81:0/416390924 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc470088de0 con 0x7fc488145660 2023-10-25T23:45:28.918 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.907+0000 7fc487fff700 1 --2- 172.21.15.81:0/416390924 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc46806aed0 0x7fc46806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:28.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.907+0000 7fc487fff700 1 --2- 172.21.15.81:0/416390924 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc46806aed0 0x7fc46806d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc478000c00 tx=0x7fc478011040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:28.919 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:28.911+0000 7fc484ff9700 1 -- 172.21.15.81:0/416390924 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc4881e5300 con 0x7fc488145660 2023-10-25T23:45:29.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:29.097+0000 7fc48e58a700 1 -- 172.21.15.81:0/416390924 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4881e5300 con 0x7fc46806aed0 2023-10-25T23:45:29.107 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:29.106+0000 7fc484ff9700 1 -- 172.21.15.81:0/416390924 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+294987 (secure 0 0 0) 0x7fc4881e5300 con 0x7fc46806aed0 2023-10-25T23:45:29.111 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:45:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:29.109+0000 7fc48e58a700 1 -- 172.21.15.81:0/416390924 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc46806aed0 msgr2=0x7fc46806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:29.109+0000 7fc48e58a700 1 --2- 172.21.15.81:0/416390924 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc46806aed0 0x7fc46806d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc478000c00 tx=0x7fc478011040 comp rx=0 tx=0).stop 2023-10-25T23:45:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:29.109+0000 7fc48e58a700 1 -- 172.21.15.81:0/416390924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc488145660 msgr2=0x7fc488138990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:29.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:29.109+0000 7fc48e58a700 1 --2- 172.21.15.81:0/416390924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc488145660 0x7fc488138990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc47000c4e0 tx=0x7fc47000c8a0 comp rx=0 tx=0).stop 2023-10-25T23:45:29.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:29.109+0000 7fc48e58a700 1 -- 172.21.15.81:0/416390924 shutdown_connections 2023-10-25T23:45:29.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:29.109+0000 7fc48e58a700 1 --2- 172.21.15.81:0/416390924 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc48814ea80 0x7fc4881e12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:29.115 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:29.109+0000 7fc48e58a700 1 --2- 172.21.15.81:0/416390924 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fc46806aed0 0x7fc46806d390 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:29.109+0000 7fc48e58a700 1 --2- 172.21.15.81:0/416390924 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4880b4ed0 0x7fc4881d64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:29.109+0000 7fc48e58a700 1 --2- 172.21.15.81:0/416390924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc488145660 0x7fc488138990 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:29.109+0000 7fc48e58a700 1 -- 172.21.15.81:0/416390924 >> 172.21.15.81:0/416390924 conn(0x7fc4880c0a60 msgr2=0x7fc48814d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:29.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:29.109+0000 7fc48e58a700 1 -- 172.21.15.81:0/416390924 shutdown_connections 2023-10-25T23:45:29.117 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:29.109+0000 7fc48e58a700 1 -- 172.21.15.81:0/416390924 wait complete. 2023-10-25T23:45:29.117 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-25T23:45:29.122 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2023-10-25T23:45:27.131221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":886094309,"num_objects":569,"num_object_clones":2,"num_object_copies":1138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":569,"num_whiteouts":0,"num_read":14774,"num_read_kb":532593,"num_write":91968,"num_write_kb":4545540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":344,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34320062,"num_omap_keys":57187,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147594,"ondisk_log_size":147594,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2694048,"kb_used_data":1734368,"kb_used_omap":12,"kb_used_meta":959603,"kb_avail":752280672,"statfs":{"total":773094113280,"available":770335408128,"internally_reserved":0,"allocated":1775992832,"data_stored":1773821594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":982634040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003263"},"pg_stats":[{"pgid":"3.3f","version":"40'1945","reported_seq":4566,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.873269+0000","last_change":"2023-10-25T23:44:39.031078+0000","last_active":"2023-10-25T23:44:47.873269+0000","last_peered":"2023-10-25T23:44:47.873269+0000","last_clean":"2023-10-25T23:44:47.873269+0000","last_became_active":"2023-10-25T23:36:09.292007+0000","last_became_peered":"2023-10-25T23:36:09.292007+0000","last_unstale":"2023-10-25T23:44:47.873269+0000","last_undegraded":"2023-10-25T23:44:47.873269+0000","last_fullsized":"2023-10-25T23:44:47.873269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1945,"log_dups_size":0,"ondisk_log_size":1945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0441538,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":3053,"num_write":1182,"num_write_kb":17288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"40'1938","reported_seq":4584,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:16.456710+0000","last_change":"2023-10-25T23:45:16.456757+0000","last_active":"2023-10-25T23:45:16.456710+0000","last_peered":"2023-10-25T23:45:16.456710+0000","last_clean":"2023-10-25T23:45:16.456710+0000","last_became_active":"2023-10-25T23:36:09.281890+0000","last_became_peered":"2023-10-25T23:36:09.281890+0000","last_unstale":"2023-10-25T23:45:16.456710+0000","last_undegraded":"2023-10-25T23:45:16.456710+0000","last_fullsized":"2023-10-25T23:45:16.456710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1938","last_scrub_stamp":"2023-10-25T23:45:16.456585+0000","last_deep_scrub":"40'1938","last_deep_scrub_stamp":"2023-10-25T23:45:16.456585+0000","last_clean_scrub_stamp":"2023-10-25T23:45:16.456585+0000","objects_scrubbed":0,"log_size":1938,"log_dups_size":0,"ondisk_log_size":1938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:24:11.638742+0000","scrub_duration":0.0045226349999999997,"objects_trimmed":0,"snaptrim_duration":0.049488604999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":12821,"num_write":1152,"num_write_kb":16010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"40'2038","reported_seq":4639,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.665442+0000","last_change":"2023-10-25T23:44:39.641700+0000","last_active":"2023-10-25T23:44:48.665442+0000","last_peered":"2023-10-25T23:44:48.665442+0000","last_clean":"2023-10-25T23:44:48.665442+0000","last_became_active":"2023-10-25T23:36:09.284066+0000","last_became_peered":"2023-10-25T23:36:09.284066+0000","last_unstale":"2023-10-25T23:44:48.665442+0000","last_undegraded":"2023-10-25T23:44:48.665442+0000","last_fullsized":"2023-10-25T23:44:48.665442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2038,"log_dups_size":0,"ondisk_log_size":2038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.17887767900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":12209,"num_write":1200,"num_write_kb":24347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"40'2086","reported_seq":4795,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:07.490132+0000","last_change":"2023-10-25T23:45:07.490180+0000","last_active":"2023-10-25T23:45:07.490132+0000","last_peered":"2023-10-25T23:45:07.490132+0000","last_clean":"2023-10-25T23:45:07.490132+0000","last_became_active":"2023-10-25T23:36:09.299585+0000","last_became_peered":"2023-10-25T23:36:09.299585+0000","last_unstale":"2023-10-25T23:45:07.490132+0000","last_undegraded":"2023-10-25T23:45:07.490132+0000","last_fullsized":"2023-10-25T23:45:07.490132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2086","last_scrub_stamp":"2023-10-25T23:45:07.490007+0000","last_deep_scrub":"40'2086","last_deep_scrub_stamp":"2023-10-25T23:45:07.490007+0000","last_clean_scrub_stamp":"2023-10-25T23:45:07.490007+0000","objects_scrubbed":0,"log_size":2086,"log_dups_size":0,"ondisk_log_size":2086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:50:14.619692+0000","scrub_duration":0.0054681310000000002,"objects_trimmed":0,"snaptrim_duration":0.16786652399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":4442,"num_write":1222,"num_write_kb":17071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"40'2222","reported_seq":4829,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:08.948289+0000","last_change":"2023-10-25T23:45:08.948387+0000","last_active":"2023-10-25T23:45:08.948289+0000","last_peered":"2023-10-25T23:45:08.948289+0000","last_clean":"2023-10-25T23:45:08.948289+0000","last_became_active":"2023-10-25T23:36:09.287403+0000","last_became_peered":"2023-10-25T23:36:09.287403+0000","last_unstale":"2023-10-25T23:45:08.948289+0000","last_undegraded":"2023-10-25T23:45:08.948289+0000","last_fullsized":"2023-10-25T23:45:08.948289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2222","last_scrub_stamp":"2023-10-25T23:45:08.948168+0000","last_deep_scrub":"40'2222","last_deep_scrub_stamp":"2023-10-25T23:45:08.948168+0000","last_clean_scrub_stamp":"2023-10-25T23:45:08.948168+0000","objects_scrubbed":0,"log_size":2222,"log_dups_size":0,"ondisk_log_size":2222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:08:52.565380+0000","scrub_duration":0.004897607,"objects_trimmed":0,"snaptrim_duration":0.047660552000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":4323,"num_write":1325,"num_write_kb":21852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"40'1930","reported_seq":4571,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:18.504421+0000","last_change":"2023-10-25T23:45:18.504476+0000","last_active":"2023-10-25T23:45:18.504421+0000","last_peered":"2023-10-25T23:45:18.504421+0000","last_clean":"2023-10-25T23:45:18.504421+0000","last_became_active":"2023-10-25T23:36:09.301305+0000","last_became_peered":"2023-10-25T23:36:09.301305+0000","last_unstale":"2023-10-25T23:45:18.504421+0000","last_undegraded":"2023-10-25T23:45:18.504421+0000","last_fullsized":"2023-10-25T23:45:18.504421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1930","last_scrub_stamp":"2023-10-25T23:45:18.504298+0000","last_deep_scrub":"40'1930","last_deep_scrub_stamp":"2023-10-25T23:45:18.504298+0000","last_clean_scrub_stamp":"2023-10-25T23:45:18.504298+0000","objects_scrubbed":0,"log_size":1930,"log_dups_size":0,"ondisk_log_size":1930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:44:30.150735+0000","scrub_duration":0.0055159830000000003,"objects_trimmed":0,"snaptrim_duration":0.139844156,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":4600,"num_write":1162,"num_write_kb":16604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"40'2105","reported_seq":4717,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:19.102288+0000","last_change":"2023-10-25T23:45:19.102335+0000","last_active":"2023-10-25T23:45:19.102288+0000","last_peered":"2023-10-25T23:45:19.102288+0000","last_clean":"2023-10-25T23:45:19.102288+0000","last_became_active":"2023-10-25T23:36:09.293173+0000","last_became_peered":"2023-10-25T23:36:09.293173+0000","last_unstale":"2023-10-25T23:45:19.102288+0000","last_undegraded":"2023-10-25T23:45:19.102288+0000","last_fullsized":"2023-10-25T23:45:19.102288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2105","last_scrub_stamp":"2023-10-25T23:45:19.102174+0000","last_deep_scrub":"40'2105","last_deep_scrub_stamp":"2023-10-25T23:45:19.102174+0000","last_clean_scrub_stamp":"2023-10-25T23:45:19.102174+0000","objects_scrubbed":0,"log_size":2105,"log_dups_size":0,"ondisk_log_size":2105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:49:01.409962+0000","scrub_duration":0.0050245740000000004,"objects_trimmed":0,"snaptrim_duration":0.040145588000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":4028,"num_write":1252,"num_write_kb":24067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"40'1952","reported_seq":4589,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.047408+0000","last_change":"2023-10-25T23:44:38.909560+0000","last_active":"2023-10-25T23:44:48.047408+0000","last_peered":"2023-10-25T23:44:48.047408+0000","last_clean":"2023-10-25T23:44:48.047408+0000","last_became_active":"2023-10-25T23:36:09.295518+0000","last_became_peered":"2023-10-25T23:36:09.295518+0000","last_unstale":"2023-10-25T23:44:48.047408+0000","last_undegraded":"2023-10-25T23:44:48.047408+0000","last_fullsized":"2023-10-25T23:44:48.047408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035739239999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":4005,"num_write":1156,"num_write_kb":40374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"40'2141","reported_seq":4773,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:24.202762+0000","last_change":"2023-10-25T23:45:24.202808+0000","last_active":"2023-10-25T23:45:24.202762+0000","last_peered":"2023-10-25T23:45:24.202762+0000","last_clean":"2023-10-25T23:45:24.202762+0000","last_became_active":"2023-10-25T23:36:09.297036+0000","last_became_peered":"2023-10-25T23:36:09.297036+0000","last_unstale":"2023-10-25T23:45:24.202762+0000","last_undegraded":"2023-10-25T23:45:24.202762+0000","last_fullsized":"2023-10-25T23:45:24.202762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2141","last_scrub_stamp":"2023-10-25T23:45:24.202641+0000","last_deep_scrub":"40'2141","last_deep_scrub_stamp":"2023-10-25T23:45:24.202641+0000","last_clean_scrub_stamp":"2023-10-25T23:45:24.202641+0000","objects_scrubbed":0,"log_size":2141,"log_dups_size":0,"ondisk_log_size":2141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:27:30.162972+0000","scrub_duration":0.004001274,"objects_trimmed":0,"snaptrim_duration":0.046296174000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":8236,"num_write":1280,"num_write_kb":21230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"40'1990","reported_seq":4607,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.665819+0000","last_change":"2023-10-25T23:44:39.516062+0000","last_active":"2023-10-25T23:44:48.665819+0000","last_peered":"2023-10-25T23:44:48.665819+0000","last_clean":"2023-10-25T23:44:48.665819+0000","last_became_active":"2023-10-25T23:36:09.297713+0000","last_became_peered":"2023-10-25T23:36:09.297713+0000","last_unstale":"2023-10-25T23:44:48.665819+0000","last_undegraded":"2023-10-25T23:44:48.665819+0000","last_fullsized":"2023-10-25T23:44:48.665819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1990,"log_dups_size":0,"ondisk_log_size":1990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052261503000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":4128,"num_write":1151,"num_write_kb":8179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"40'2162","reported_seq":4760,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.665466+0000","last_change":"2023-10-25T23:44:39.519698+0000","last_active":"2023-10-25T23:44:48.665466+0000","last_peered":"2023-10-25T23:44:48.665466+0000","last_clean":"2023-10-25T23:44:48.665466+0000","last_became_active":"2023-10-25T23:36:50.071605+0000","last_became_peered":"2023-10-25T23:36:50.071605+0000","last_unstale":"2023-10-25T23:44:48.665466+0000","last_undegraded":"2023-10-25T23:44:48.665466+0000","last_fullsized":"2023-10-25T23:44:48.665466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2162,"log_dups_size":0,"ondisk_log_size":2162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.056199102000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":4889,"num_write":1231,"num_write_kb":19417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"40'2105","reported_seq":4720,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:01.541640+0000","last_change":"2023-10-25T23:45:01.541723+0000","last_active":"2023-10-25T23:45:01.541640+0000","last_peered":"2023-10-25T23:45:01.541640+0000","last_clean":"2023-10-25T23:45:01.541640+0000","last_became_active":"2023-10-25T23:36:09.291351+0000","last_became_peered":"2023-10-25T23:36:09.291351+0000","last_unstale":"2023-10-25T23:45:01.541640+0000","last_undegraded":"2023-10-25T23:45:01.541640+0000","last_fullsized":"2023-10-25T23:45:01.541640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2105","last_scrub_stamp":"2023-10-25T23:45:01.541514+0000","last_deep_scrub":"40'2105","last_deep_scrub_stamp":"2023-10-25T23:45:01.541514+0000","last_clean_scrub_stamp":"2023-10-25T23:45:01.541514+0000","objects_scrubbed":0,"log_size":2105,"log_dups_size":0,"ondisk_log_size":2105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:23:34.365717+0000","scrub_duration":0.0060231190000000004,"objects_trimmed":0,"snaptrim_duration":0.104157445,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":4997,"num_write":1220,"num_write_kb":33278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"40'2041","reported_seq":4665,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:05.023879+0000","last_change":"2023-10-25T23:45:05.023966+0000","last_active":"2023-10-25T23:45:05.023879+0000","last_peered":"2023-10-25T23:45:05.023879+0000","last_clean":"2023-10-25T23:45:05.023879+0000","last_became_active":"2023-10-25T23:36:09.289895+0000","last_became_peered":"2023-10-25T23:36:09.289895+0000","last_unstale":"2023-10-25T23:45:05.023879+0000","last_undegraded":"2023-10-25T23:45:05.023879+0000","last_fullsized":"2023-10-25T23:45:05.023879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2041","last_scrub_stamp":"2023-10-25T23:45:05.023771+0000","last_deep_scrub":"40'2041","last_deep_scrub_stamp":"2023-10-25T23:45:05.023771+0000","last_clean_scrub_stamp":"2023-10-25T23:45:05.023771+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:12:05.963637+0000","scrub_duration":0.0041081449999999997,"objects_trimmed":0,"snaptrim_duration":0.041092534,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":8364,"num_write":1160,"num_write_kb":24700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"40'2063","reported_seq":4703,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:54.785942+0000","last_change":"2023-10-25T23:44:54.786036+0000","last_active":"2023-10-25T23:44:54.785942+0000","last_peered":"2023-10-25T23:44:54.785942+0000","last_clean":"2023-10-25T23:44:54.785942+0000","last_became_active":"2023-10-25T23:36:09.283250+0000","last_became_peered":"2023-10-25T23:36:09.283250+0000","last_unstale":"2023-10-25T23:44:54.785942+0000","last_undegraded":"2023-10-25T23:44:54.785942+0000","last_fullsized":"2023-10-25T23:44:54.785942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2063","last_scrub_stamp":"2023-10-25T23:44:54.785822+0000","last_deep_scrub":"40'2063","last_deep_scrub_stamp":"2023-10-25T23:44:54.785822+0000","last_clean_scrub_stamp":"2023-10-25T23:44:54.785822+0000","objects_scrubbed":0,"log_size":2063,"log_dups_size":0,"ondisk_log_size":2063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:33:50.507803+0000","scrub_duration":0.0058257480000000004,"objects_trimmed":0,"snaptrim_duration":0.18494869999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":4523,"num_write":1222,"num_write_kb":24181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"40'2103","reported_seq":4729,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:09.382946+0000","last_change":"2023-10-25T23:45:09.383002+0000","last_active":"2023-10-25T23:45:09.382946+0000","last_peered":"2023-10-25T23:45:09.382946+0000","last_clean":"2023-10-25T23:45:09.382946+0000","last_became_active":"2023-10-25T23:36:09.286191+0000","last_became_peered":"2023-10-25T23:36:09.286191+0000","last_unstale":"2023-10-25T23:45:09.382946+0000","last_undegraded":"2023-10-25T23:45:09.382946+0000","last_fullsized":"2023-10-25T23:45:09.382946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2103","last_scrub_stamp":"2023-10-25T23:45:09.382855+0000","last_deep_scrub":"40'2103","last_deep_scrub_stamp":"2023-10-25T23:45:09.382855+0000","last_clean_scrub_stamp":"2023-10-25T23:45:09.382855+0000","objects_scrubbed":0,"log_size":2103,"log_dups_size":0,"ondisk_log_size":2103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:34.076421+0000","scrub_duration":0.0050155069999999998,"objects_trimmed":0,"snaptrim_duration":0.049576174000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":4088,"num_write":1280,"num_write_kb":29409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"40'2074","reported_seq":4711,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:09.470986+0000","last_change":"2023-10-25T23:45:09.471035+0000","last_active":"2023-10-25T23:45:09.470986+0000","last_peered":"2023-10-25T23:45:09.470986+0000","last_clean":"2023-10-25T23:45:09.470986+0000","last_became_active":"2023-10-25T23:36:09.301040+0000","last_became_peered":"2023-10-25T23:36:09.301040+0000","last_unstale":"2023-10-25T23:45:09.470986+0000","last_undegraded":"2023-10-25T23:45:09.470986+0000","last_fullsized":"2023-10-25T23:45:09.470986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2074","last_scrub_stamp":"2023-10-25T23:45:09.470837+0000","last_deep_scrub":"40'2074","last_deep_scrub_stamp":"2023-10-25T23:45:09.470837+0000","last_clean_scrub_stamp":"2023-10-25T23:45:09.470837+0000","objects_scrubbed":0,"log_size":2074,"log_dups_size":0,"ondisk_log_size":2074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:39:02.546704+0000","scrub_duration":0.0058892409999999999,"objects_trimmed":0,"snaptrim_duration":0.15382465100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":14548,"num_write":1224,"num_write_kb":47800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"40'2118","reported_seq":4769,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:54.066379+0000","last_change":"2023-10-25T23:44:54.066449+0000","last_active":"2023-10-25T23:44:54.066379+0000","last_peered":"2023-10-25T23:44:54.066379+0000","last_clean":"2023-10-25T23:44:54.066379+0000","last_became_active":"2023-10-25T23:36:50.103220+0000","last_became_peered":"2023-10-25T23:36:50.103220+0000","last_unstale":"2023-10-25T23:44:54.066379+0000","last_undegraded":"2023-10-25T23:44:54.066379+0000","last_fullsized":"2023-10-25T23:44:54.066379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2118","last_scrub_stamp":"2023-10-25T23:44:54.066263+0000","last_deep_scrub":"40'2118","last_deep_scrub_stamp":"2023-10-25T23:44:54.066263+0000","last_clean_scrub_stamp":"2023-10-25T23:44:54.066263+0000","objects_scrubbed":0,"log_size":2118,"log_dups_size":0,"ondisk_log_size":2118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:10:22.153336+0000","scrub_duration":0.0035887580000000001,"objects_trimmed":0,"snaptrim_duration":0.033066291999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":8493,"num_write":1280,"num_write_kb":14868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"40'2009","reported_seq":4631,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:51.045918+0000","last_change":"2023-10-25T23:44:51.045966+0000","last_active":"2023-10-25T23:44:51.045918+0000","last_peered":"2023-10-25T23:44:51.045918+0000","last_clean":"2023-10-25T23:44:51.045918+0000","last_became_active":"2023-10-25T23:36:09.282282+0000","last_became_peered":"2023-10-25T23:36:09.282282+0000","last_unstale":"2023-10-25T23:44:51.045918+0000","last_undegraded":"2023-10-25T23:44:51.045918+0000","last_fullsized":"2023-10-25T23:44:51.045918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2009","last_scrub_stamp":"2023-10-25T23:44:51.045757+0000","last_deep_scrub":"40'2009","last_deep_scrub_stamp":"2023-10-25T23:44:51.045757+0000","last_clean_scrub_stamp":"2023-10-25T23:44:51.045757+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:26:50.500449+0000","scrub_duration":0.0054215599999999997,"objects_trimmed":0,"snaptrim_duration":0.033856860000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":3064,"num_write":1152,"num_write_kb":24838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"40'2193","reported_seq":4813,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:56.023652+0000","last_change":"2023-10-25T23:44:56.023652+0000","last_active":"2023-10-25T23:44:56.023652+0000","last_peered":"2023-10-25T23:44:56.023652+0000","last_clean":"2023-10-25T23:44:56.023652+0000","last_became_active":"2023-10-25T23:36:09.289457+0000","last_became_peered":"2023-10-25T23:36:09.289457+0000","last_unstale":"2023-10-25T23:44:56.023652+0000","last_undegraded":"2023-10-25T23:44:56.023652+0000","last_fullsized":"2023-10-25T23:44:56.023652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2193","last_scrub_stamp":"2023-10-25T23:44:56.023426+0000","last_deep_scrub":"40'2193","last_deep_scrub_stamp":"2023-10-25T23:44:56.023426+0000","last_clean_scrub_stamp":"2023-10-25T23:44:56.023426+0000","objects_scrubbed":0,"log_size":2193,"log_dups_size":0,"ondisk_log_size":2193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:50:13.161520+0000","scrub_duration":0.0054959659999999997,"objects_trimmed":0,"snaptrim_duration":0.041861184000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":8808,"num_write":1334,"num_write_kb":38138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"41'383","reported_seq":428,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:51.809605+0000","last_change":"2023-10-25T23:44:51.809669+0000","last_active":"2023-10-25T23:44:51.809605+0000","last_peered":"2023-10-25T23:44:51.809605+0000","last_clean":"2023-10-25T23:44:51.809605+0000","last_became_active":"2023-10-25T23:36:08.270911+0000","last_became_peered":"2023-10-25T23:36:08.270911+0000","last_unstale":"2023-10-25T23:44:51.809605+0000","last_undegraded":"2023-10-25T23:44:51.809605+0000","last_fullsized":"2023-10-25T23:44:51.809605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'383","last_scrub_stamp":"2023-10-25T23:44:51.809528+0000","last_deep_scrub":"41'383","last_deep_scrub_stamp":"2023-10-25T23:44:51.809528+0000","last_clean_scrub_stamp":"2023-10-25T23:44:51.809528+0000","objects_scrubbed":20,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:01:37.777592+0000","scrub_duration":0.059215088999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33555014,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":323,"num_write_kb":78531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":351082,"num_omap_keys":627,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"40'1985","reported_seq":4589,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:19.944971+0000","last_change":"2023-10-25T23:45:19.945022+0000","last_active":"2023-10-25T23:45:19.944971+0000","last_peered":"2023-10-25T23:45:19.944971+0000","last_clean":"2023-10-25T23:45:19.944971+0000","last_became_active":"2023-10-25T23:36:09.290260+0000","last_became_peered":"2023-10-25T23:36:09.290260+0000","last_unstale":"2023-10-25T23:45:19.944971+0000","last_undegraded":"2023-10-25T23:45:19.944971+0000","last_fullsized":"2023-10-25T23:45:19.944971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1985","last_scrub_stamp":"2023-10-25T23:45:19.944875+0000","last_deep_scrub":"40'1985","last_deep_scrub_stamp":"2023-10-25T23:45:19.944875+0000","last_clean_scrub_stamp":"2023-10-25T23:45:19.944875+0000","objects_scrubbed":0,"log_size":1985,"log_dups_size":0,"ondisk_log_size":1985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:39:37.526984+0000","scrub_duration":0.0050587460000000002,"objects_trimmed":0,"snaptrim_duration":0.036898185999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":3083,"num_write":1169,"num_write_kb":11022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"41'649","reported_seq":694,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:56.146522+0000","last_change":"2023-10-25T23:44:56.146628+0000","last_active":"2023-10-25T23:44:56.146522+0000","last_peered":"2023-10-25T23:44:56.146522+0000","last_clean":"2023-10-25T23:44:56.146522+0000","last_became_active":"2023-10-25T23:36:08.269443+0000","last_became_peered":"2023-10-25T23:36:08.269443+0000","last_unstale":"2023-10-25T23:44:56.146522+0000","last_undegraded":"2023-10-25T23:44:56.146522+0000","last_fullsized":"2023-10-25T23:44:56.146522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'649","last_scrub_stamp":"2023-10-25T23:44:56.146419+0000","last_deep_scrub":"41'649","last_deep_scrub_stamp":"2023-10-25T23:44:56.146419+0000","last_clean_scrub_stamp":"2023-10-25T23:44:56.146419+0000","objects_scrubbed":13,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:50:13.284513+0000","scrub_duration":0.054388904000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":598,"num_write_kb":86544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149116,"num_omap_keys":265,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"40'1964","reported_seq":4610,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:25.986836+0000","last_change":"2023-10-25T23:45:25.986920+0000","last_active":"2023-10-25T23:45:25.986836+0000","last_peered":"2023-10-25T23:45:25.986836+0000","last_clean":"2023-10-25T23:45:25.986836+0000","last_became_active":"2023-10-25T23:36:09.299738+0000","last_became_peered":"2023-10-25T23:36:09.299738+0000","last_unstale":"2023-10-25T23:45:25.986836+0000","last_undegraded":"2023-10-25T23:45:25.986836+0000","last_fullsized":"2023-10-25T23:45:25.986836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1964","last_scrub_stamp":"2023-10-25T23:45:25.986697+0000","last_deep_scrub":"40'1964","last_deep_scrub_stamp":"2023-10-25T23:45:25.986697+0000","last_clean_scrub_stamp":"2023-10-25T23:45:25.986697+0000","objects_scrubbed":0,"log_size":1964,"log_dups_size":0,"ondisk_log_size":1964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:14:52.812902+0000","scrub_duration":0.0033618939999999998,"objects_trimmed":0,"snaptrim_duration":0.16688098700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":3695,"num_write":1175,"num_write_kb":20733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"41'628","reported_seq":672,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:07.043434+0000","last_change":"2023-10-25T23:45:07.043509+0000","last_active":"2023-10-25T23:45:07.043434+0000","last_peered":"2023-10-25T23:45:07.043434+0000","last_clean":"2023-10-25T23:45:07.043434+0000","last_became_active":"2023-10-25T23:36:08.273574+0000","last_became_peered":"2023-10-25T23:36:08.273574+0000","last_unstale":"2023-10-25T23:45:07.043434+0000","last_undegraded":"2023-10-25T23:45:07.043434+0000","last_fullsized":"2023-10-25T23:45:07.043434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'628","last_scrub_stamp":"2023-10-25T23:45:07.043349+0000","last_deep_scrub":"41'628","last_deep_scrub_stamp":"2023-10-25T23:45:07.043349+0000","last_clean_scrub_stamp":"2023-10-25T23:45:07.043349+0000","objects_scrubbed":21,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:10:01.813301+0000","scrub_duration":0.077303144000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":582,"num_write_kb":140942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1011184,"num_omap_keys":1546,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"40'2159","reported_seq":4763,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.989840+0000","last_change":"2023-10-25T23:44:39.102502+0000","last_active":"2023-10-25T23:44:47.989840+0000","last_peered":"2023-10-25T23:44:47.989840+0000","last_clean":"2023-10-25T23:44:47.989840+0000","last_became_active":"2023-10-25T23:36:09.299916+0000","last_became_peered":"2023-10-25T23:36:09.299916+0000","last_unstale":"2023-10-25T23:44:47.989840+0000","last_undegraded":"2023-10-25T23:44:47.989840+0000","last_fullsized":"2023-10-25T23:44:47.989840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14014327800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":4255,"num_write":1272,"num_write_kb":13349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"41'414","reported_seq":458,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:06.063739+0000","last_change":"2023-10-25T23:45:06.063862+0000","last_active":"2023-10-25T23:45:06.063739+0000","last_peered":"2023-10-25T23:45:06.063739+0000","last_clean":"2023-10-25T23:45:06.063739+0000","last_became_active":"2023-10-25T23:36:08.271442+0000","last_became_peered":"2023-10-25T23:36:08.271442+0000","last_unstale":"2023-10-25T23:45:06.063739+0000","last_undegraded":"2023-10-25T23:45:06.063739+0000","last_fullsized":"2023-10-25T23:45:06.063739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'414","last_scrub_stamp":"2023-10-25T23:45:06.063634+0000","last_deep_scrub":"41'414","last_deep_scrub_stamp":"2023-10-25T23:45:06.063634+0000","last_clean_scrub_stamp":"2023-10-25T23:45:06.063634+0000","objects_scrubbed":21,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:14:32.889839+0000","scrub_duration":0.052590801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":379,"num_write_kb":83039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":393616,"num_omap_keys":682,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"40'2019","reported_seq":4660,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:12.531974+0000","last_change":"2023-10-25T23:45:12.532035+0000","last_active":"2023-10-25T23:45:12.531974+0000","last_peered":"2023-10-25T23:45:12.531974+0000","last_clean":"2023-10-25T23:45:12.531974+0000","last_became_active":"2023-10-25T23:36:09.299130+0000","last_became_peered":"2023-10-25T23:36:09.299130+0000","last_unstale":"2023-10-25T23:45:12.531974+0000","last_undegraded":"2023-10-25T23:45:12.531974+0000","last_fullsized":"2023-10-25T23:45:12.531974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2019","last_scrub_stamp":"2023-10-25T23:45:12.531861+0000","last_deep_scrub":"40'2019","last_deep_scrub_stamp":"2023-10-25T23:45:12.531861+0000","last_clean_scrub_stamp":"2023-10-25T23:45:12.531861+0000","objects_scrubbed":0,"log_size":2019,"log_dups_size":0,"ondisk_log_size":2019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:22:05.277506+0000","scrub_duration":0.0053950580000000003,"objects_trimmed":0,"snaptrim_duration":0.14672489499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":3649,"num_write":1196,"num_write_kb":32686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"41'472","reported_seq":516,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:54.120320+0000","last_change":"2023-10-25T23:44:54.120431+0000","last_active":"2023-10-25T23:44:54.120320+0000","last_peered":"2023-10-25T23:44:54.120320+0000","last_clean":"2023-10-25T23:44:54.120320+0000","last_became_active":"2023-10-25T23:36:08.270138+0000","last_became_peered":"2023-10-25T23:36:08.270138+0000","last_unstale":"2023-10-25T23:44:54.120320+0000","last_undegraded":"2023-10-25T23:44:54.120320+0000","last_fullsized":"2023-10-25T23:44:54.120320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'472","last_scrub_stamp":"2023-10-25T23:44:54.120211+0000","last_deep_scrub":"41'472","last_deep_scrub_stamp":"2023-10-25T23:44:54.120211+0000","last_clean_scrub_stamp":"2023-10-25T23:44:54.120211+0000","objects_scrubbed":20,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:27:28.414292+0000","scrub_duration":0.071562769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":475,"num_write_kb":111638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4150944,"num_omap_keys":7343,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"40'2154","reported_seq":4775,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:58.501870+0000","last_change":"2023-10-25T23:44:58.501940+0000","last_active":"2023-10-25T23:44:58.501870+0000","last_peered":"2023-10-25T23:44:58.501870+0000","last_clean":"2023-10-25T23:44:58.501870+0000","last_became_active":"2023-10-25T23:36:09.287455+0000","last_became_peered":"2023-10-25T23:36:09.287455+0000","last_unstale":"2023-10-25T23:44:58.501870+0000","last_undegraded":"2023-10-25T23:44:58.501870+0000","last_fullsized":"2023-10-25T23:44:58.501870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2154","last_scrub_stamp":"2023-10-25T23:44:58.501771+0000","last_deep_scrub":"40'2154","last_deep_scrub_stamp":"2023-10-25T23:44:58.501771+0000","last_clean_scrub_stamp":"2023-10-25T23:44:58.501771+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:20:18.363567+0000","scrub_duration":0.0049148270000000001,"objects_trimmed":0,"snaptrim_duration":0.093404585999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":5171,"num_write":1282,"num_write_kb":34019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"41'545","reported_seq":589,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:50.958967+0000","last_change":"2023-10-25T23:44:50.959038+0000","last_active":"2023-10-25T23:44:50.958967+0000","last_peered":"2023-10-25T23:44:50.958967+0000","last_clean":"2023-10-25T23:44:50.958967+0000","last_became_active":"2023-10-25T23:36:08.271974+0000","last_became_peered":"2023-10-25T23:36:08.271974+0000","last_unstale":"2023-10-25T23:44:50.958967+0000","last_undegraded":"2023-10-25T23:44:50.958967+0000","last_fullsized":"2023-10-25T23:44:50.958967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'545","last_scrub_stamp":"2023-10-25T23:44:50.958861+0000","last_deep_scrub":"41'545","last_deep_scrub_stamp":"2023-10-25T23:44:50.958861+0000","last_clean_scrub_stamp":"2023-10-25T23:44:50.958861+0000","objects_scrubbed":8,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:21:29.815599+0000","scrub_duration":0.037452547000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":503,"num_write_kb":90640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":126186,"num_omap_keys":226,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"40'2101","reported_seq":4701,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:16.851062+0000","last_change":"2023-10-25T23:45:16.851115+0000","last_active":"2023-10-25T23:45:16.851062+0000","last_peered":"2023-10-25T23:45:16.851062+0000","last_clean":"2023-10-25T23:45:16.851062+0000","last_became_active":"2023-10-25T23:36:09.294176+0000","last_became_peered":"2023-10-25T23:36:09.294176+0000","last_unstale":"2023-10-25T23:45:16.851062+0000","last_undegraded":"2023-10-25T23:45:16.851062+0000","last_fullsized":"2023-10-25T23:45:16.851062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2101","last_scrub_stamp":"2023-10-25T23:45:16.850965+0000","last_deep_scrub":"40'2101","last_deep_scrub_stamp":"2023-10-25T23:45:16.850965+0000","last_clean_scrub_stamp":"2023-10-25T23:45:16.850965+0000","objects_scrubbed":0,"log_size":2101,"log_dups_size":0,"ondisk_log_size":2101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:35:54.742884+0000","scrub_duration":0.0048591720000000001,"objects_trimmed":0,"snaptrim_duration":0.20272068300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":27232,"num_write":1210,"num_write_kb":20727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"41'313","reported_seq":357,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:51.150889+0000","last_change":"2023-10-25T23:44:51.150961+0000","last_active":"2023-10-25T23:44:51.150889+0000","last_peered":"2023-10-25T23:44:51.150889+0000","last_clean":"2023-10-25T23:44:51.150889+0000","last_became_active":"2023-10-25T23:36:08.273035+0000","last_became_peered":"2023-10-25T23:36:08.273035+0000","last_unstale":"2023-10-25T23:44:51.150889+0000","last_undegraded":"2023-10-25T23:44:51.150889+0000","last_fullsized":"2023-10-25T23:44:51.150889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'313","last_scrub_stamp":"2023-10-25T23:44:51.150805+0000","last_deep_scrub":"41'313","last_deep_scrub_stamp":"2023-10-25T23:44:51.150805+0000","last_clean_scrub_stamp":"2023-10-25T23:44:51.150805+0000","objects_scrubbed":13,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:58:17.029784+0000","scrub_duration":0.051535087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20925654,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":275,"num_write_kb":80040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1602763,"num_omap_keys":2447,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"40'2324","reported_seq":4919,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.047619+0000","last_change":"2023-10-25T23:44:38.909221+0000","last_active":"2023-10-25T23:44:48.047619+0000","last_peered":"2023-10-25T23:44:48.047619+0000","last_clean":"2023-10-25T23:44:48.047619+0000","last_became_active":"2023-10-25T23:36:09.292546+0000","last_became_peered":"2023-10-25T23:36:09.292546+0000","last_unstale":"2023-10-25T23:44:48.047619+0000","last_undegraded":"2023-10-25T23:44:48.047619+0000","last_fullsized":"2023-10-25T23:44:48.047619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035319162000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":23958,"num_write":1360,"num_write_kb":38473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"41'1039","reported_seq":1083,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:58.509448+0000","last_change":"2023-10-25T23:44:58.509524+0000","last_active":"2023-10-25T23:44:58.509448+0000","last_peered":"2023-10-25T23:44:58.509448+0000","last_clean":"2023-10-25T23:44:58.509448+0000","last_became_active":"2023-10-25T23:36:08.277138+0000","last_became_peered":"2023-10-25T23:36:08.277138+0000","last_unstale":"2023-10-25T23:44:58.509448+0000","last_undegraded":"2023-10-25T23:44:58.509448+0000","last_fullsized":"2023-10-25T23:44:58.509448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1039","last_scrub_stamp":"2023-10-25T23:44:58.509365+0000","last_deep_scrub":"41'1039","last_deep_scrub_stamp":"2023-10-25T23:44:58.509365+0000","last_clean_scrub_stamp":"2023-10-25T23:44:58.509365+0000","objects_scrubbed":22,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:29:10.829596+0000","scrub_duration":0.093800564000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":989,"num_write_kb":120913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1331763,"num_omap_keys":2391,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"40'2067","reported_seq":4685,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:14.421388+0000","last_change":"2023-10-25T23:45:14.421436+0000","last_active":"2023-10-25T23:45:14.421388+0000","last_peered":"2023-10-25T23:45:14.421388+0000","last_clean":"2023-10-25T23:45:14.421388+0000","last_became_active":"2023-10-25T23:36:09.290456+0000","last_became_peered":"2023-10-25T23:36:09.290456+0000","last_unstale":"2023-10-25T23:45:14.421388+0000","last_undegraded":"2023-10-25T23:45:14.421388+0000","last_fullsized":"2023-10-25T23:45:14.421388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2067","last_scrub_stamp":"2023-10-25T23:45:14.421273+0000","last_deep_scrub":"40'2067","last_deep_scrub_stamp":"2023-10-25T23:45:14.421273+0000","last_clean_scrub_stamp":"2023-10-25T23:45:14.421273+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:29:57.100609+0000","scrub_duration":0.0039362030000000001,"objects_trimmed":0,"snaptrim_duration":0.058251507000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":31667,"num_write":1204,"num_write_kb":33454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"41'372","reported_seq":493,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:58.089431+0000","last_change":"2023-10-25T23:44:58.089534+0000","last_active":"2023-10-25T23:44:58.089431+0000","last_peered":"2023-10-25T23:44:58.089431+0000","last_clean":"2023-10-25T23:44:58.089431+0000","last_became_active":"2023-10-25T23:36:08.272120+0000","last_became_peered":"2023-10-25T23:36:08.272120+0000","last_unstale":"2023-10-25T23:44:58.089431+0000","last_undegraded":"2023-10-25T23:44:58.089431+0000","last_fullsized":"2023-10-25T23:44:58.089431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'372","last_scrub_stamp":"2023-10-25T23:44:58.089308+0000","last_deep_scrub":"41'372","last_deep_scrub_stamp":"2023-10-25T23:44:58.089308+0000","last_clean_scrub_stamp":"2023-10-25T23:44:58.089308+0000","objects_scrubbed":17,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:17:25.802848+0000","scrub_duration":0.058194296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21516807,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":85,"num_read_kb":582,"num_write":349,"num_write_kb":84048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":536150,"num_omap_keys":952,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"40'2013","reported_seq":4635,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:05.451533+0000","last_change":"2023-10-25T23:45:05.451575+0000","last_active":"2023-10-25T23:45:05.451533+0000","last_peered":"2023-10-25T23:45:05.451533+0000","last_clean":"2023-10-25T23:45:05.451533+0000","last_became_active":"2023-10-25T23:36:09.293132+0000","last_became_peered":"2023-10-25T23:36:09.293132+0000","last_unstale":"2023-10-25T23:45:05.451533+0000","last_undegraded":"2023-10-25T23:45:05.451533+0000","last_fullsized":"2023-10-25T23:45:05.451533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2013","last_scrub_stamp":"2023-10-25T23:45:05.451437+0000","last_deep_scrub":"40'2013","last_deep_scrub_stamp":"2023-10-25T23:45:05.451437+0000","last_clean_scrub_stamp":"2023-10-25T23:45:05.451437+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:14:32.277642+0000","scrub_duration":0.0046978360000000004,"objects_trimmed":0,"snaptrim_duration":0.167893237,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":3351,"num_write":1194,"num_write_kb":12593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"41'695","reported_seq":739,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:50.371199+0000","last_change":"2023-10-25T23:44:50.371272+0000","last_active":"2023-10-25T23:44:50.371199+0000","last_peered":"2023-10-25T23:44:50.371199+0000","last_clean":"2023-10-25T23:44:50.371199+0000","last_became_active":"2023-10-25T23:36:08.272596+0000","last_became_peered":"2023-10-25T23:36:08.272596+0000","last_unstale":"2023-10-25T23:44:50.371199+0000","last_undegraded":"2023-10-25T23:44:50.371199+0000","last_fullsized":"2023-10-25T23:44:50.371199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'695","last_scrub_stamp":"2023-10-25T23:44:50.371115+0000","last_deep_scrub":"41'695","last_deep_scrub_stamp":"2023-10-25T23:44:50.371115+0000","last_clean_scrub_stamp":"2023-10-25T23:44:50.371115+0000","objects_scrubbed":19,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:58:16.250094+0000","scrub_duration":0.077208414000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":681,"num_write_kb":114510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3072130,"num_omap_keys":5404,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"40'2412","reported_seq":4894,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:07.658306+0000","last_change":"2023-10-25T23:45:07.658354+0000","last_active":"2023-10-25T23:45:07.658306+0000","last_peered":"2023-10-25T23:45:07.658306+0000","last_clean":"2023-10-25T23:45:07.658306+0000","last_became_active":"2023-10-25T23:36:09.299938+0000","last_became_peered":"2023-10-25T23:36:09.299938+0000","last_unstale":"2023-10-25T23:45:07.658306+0000","last_undegraded":"2023-10-25T23:45:07.658306+0000","last_fullsized":"2023-10-25T23:45:07.658306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2412","last_scrub_stamp":"2023-10-25T23:45:07.658192+0000","last_deep_scrub":"40'2412","last_deep_scrub_stamp":"2023-10-25T23:45:07.658192+0000","last_clean_scrub_stamp":"2023-10-25T23:45:07.658192+0000","objects_scrubbed":0,"log_size":2412,"log_dups_size":0,"ondisk_log_size":2412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:42.116930+0000","scrub_duration":0.0049575330000000001,"objects_trimmed":0,"snaptrim_duration":0.20328459099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":3949,"num_write":1292,"num_write_kb":20710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"41'684","reported_seq":728,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:54.301455+0000","last_change":"2023-10-25T23:44:54.301510+0000","last_active":"2023-10-25T23:44:54.301455+0000","last_peered":"2023-10-25T23:44:54.301455+0000","last_clean":"2023-10-25T23:44:54.301455+0000","last_became_active":"2023-10-25T23:36:08.279509+0000","last_became_peered":"2023-10-25T23:36:08.279509+0000","last_unstale":"2023-10-25T23:44:54.301455+0000","last_undegraded":"2023-10-25T23:44:54.301455+0000","last_fullsized":"2023-10-25T23:44:54.301455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'684","last_scrub_stamp":"2023-10-25T23:44:54.301377+0000","last_deep_scrub":"41'684","last_deep_scrub_stamp":"2023-10-25T23:44:54.301377+0000","last_clean_scrub_stamp":"2023-10-25T23:44:54.301377+0000","objects_scrubbed":14,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:24:35.077752+0000","scrub_duration":0.039027157,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":675,"num_write_kb":75678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":833477,"num_omap_keys":1408,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"40'2111","reported_seq":4735,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:03.536532+0000","last_change":"2023-10-25T23:45:03.536599+0000","last_active":"2023-10-25T23:45:03.536532+0000","last_peered":"2023-10-25T23:45:03.536532+0000","last_clean":"2023-10-25T23:45:03.536532+0000","last_became_active":"2023-10-25T23:36:09.285196+0000","last_became_peered":"2023-10-25T23:36:09.285196+0000","last_unstale":"2023-10-25T23:45:03.536532+0000","last_undegraded":"2023-10-25T23:45:03.536532+0000","last_fullsized":"2023-10-25T23:45:03.536532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2111","last_scrub_stamp":"2023-10-25T23:45:03.536397+0000","last_deep_scrub":"40'2111","last_deep_scrub_stamp":"2023-10-25T23:45:03.536397+0000","last_clean_scrub_stamp":"2023-10-25T23:45:03.536397+0000","objects_scrubbed":0,"log_size":2111,"log_dups_size":0,"ondisk_log_size":2111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:31:40.764015+0000","scrub_duration":0.0051017290000000002,"objects_trimmed":0,"snaptrim_duration":0.093006917999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":5156,"num_write":1232,"num_write_kb":26142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"41'539","reported_seq":583,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:57.032937+0000","last_change":"2023-10-25T23:44:57.033037+0000","last_active":"2023-10-25T23:44:57.032937+0000","last_peered":"2023-10-25T23:44:57.032937+0000","last_clean":"2023-10-25T23:44:57.032937+0000","last_became_active":"2023-10-25T23:36:08.272248+0000","last_became_peered":"2023-10-25T23:36:08.272248+0000","last_unstale":"2023-10-25T23:44:57.032937+0000","last_undegraded":"2023-10-25T23:44:57.032937+0000","last_fullsized":"2023-10-25T23:44:57.032937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'539","last_scrub_stamp":"2023-10-25T23:44:57.032834+0000","last_deep_scrub":"41'539","last_deep_scrub_stamp":"2023-10-25T23:44:57.032834+0000","last_clean_scrub_stamp":"2023-10-25T23:44:57.032834+0000","objects_scrubbed":14,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:24:37.809209+0000","scrub_duration":0.047065255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166496,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":487,"num_write_kb":123604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":275248,"num_omap_keys":407,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"40'2017","reported_seq":4653,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.113462+0000","last_change":"2023-10-25T23:44:48.113512+0000","last_active":"2023-10-25T23:44:48.113462+0000","last_peered":"2023-10-25T23:44:48.113462+0000","last_clean":"2023-10-25T23:44:48.113462+0000","last_became_active":"2023-10-25T23:36:09.292300+0000","last_became_peered":"2023-10-25T23:36:09.292300+0000","last_unstale":"2023-10-25T23:44:48.113462+0000","last_undegraded":"2023-10-25T23:44:48.113462+0000","last_fullsized":"2023-10-25T23:44:48.113462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2017","last_scrub_stamp":"2023-10-25T23:44:48.113376+0000","last_deep_scrub":"40'2017","last_deep_scrub_stamp":"2023-10-25T23:44:48.113376+0000","last_clean_scrub_stamp":"2023-10-25T23:44:48.113376+0000","objects_scrubbed":3,"log_size":2017,"log_dups_size":0,"ondisk_log_size":2017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:14:52.977935+0000","scrub_duration":0.0058894630000000002,"objects_trimmed":0,"snaptrim_duration":0.041370048,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":2,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":211,"num_read_kb":3693,"num_write":1198,"num_write_kb":20850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"40'229","reported_seq":273,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:44.810353+0000","last_change":"2023-10-25T23:44:44.810353+0000","last_active":"2023-10-25T23:44:44.810353+0000","last_peered":"2023-10-25T23:44:44.810353+0000","last_clean":"2023-10-25T23:44:44.810353+0000","last_became_active":"2023-10-25T23:36:08.274162+0000","last_became_peered":"2023-10-25T23:36:08.274162+0000","last_unstale":"2023-10-25T23:44:44.810353+0000","last_undegraded":"2023-10-25T23:44:44.810353+0000","last_fullsized":"2023-10-25T23:44:44.810353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'229","last_scrub_stamp":"2023-10-25T23:44:44.810222+0000","last_deep_scrub":"40'229","last_deep_scrub_stamp":"2023-10-25T23:44:44.810222+0000","last_clean_scrub_stamp":"2023-10-25T23:44:44.810222+0000","objects_scrubbed":19,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:05:42.612397+0000","scrub_duration":0.067816369000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360162,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":202,"num_write_kb":93162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2596919,"num_omap_keys":4542,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"40'2312","reported_seq":4820,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:01.645542+0000","last_change":"2023-10-25T23:45:01.645594+0000","last_active":"2023-10-25T23:45:01.645542+0000","last_peered":"2023-10-25T23:45:01.645542+0000","last_clean":"2023-10-25T23:45:01.645542+0000","last_became_active":"2023-10-25T23:36:09.284386+0000","last_became_peered":"2023-10-25T23:36:09.284386+0000","last_unstale":"2023-10-25T23:45:01.645542+0000","last_undegraded":"2023-10-25T23:45:01.645542+0000","last_fullsized":"2023-10-25T23:45:01.645542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2312","last_scrub_stamp":"2023-10-25T23:45:01.645430+0000","last_deep_scrub":"40'2312","last_deep_scrub_stamp":"2023-10-25T23:45:01.645430+0000","last_clean_scrub_stamp":"2023-10-25T23:45:01.645430+0000","objects_scrubbed":0,"log_size":2312,"log_dups_size":0,"ondisk_log_size":2312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:02:03.581760+0000","scrub_duration":0.0060352870000000003,"objects_trimmed":0,"snaptrim_duration":0.17573393000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":8533,"num_write":1240,"num_write_kb":24417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"41'191","reported_seq":235,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:49.302476+0000","last_change":"2023-10-25T23:44:49.302547+0000","last_active":"2023-10-25T23:44:49.302476+0000","last_peered":"2023-10-25T23:44:49.302476+0000","last_clean":"2023-10-25T23:44:49.302476+0000","last_became_active":"2023-10-25T23:36:08.271188+0000","last_became_peered":"2023-10-25T23:36:08.271188+0000","last_unstale":"2023-10-25T23:44:49.302476+0000","last_undegraded":"2023-10-25T23:44:49.302476+0000","last_fullsized":"2023-10-25T23:44:49.302476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'191","last_scrub_stamp":"2023-10-25T23:44:49.302368+0000","last_deep_scrub":"41'191","last_deep_scrub_stamp":"2023-10-25T23:44:49.302368+0000","last_clean_scrub_stamp":"2023-10-25T23:44:49.302368+0000","objects_scrubbed":11,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:20:08.912260+0000","scrub_duration":0.028664325000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":160,"num_write_kb":61795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":145850,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"40'2163","reported_seq":4773,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:11.007974+0000","last_change":"2023-10-25T23:45:11.008060+0000","last_active":"2023-10-25T23:45:11.007974+0000","last_peered":"2023-10-25T23:45:11.007974+0000","last_clean":"2023-10-25T23:45:11.007974+0000","last_became_active":"2023-10-25T23:36:09.294200+0000","last_became_peered":"2023-10-25T23:36:09.294200+0000","last_unstale":"2023-10-25T23:45:11.007974+0000","last_undegraded":"2023-10-25T23:45:11.007974+0000","last_fullsized":"2023-10-25T23:45:11.007974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2163","last_scrub_stamp":"2023-10-25T23:45:11.007857+0000","last_deep_scrub":"40'2163","last_deep_scrub_stamp":"2023-10-25T23:45:11.007857+0000","last_clean_scrub_stamp":"2023-10-25T23:45:11.007857+0000","objects_scrubbed":0,"log_size":2163,"log_dups_size":0,"ondisk_log_size":2163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:25:56.561399+0000","scrub_duration":0.0049179410000000003,"objects_trimmed":0,"snaptrim_duration":0.047064776000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":3992,"num_write":1263,"num_write_kb":18428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"41'415","reported_seq":460,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:55.046562+0000","last_change":"2023-10-25T23:44:55.046636+0000","last_active":"2023-10-25T23:44:55.046562+0000","last_peered":"2023-10-25T23:44:55.046562+0000","last_clean":"2023-10-25T23:44:55.046562+0000","last_became_active":"2023-10-25T23:36:08.272301+0000","last_became_peered":"2023-10-25T23:36:08.272301+0000","last_unstale":"2023-10-25T23:44:55.046562+0000","last_undegraded":"2023-10-25T23:44:55.046562+0000","last_fullsized":"2023-10-25T23:44:55.046562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'415","last_scrub_stamp":"2023-10-25T23:44:55.046459+0000","last_deep_scrub":"41'415","last_deep_scrub_stamp":"2023-10-25T23:44:55.046459+0000","last_clean_scrub_stamp":"2023-10-25T23:44:55.046459+0000","objects_scrubbed":27,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:04:17.601081+0000","scrub_duration":0.103266866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":376,"num_write_kb":99496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":428421,"num_omap_keys":766,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"40'2015","reported_seq":4648,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:13.085265+0000","last_change":"2023-10-25T23:45:13.085351+0000","last_active":"2023-10-25T23:45:13.085265+0000","last_peered":"2023-10-25T23:45:13.085265+0000","last_clean":"2023-10-25T23:45:13.085265+0000","last_became_active":"2023-10-25T23:36:09.291305+0000","last_became_peered":"2023-10-25T23:36:09.291305+0000","last_unstale":"2023-10-25T23:45:13.085265+0000","last_undegraded":"2023-10-25T23:45:13.085265+0000","last_fullsized":"2023-10-25T23:45:13.085265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2015","last_scrub_stamp":"2023-10-25T23:45:13.085125+0000","last_deep_scrub":"40'2015","last_deep_scrub_stamp":"2023-10-25T23:45:13.085125+0000","last_clean_scrub_stamp":"2023-10-25T23:45:13.085125+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:27:19.691270+0000","scrub_duration":0.0065419679999999996,"objects_trimmed":0,"snaptrim_duration":0.044631746999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":3822,"num_write":1210,"num_write_kb":15603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"41'353","reported_seq":397,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:49.036360+0000","last_change":"2023-10-25T23:44:49.036427+0000","last_active":"2023-10-25T23:44:49.036360+0000","last_peered":"2023-10-25T23:44:49.036360+0000","last_clean":"2023-10-25T23:44:49.036360+0000","last_became_active":"2023-10-25T23:36:08.277327+0000","last_became_peered":"2023-10-25T23:36:08.277327+0000","last_unstale":"2023-10-25T23:44:49.036360+0000","last_undegraded":"2023-10-25T23:44:49.036360+0000","last_fullsized":"2023-10-25T23:44:49.036360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'353","last_scrub_stamp":"2023-10-25T23:44:49.036269+0000","last_deep_scrub":"41'353","last_deep_scrub_stamp":"2023-10-25T23:44:49.036269+0000","last_clean_scrub_stamp":"2023-10-25T23:44:49.036269+0000","objects_scrubbed":19,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:59:01.177225+0000","scrub_duration":0.043642932000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":349,"num_write_kb":89245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":985085,"num_omap_keys":1249,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"40'2084","reported_seq":4742,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:17.091981+0000","last_change":"2023-10-25T23:45:17.092068+0000","last_active":"2023-10-25T23:45:17.091981+0000","last_peered":"2023-10-25T23:45:17.091981+0000","last_clean":"2023-10-25T23:45:17.091981+0000","last_became_active":"2023-10-25T23:36:09.295231+0000","last_became_peered":"2023-10-25T23:36:09.295231+0000","last_unstale":"2023-10-25T23:45:17.091981+0000","last_undegraded":"2023-10-25T23:45:17.091981+0000","last_fullsized":"2023-10-25T23:45:17.091981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2084","last_scrub_stamp":"2023-10-25T23:45:17.091849+0000","last_deep_scrub":"40'2084","last_deep_scrub_stamp":"2023-10-25T23:45:17.091849+0000","last_clean_scrub_stamp":"2023-10-25T23:45:17.091849+0000","objects_scrubbed":0,"log_size":2084,"log_dups_size":0,"ondisk_log_size":2084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:56:10.175191+0000","scrub_duration":0.0056155550000000004,"objects_trimmed":0,"snaptrim_duration":0.037920328000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":12104,"num_write":1268,"num_write_kb":24673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"41'408","reported_seq":453,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:51.531995+0000","last_change":"2023-10-25T23:44:51.531995+0000","last_active":"2023-10-25T23:44:51.531995+0000","last_peered":"2023-10-25T23:44:51.531995+0000","last_clean":"2023-10-25T23:44:51.531995+0000","last_became_active":"2023-10-25T23:36:08.263264+0000","last_became_peered":"2023-10-25T23:36:08.263264+0000","last_unstale":"2023-10-25T23:44:51.531995+0000","last_undegraded":"2023-10-25T23:44:51.531995+0000","last_fullsized":"2023-10-25T23:44:51.531995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'408","last_scrub_stamp":"2023-10-25T23:44:51.531833+0000","last_deep_scrub":"41'408","last_deep_scrub_stamp":"2023-10-25T23:44:51.531833+0000","last_clean_scrub_stamp":"2023-10-25T23:44:51.531833+0000","objects_scrubbed":21,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:14:41.177258+0000","scrub_duration":0.064666293999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554454,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":368,"num_write_kb":90831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":303629,"num_omap_keys":534,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"40'2070","reported_seq":4709,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:22.162144+0000","last_change":"2023-10-25T23:45:22.162191+0000","last_active":"2023-10-25T23:45:22.162144+0000","last_peered":"2023-10-25T23:45:22.162144+0000","last_clean":"2023-10-25T23:45:22.162144+0000","last_became_active":"2023-10-25T23:36:09.294298+0000","last_became_peered":"2023-10-25T23:36:09.294298+0000","last_unstale":"2023-10-25T23:45:22.162144+0000","last_undegraded":"2023-10-25T23:45:22.162144+0000","last_fullsized":"2023-10-25T23:45:22.162144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2070","last_scrub_stamp":"2023-10-25T23:45:22.162003+0000","last_deep_scrub":"40'2070","last_deep_scrub_stamp":"2023-10-25T23:45:22.162003+0000","last_clean_scrub_stamp":"2023-10-25T23:45:22.162003+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:19:09.916230+0000","scrub_duration":0.0050462509999999999,"objects_trimmed":0,"snaptrim_duration":0.040324974999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":8972,"num_write":1223,"num_write_kb":21636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"40'339","reported_seq":384,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:45.236992+0000","last_change":"2023-10-25T23:44:45.236992+0000","last_active":"2023-10-25T23:44:45.236992+0000","last_peered":"2023-10-25T23:44:45.236992+0000","last_clean":"2023-10-25T23:44:45.236992+0000","last_became_active":"2023-10-25T23:36:08.277087+0000","last_became_peered":"2023-10-25T23:36:08.277087+0000","last_unstale":"2023-10-25T23:44:45.236992+0000","last_undegraded":"2023-10-25T23:44:45.236992+0000","last_fullsized":"2023-10-25T23:44:45.236992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'339","last_scrub_stamp":"2023-10-25T23:44:45.236835+0000","last_deep_scrub":"40'339","last_deep_scrub_stamp":"2023-10-25T23:44:45.236835+0000","last_clean_scrub_stamp":"2023-10-25T23:44:45.236835+0000","objects_scrubbed":23,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:38:57.739655+0000","scrub_duration":0.071032165999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":307,"num_write_kb":115956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":959437,"num_omap_keys":1709,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"40'2156","reported_seq":4774,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:02.409958+0000","last_change":"2023-10-25T23:45:02.410009+0000","last_active":"2023-10-25T23:45:02.409958+0000","last_peered":"2023-10-25T23:45:02.409958+0000","last_clean":"2023-10-25T23:45:02.409958+0000","last_became_active":"2023-10-25T23:36:50.069951+0000","last_became_peered":"2023-10-25T23:36:50.069951+0000","last_unstale":"2023-10-25T23:45:02.409958+0000","last_undegraded":"2023-10-25T23:45:02.409958+0000","last_fullsized":"2023-10-25T23:45:02.409958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2156","last_scrub_stamp":"2023-10-25T23:45:02.409846+0000","last_deep_scrub":"40'2156","last_deep_scrub_stamp":"2023-10-25T23:45:02.409846+0000","last_clean_scrub_stamp":"2023-10-25T23:45:02.409846+0000","objects_scrubbed":0,"log_size":2156,"log_dups_size":0,"ondisk_log_size":2156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:19:24.191246+0000","scrub_duration":0.0063092230000000001,"objects_trimmed":0,"snaptrim_duration":0.160884052,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":24659,"num_write":1256,"num_write_kb":46504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"41'308","reported_seq":353,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:51.399474+0000","last_change":"2023-10-25T23:44:51.399552+0000","last_active":"2023-10-25T23:44:51.399474+0000","last_peered":"2023-10-25T23:44:51.399474+0000","last_clean":"2023-10-25T23:44:51.399474+0000","last_became_active":"2023-10-25T23:36:08.279302+0000","last_became_peered":"2023-10-25T23:36:08.279302+0000","last_unstale":"2023-10-25T23:44:51.399474+0000","last_undegraded":"2023-10-25T23:44:51.399474+0000","last_fullsized":"2023-10-25T23:44:51.399474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'308","last_scrub_stamp":"2023-10-25T23:44:51.399374+0000","last_deep_scrub":"41'308","last_deep_scrub_stamp":"2023-10-25T23:44:51.399374+0000","last_clean_scrub_stamp":"2023-10-25T23:44:51.399374+0000","objects_scrubbed":16,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:25.858112+0000","scrub_duration":0.073867762000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":257,"num_write_kb":101207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2453176,"num_omap_keys":4372,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"40'2040","reported_seq":4681,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:04.566238+0000","last_change":"2023-10-25T23:45:04.566311+0000","last_active":"2023-10-25T23:45:04.566238+0000","last_peered":"2023-10-25T23:45:04.566238+0000","last_clean":"2023-10-25T23:45:04.566238+0000","last_became_active":"2023-10-25T23:36:09.292670+0000","last_became_peered":"2023-10-25T23:36:09.292670+0000","last_unstale":"2023-10-25T23:45:04.566238+0000","last_undegraded":"2023-10-25T23:45:04.566238+0000","last_fullsized":"2023-10-25T23:45:04.566238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2040","last_scrub_stamp":"2023-10-25T23:45:04.566100+0000","last_deep_scrub":"40'2040","last_deep_scrub_stamp":"2023-10-25T23:45:04.566100+0000","last_clean_scrub_stamp":"2023-10-25T23:45:04.566100+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:26:33.627605+0000","scrub_duration":0.0053032269999999998,"objects_trimmed":0,"snaptrim_duration":0.104196124,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":4275,"num_write":1236,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"40'2118","reported_seq":4736,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:07.329140+0000","last_change":"2023-10-25T23:45:07.329194+0000","last_active":"2023-10-25T23:45:07.329140+0000","last_peered":"2023-10-25T23:45:07.329140+0000","last_clean":"2023-10-25T23:45:07.329140+0000","last_became_active":"2023-10-25T23:36:09.283766+0000","last_became_peered":"2023-10-25T23:36:09.283766+0000","last_unstale":"2023-10-25T23:45:07.329140+0000","last_undegraded":"2023-10-25T23:45:07.329140+0000","last_fullsized":"2023-10-25T23:45:07.329140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2118","last_scrub_stamp":"2023-10-25T23:45:07.329001+0000","last_deep_scrub":"40'2118","last_deep_scrub_stamp":"2023-10-25T23:45:07.329001+0000","last_clean_scrub_stamp":"2023-10-25T23:45:07.329001+0000","objects_scrubbed":0,"log_size":2118,"log_dups_size":0,"ondisk_log_size":2118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:27:13.935146+0000","scrub_duration":0.0046581849999999996,"objects_trimmed":0,"snaptrim_duration":0.055043175999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":3969,"num_write":1247,"num_write_kb":17464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"41'565","reported_seq":903,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:50.098163+0000","last_change":"2023-10-25T23:44:50.098228+0000","last_active":"2023-10-25T23:44:50.098163+0000","last_peered":"2023-10-25T23:44:50.098163+0000","last_clean":"2023-10-25T23:44:50.098163+0000","last_became_active":"2023-10-25T23:36:08.263842+0000","last_became_peered":"2023-10-25T23:36:08.263842+0000","last_unstale":"2023-10-25T23:44:50.098163+0000","last_undegraded":"2023-10-25T23:44:50.098163+0000","last_fullsized":"2023-10-25T23:44:50.098163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'565","last_scrub_stamp":"2023-10-25T23:44:50.098069+0000","last_deep_scrub":"41'565","last_deep_scrub_stamp":"2023-10-25T23:44:50.098069+0000","last_clean_scrub_stamp":"2023-10-25T23:44:50.098069+0000","objects_scrubbed":15,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:37:16.219278+0000","scrub_duration":0.058695506000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":301,"num_read_kb":4287,"num_write":520,"num_write_kb":107914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":890223,"num_omap_keys":1552,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"40'2114","reported_seq":4715,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:02.137087+0000","last_change":"2023-10-25T23:45:02.137146+0000","last_active":"2023-10-25T23:45:02.137087+0000","last_peered":"2023-10-25T23:45:02.137087+0000","last_clean":"2023-10-25T23:45:02.137087+0000","last_became_active":"2023-10-25T23:36:09.295595+0000","last_became_peered":"2023-10-25T23:36:09.295595+0000","last_unstale":"2023-10-25T23:45:02.137087+0000","last_undegraded":"2023-10-25T23:45:02.137087+0000","last_fullsized":"2023-10-25T23:45:02.137087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2114","last_scrub_stamp":"2023-10-25T23:45:02.136918+0000","last_deep_scrub":"40'2114","last_deep_scrub_stamp":"2023-10-25T23:45:02.136918+0000","last_clean_scrub_stamp":"2023-10-25T23:45:02.136918+0000","objects_scrubbed":0,"log_size":2114,"log_dups_size":0,"ondisk_log_size":2114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:26.116142+0000","scrub_duration":0.0051631990000000003,"objects_trimmed":0,"snaptrim_duration":0.038517528000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":3321,"num_write":1232,"num_write_kb":16686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"41'231","reported_seq":276,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:53.344277+0000","last_change":"2023-10-25T23:44:53.344346+0000","last_active":"2023-10-25T23:44:53.344277+0000","last_peered":"2023-10-25T23:44:53.344277+0000","last_clean":"2023-10-25T23:44:53.344277+0000","last_became_active":"2023-10-25T23:36:08.271640+0000","last_became_peered":"2023-10-25T23:36:08.271640+0000","last_unstale":"2023-10-25T23:44:53.344277+0000","last_undegraded":"2023-10-25T23:44:53.344277+0000","last_fullsized":"2023-10-25T23:44:53.344277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'231","last_scrub_stamp":"2023-10-25T23:44:53.344188+0000","last_deep_scrub":"41'231","last_deep_scrub_stamp":"2023-10-25T23:44:53.344188+0000","last_clean_scrub_stamp":"2023-10-25T23:44:53.344188+0000","objects_scrubbed":11,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:50:10.482282+0000","scrub_duration":0.021348121000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":206,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":827399,"num_omap_keys":1449,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"41'119","reported_seq":200,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:57.051874+0000","last_change":"2023-10-25T23:44:57.051994+0000","last_active":"2023-10-25T23:44:57.051874+0000","last_peered":"2023-10-25T23:44:57.051874+0000","last_clean":"2023-10-25T23:44:57.051874+0000","last_became_active":"2023-10-25T23:35:58.276606+0000","last_became_peered":"2023-10-25T23:35:58.276606+0000","last_unstale":"2023-10-25T23:44:57.051874+0000","last_undegraded":"2023-10-25T23:44:57.051874+0000","last_fullsized":"2023-10-25T23:44:57.051874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'119","last_scrub_stamp":"2023-10-25T23:44:57.051784+0000","last_deep_scrub":"41'119","last_deep_scrub_stamp":"2023-10-25T23:44:57.051784+0000","last_clean_scrub_stamp":"2023-10-25T23:44:57.051784+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:35:34.943703+0000","scrub_duration":0.0053083490000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"40'1947","reported_seq":4568,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:53.768499+0000","last_change":"2023-10-25T23:44:53.768591+0000","last_active":"2023-10-25T23:44:53.768499+0000","last_peered":"2023-10-25T23:44:53.768499+0000","last_clean":"2023-10-25T23:44:53.768499+0000","last_became_active":"2023-10-25T23:36:09.291072+0000","last_became_peered":"2023-10-25T23:36:09.291072+0000","last_unstale":"2023-10-25T23:44:53.768499+0000","last_undegraded":"2023-10-25T23:44:53.768499+0000","last_fullsized":"2023-10-25T23:44:53.768499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1947","last_scrub_stamp":"2023-10-25T23:44:53.768341+0000","last_deep_scrub":"40'1947","last_deep_scrub_stamp":"2023-10-25T23:44:53.768341+0000","last_clean_scrub_stamp":"2023-10-25T23:44:53.768341+0000","objects_scrubbed":0,"log_size":1947,"log_dups_size":0,"ondisk_log_size":1947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:51:02.117926+0000","scrub_duration":0.0055393680000000002,"objects_trimmed":0,"snaptrim_duration":0.185957752,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":28650,"num_write":1164,"num_write_kb":22232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"41'257","reported_seq":302,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:04.095508+0000","last_change":"2023-10-25T23:45:04.095628+0000","last_active":"2023-10-25T23:45:04.095508+0000","last_peered":"2023-10-25T23:45:04.095508+0000","last_clean":"2023-10-25T23:45:04.095508+0000","last_became_active":"2023-10-25T23:36:08.277663+0000","last_became_peered":"2023-10-25T23:36:08.277663+0000","last_unstale":"2023-10-25T23:45:04.095508+0000","last_undegraded":"2023-10-25T23:45:04.095508+0000","last_fullsized":"2023-10-25T23:45:04.095508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'257","last_scrub_stamp":"2023-10-25T23:45:04.095393+0000","last_deep_scrub":"41'257","last_deep_scrub_stamp":"2023-10-25T23:45:04.095393+0000","last_clean_scrub_stamp":"2023-10-25T23:45:04.095393+0000","objects_scrubbed":17,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:19:25.876792+0000","scrub_duration":0.044802369000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":226,"num_write_kb":82970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":343372,"num_omap_keys":597,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"41'498","reported_seq":543,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:08.030347+0000","last_change":"2023-10-25T23:45:08.030411+0000","last_active":"2023-10-25T23:45:08.030347+0000","last_peered":"2023-10-25T23:45:08.030347+0000","last_clean":"2023-10-25T23:45:08.030347+0000","last_became_active":"2023-10-25T23:36:08.269896+0000","last_became_peered":"2023-10-25T23:36:08.269896+0000","last_unstale":"2023-10-25T23:45:08.030347+0000","last_undegraded":"2023-10-25T23:45:08.030347+0000","last_fullsized":"2023-10-25T23:45:08.030347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'498","last_scrub_stamp":"2023-10-25T23:45:08.030257+0000","last_deep_scrub":"41'498","last_deep_scrub_stamp":"2023-10-25T23:45:08.030257+0000","last_clean_scrub_stamp":"2023-10-25T23:45:08.030257+0000","objects_scrubbed":13,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:58:58.522191+0000","scrub_duration":0.067194090999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":446,"num_write_kb":94912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336512,"num_omap_keys":600,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"40'2036","reported_seq":4681,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:11.455726+0000","last_change":"2023-10-25T23:45:11.455810+0000","last_active":"2023-10-25T23:45:11.455726+0000","last_peered":"2023-10-25T23:45:11.455726+0000","last_clean":"2023-10-25T23:45:11.455726+0000","last_became_active":"2023-10-25T23:36:09.278967+0000","last_became_peered":"2023-10-25T23:36:09.278967+0000","last_unstale":"2023-10-25T23:45:11.455726+0000","last_undegraded":"2023-10-25T23:45:11.455726+0000","last_fullsized":"2023-10-25T23:45:11.455726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2036","last_scrub_stamp":"2023-10-25T23:45:11.455577+0000","last_deep_scrub":"40'2036","last_deep_scrub_stamp":"2023-10-25T23:45:11.455577+0000","last_clean_scrub_stamp":"2023-10-25T23:45:11.455577+0000","objects_scrubbed":0,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:40:27.120347+0000","scrub_duration":0.0057848709999999996,"objects_trimmed":0,"snaptrim_duration":0.055404268,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":3903,"num_write":1243,"num_write_kb":26062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"41'379","reported_seq":424,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:04.342729+0000","last_change":"2023-10-25T23:45:04.342838+0000","last_active":"2023-10-25T23:45:04.342729+0000","last_peered":"2023-10-25T23:45:04.342729+0000","last_clean":"2023-10-25T23:45:04.342729+0000","last_became_active":"2023-10-25T23:36:08.279082+0000","last_became_peered":"2023-10-25T23:36:08.279082+0000","last_unstale":"2023-10-25T23:45:04.342729+0000","last_undegraded":"2023-10-25T23:45:04.342729+0000","last_fullsized":"2023-10-25T23:45:04.342729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'379","last_scrub_stamp":"2023-10-25T23:45:04.342644+0000","last_deep_scrub":"41'379","last_deep_scrub_stamp":"2023-10-25T23:45:04.342644+0000","last_clean_scrub_stamp":"2023-10-25T23:45:04.342644+0000","objects_scrubbed":14,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:44:05.654623+0000","scrub_duration":0.051811070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":470,"num_write_kb":81486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":175294,"num_omap_keys":314,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"40'1963","reported_seq":4575,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.048032+0000","last_change":"2023-10-25T23:44:38.913967+0000","last_active":"2023-10-25T23:44:48.048032+0000","last_peered":"2023-10-25T23:44:48.048032+0000","last_clean":"2023-10-25T23:44:48.048032+0000","last_became_active":"2023-10-25T23:36:09.289751+0000","last_became_peered":"2023-10-25T23:36:09.289751+0000","last_unstale":"2023-10-25T23:44:48.048032+0000","last_undegraded":"2023-10-25T23:44:48.048032+0000","last_fullsized":"2023-10-25T23:44:48.048032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1963,"log_dups_size":0,"ondisk_log_size":1963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039560708999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":4389,"num_write":1130,"num_write_kb":12211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"41'425","reported_seq":470,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:05.052342+0000","last_change":"2023-10-25T23:45:05.052420+0000","last_active":"2023-10-25T23:45:05.052342+0000","last_peered":"2023-10-25T23:45:05.052342+0000","last_clean":"2023-10-25T23:45:05.052342+0000","last_became_active":"2023-10-25T23:36:08.273029+0000","last_became_peered":"2023-10-25T23:36:08.273029+0000","last_unstale":"2023-10-25T23:45:05.052342+0000","last_undegraded":"2023-10-25T23:45:05.052342+0000","last_fullsized":"2023-10-25T23:45:05.052342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'425","last_scrub_stamp":"2023-10-25T23:45:05.052255+0000","last_deep_scrub":"41'425","last_deep_scrub_stamp":"2023-10-25T23:45:05.052255+0000","last_clean_scrub_stamp":"2023-10-25T23:45:05.052255+0000","objects_scrubbed":17,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:44:06.364234+0000","scrub_duration":0.089985721000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":396,"num_write_kb":80384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1784242,"num_omap_keys":3118,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"40'1994","reported_seq":4630,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:20.925328+0000","last_change":"2023-10-25T23:45:20.925426+0000","last_active":"2023-10-25T23:45:20.925328+0000","last_peered":"2023-10-25T23:45:20.925328+0000","last_clean":"2023-10-25T23:45:20.925328+0000","last_became_active":"2023-10-25T23:36:09.287532+0000","last_became_peered":"2023-10-25T23:36:09.287532+0000","last_unstale":"2023-10-25T23:45:20.925328+0000","last_undegraded":"2023-10-25T23:45:20.925328+0000","last_fullsized":"2023-10-25T23:45:20.925328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1994","last_scrub_stamp":"2023-10-25T23:45:20.925194+0000","last_deep_scrub":"40'1994","last_deep_scrub_stamp":"2023-10-25T23:45:20.925194+0000","last_clean_scrub_stamp":"2023-10-25T23:45:20.925194+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:12:21.865060+0000","scrub_duration":0.0050023979999999999,"objects_trimmed":0,"snaptrim_duration":0.194145863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":4941,"num_write":1181,"num_write_kb":9554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"41'262","reported_seq":307,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:58.158213+0000","last_change":"2023-10-25T23:44:58.158287+0000","last_active":"2023-10-25T23:44:58.158213+0000","last_peered":"2023-10-25T23:44:58.158213+0000","last_clean":"2023-10-25T23:44:58.158213+0000","last_became_active":"2023-10-25T23:36:08.266648+0000","last_became_peered":"2023-10-25T23:36:08.266648+0000","last_unstale":"2023-10-25T23:44:58.158213+0000","last_undegraded":"2023-10-25T23:44:58.158213+0000","last_fullsized":"2023-10-25T23:44:58.158213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'262","last_scrub_stamp":"2023-10-25T23:44:58.158124+0000","last_deep_scrub":"41'262","last_deep_scrub_stamp":"2023-10-25T23:44:58.158124+0000","last_clean_scrub_stamp":"2023-10-25T23:44:58.158124+0000","objects_scrubbed":24,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:39:03.956788+0000","scrub_duration":0.103703136,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":194,"num_write_kb":95518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3191637,"num_omap_keys":4061,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"40'2107","reported_seq":4740,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:54.474516+0000","last_change":"2023-10-25T23:44:54.474641+0000","last_active":"2023-10-25T23:44:54.474516+0000","last_peered":"2023-10-25T23:44:54.474516+0000","last_clean":"2023-10-25T23:44:54.474516+0000","last_became_active":"2023-10-25T23:36:09.284666+0000","last_became_peered":"2023-10-25T23:36:09.284666+0000","last_unstale":"2023-10-25T23:44:54.474516+0000","last_undegraded":"2023-10-25T23:44:54.474516+0000","last_fullsized":"2023-10-25T23:44:54.474516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2107","last_scrub_stamp":"2023-10-25T23:44:54.474411+0000","last_deep_scrub":"40'2107","last_deep_scrub_stamp":"2023-10-25T23:44:54.474411+0000","last_clean_scrub_stamp":"2023-10-25T23:44:54.474411+0000","objects_scrubbed":0,"log_size":2107,"log_dups_size":0,"ondisk_log_size":2107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:59:09.268570+0000","scrub_duration":0.0048174560000000003,"objects_trimmed":0,"snaptrim_duration":0.075073965000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":4417,"num_write":1270,"num_write_kb":29307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"41'413","reported_seq":458,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:06.380183+0000","last_change":"2023-10-25T23:45:06.380244+0000","last_active":"2023-10-25T23:45:06.380183+0000","last_peered":"2023-10-25T23:45:06.380183+0000","last_clean":"2023-10-25T23:45:06.380183+0000","last_became_active":"2023-10-25T23:36:08.277873+0000","last_became_peered":"2023-10-25T23:36:08.277873+0000","last_unstale":"2023-10-25T23:45:06.380183+0000","last_undegraded":"2023-10-25T23:45:06.380183+0000","last_fullsized":"2023-10-25T23:45:06.380183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'413","last_scrub_stamp":"2023-10-25T23:45:06.380094+0000","last_deep_scrub":"41'413","last_deep_scrub_stamp":"2023-10-25T23:45:06.380094+0000","last_clean_scrub_stamp":"2023-10-25T23:45:06.380094+0000","objects_scrubbed":23,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:04:30.418912+0000","scrub_duration":0.082684259999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":385,"num_write_kb":96608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1359456,"num_omap_keys":1930,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"41'2141","reported_seq":4770,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:10.106724+0000","last_change":"2023-10-25T23:45:10.106779+0000","last_active":"2023-10-25T23:45:10.106724+0000","last_peered":"2023-10-25T23:45:10.106724+0000","last_clean":"2023-10-25T23:45:10.106724+0000","last_became_active":"2023-10-25T23:36:09.289320+0000","last_became_peered":"2023-10-25T23:36:09.289320+0000","last_unstale":"2023-10-25T23:45:10.106724+0000","last_undegraded":"2023-10-25T23:45:10.106724+0000","last_fullsized":"2023-10-25T23:45:10.106724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2141","last_scrub_stamp":"2023-10-25T23:45:10.106629+0000","last_deep_scrub":"41'2141","last_deep_scrub_stamp":"2023-10-25T23:45:10.106629+0000","last_clean_scrub_stamp":"2023-10-25T23:45:10.106629+0000","objects_scrubbed":1,"log_size":2141,"log_dups_size":0,"ondisk_log_size":2141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:10:04.876582+0000","scrub_duration":0.0085135999999999996,"objects_trimmed":0,"snaptrim_duration":0.037048923999999997,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":230,"num_read_kb":4443,"num_write":1269,"num_write_kb":26048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"41'641","reported_seq":686,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:58.338708+0000","last_change":"2023-10-25T23:44:58.338811+0000","last_active":"2023-10-25T23:44:58.338708+0000","last_peered":"2023-10-25T23:44:58.338708+0000","last_clean":"2023-10-25T23:44:58.338708+0000","last_became_active":"2023-10-25T23:36:08.278656+0000","last_became_peered":"2023-10-25T23:36:08.278656+0000","last_unstale":"2023-10-25T23:44:58.338708+0000","last_undegraded":"2023-10-25T23:44:58.338708+0000","last_fullsized":"2023-10-25T23:44:58.338708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'641","last_scrub_stamp":"2023-10-25T23:44:58.338617+0000","last_deep_scrub":"41'641","last_deep_scrub_stamp":"2023-10-25T23:44:58.338617+0000","last_clean_scrub_stamp":"2023-10-25T23:44:58.338617+0000","objects_scrubbed":23,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:34:14.170088+0000","scrub_duration":0.089561260000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":598,"num_write_kb":115954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":812553,"num_omap_keys":1430,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"40'2112","reported_seq":4718,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:57.063664+0000","last_change":"2023-10-25T23:44:57.063664+0000","last_active":"2023-10-25T23:44:57.063664+0000","last_peered":"2023-10-25T23:44:57.063664+0000","last_clean":"2023-10-25T23:44:57.063664+0000","last_became_active":"2023-10-25T23:36:09.292345+0000","last_became_peered":"2023-10-25T23:36:09.292345+0000","last_unstale":"2023-10-25T23:44:57.063664+0000","last_undegraded":"2023-10-25T23:44:57.063664+0000","last_fullsized":"2023-10-25T23:44:57.063664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2112","last_scrub_stamp":"2023-10-25T23:44:57.063525+0000","last_deep_scrub":"40'2112","last_deep_scrub_stamp":"2023-10-25T23:44:57.063525+0000","last_clean_scrub_stamp":"2023-10-25T23:44:57.063525+0000","objects_scrubbed":0,"log_size":2112,"log_dups_size":0,"ondisk_log_size":2112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:35:34.955444+0000","scrub_duration":0.0042181479999999997,"objects_trimmed":0,"snaptrim_duration":0.039941503000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":8471,"num_write":1242,"num_write_kb":22974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"41'431","reported_seq":476,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:05.082243+0000","last_change":"2023-10-25T23:45:05.082243+0000","last_active":"2023-10-25T23:45:05.082243+0000","last_peered":"2023-10-25T23:45:05.082243+0000","last_clean":"2023-10-25T23:45:05.082243+0000","last_became_active":"2023-10-25T23:36:08.268753+0000","last_became_peered":"2023-10-25T23:36:08.268753+0000","last_unstale":"2023-10-25T23:45:05.082243+0000","last_undegraded":"2023-10-25T23:45:05.082243+0000","last_fullsized":"2023-10-25T23:45:05.082243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'431","last_scrub_stamp":"2023-10-25T23:45:05.082053+0000","last_deep_scrub":"41'431","last_deep_scrub_stamp":"2023-10-25T23:45:05.082053+0000","last_clean_scrub_stamp":"2023-10-25T23:45:05.082053+0000","objects_scrubbed":15,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:24.276423+0000","scrub_duration":0.047061694000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":415,"num_write_kb":99792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":353948,"num_omap_keys":624,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"40'2029","reported_seq":4668,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:25.233513+0000","last_change":"2023-10-25T23:45:25.233587+0000","last_active":"2023-10-25T23:45:25.233513+0000","last_peered":"2023-10-25T23:45:25.233513+0000","last_clean":"2023-10-25T23:45:25.233513+0000","last_became_active":"2023-10-25T23:36:09.290151+0000","last_became_peered":"2023-10-25T23:36:09.290151+0000","last_unstale":"2023-10-25T23:45:25.233513+0000","last_undegraded":"2023-10-25T23:45:25.233513+0000","last_fullsized":"2023-10-25T23:45:25.233513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2029","last_scrub_stamp":"2023-10-25T23:45:25.233379+0000","last_deep_scrub":"40'2029","last_deep_scrub_stamp":"2023-10-25T23:45:25.233379+0000","last_clean_scrub_stamp":"2023-10-25T23:45:25.233379+0000","objects_scrubbed":0,"log_size":2029,"log_dups_size":0,"ondisk_log_size":2029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:07:54.294883+0000","scrub_duration":0.0061963959999999998,"objects_trimmed":0,"snaptrim_duration":0.047955154,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":5633,"num_write":1198,"num_write_kb":13442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"41'239","reported_seq":284,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.059663+0000","last_change":"2023-10-25T23:44:48.059663+0000","last_active":"2023-10-25T23:44:48.059663+0000","last_peered":"2023-10-25T23:44:48.059663+0000","last_clean":"2023-10-25T23:44:48.059663+0000","last_became_active":"2023-10-25T23:36:08.271846+0000","last_became_peered":"2023-10-25T23:36:08.271846+0000","last_unstale":"2023-10-25T23:44:48.059663+0000","last_undegraded":"2023-10-25T23:44:48.059663+0000","last_fullsized":"2023-10-25T23:44:48.059663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'239","last_scrub_stamp":"2023-10-25T23:44:48.059439+0000","last_deep_scrub":"41'239","last_deep_scrub_stamp":"2023-10-25T23:44:48.059439+0000","last_clean_scrub_stamp":"2023-10-25T23:44:48.059439+0000","objects_scrubbed":13,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:23:30.202942+0000","scrub_duration":0.071935235,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":195,"num_write_kb":98810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":281074,"num_omap_keys":484,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"40'2031","reported_seq":4654,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:15.006483+0000","last_change":"2023-10-25T23:45:15.006533+0000","last_active":"2023-10-25T23:45:15.006483+0000","last_peered":"2023-10-25T23:45:15.006483+0000","last_clean":"2023-10-25T23:45:15.006483+0000","last_became_active":"2023-10-25T23:36:09.295635+0000","last_became_peered":"2023-10-25T23:36:09.295635+0000","last_unstale":"2023-10-25T23:45:15.006483+0000","last_undegraded":"2023-10-25T23:45:15.006483+0000","last_fullsized":"2023-10-25T23:45:15.006483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2031","last_scrub_stamp":"2023-10-25T23:45:15.006366+0000","last_deep_scrub":"40'2031","last_deep_scrub_stamp":"2023-10-25T23:45:15.006366+0000","last_clean_scrub_stamp":"2023-10-25T23:45:15.006366+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:35:33.630970+0000","scrub_duration":0.0051643940000000001,"objects_trimmed":0,"snaptrim_duration":0.046467368000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":10038,"num_write":1186,"num_write_kb":32237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"41'466","reported_seq":511,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.225686+0000","last_change":"2023-10-25T23:44:48.225686+0000","last_active":"2023-10-25T23:44:48.225686+0000","last_peered":"2023-10-25T23:44:48.225686+0000","last_clean":"2023-10-25T23:44:48.225686+0000","last_became_active":"2023-10-25T23:36:08.277344+0000","last_became_peered":"2023-10-25T23:36:08.277344+0000","last_unstale":"2023-10-25T23:44:48.225686+0000","last_undegraded":"2023-10-25T23:44:48.225686+0000","last_fullsized":"2023-10-25T23:44:48.225686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'466","last_scrub_stamp":"2023-10-25T23:44:48.225545+0000","last_deep_scrub":"41'466","last_deep_scrub_stamp":"2023-10-25T23:44:48.225545+0000","last_clean_scrub_stamp":"2023-10-25T23:44:48.225545+0000","objects_scrubbed":24,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:28:40.923648+0000","scrub_duration":0.059957362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25170780,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":452,"num_write_kb":113081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1826286,"num_omap_keys":3161,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"40'2042","reported_seq":4679,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:06.491512+0000","last_change":"2023-10-25T23:45:06.491512+0000","last_active":"2023-10-25T23:45:06.491512+0000","last_peered":"2023-10-25T23:45:06.491512+0000","last_clean":"2023-10-25T23:45:06.491512+0000","last_became_active":"2023-10-25T23:36:09.299234+0000","last_became_peered":"2023-10-25T23:36:09.299234+0000","last_unstale":"2023-10-25T23:45:06.491512+0000","last_undegraded":"2023-10-25T23:45:06.491512+0000","last_fullsized":"2023-10-25T23:45:06.491512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2042","last_scrub_stamp":"2023-10-25T23:45:06.491349+0000","last_deep_scrub":"40'2042","last_deep_scrub_stamp":"2023-10-25T23:45:06.491349+0000","last_clean_scrub_stamp":"2023-10-25T23:45:06.491349+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:10:01.261301+0000","scrub_duration":0.0050064489999999996,"objects_trimmed":0,"snaptrim_duration":0.15372042599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":4213,"num_write":1231,"num_write_kb":8559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"40'482","reported_seq":527,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.873207+0000","last_change":"2023-10-25T23:44:46.025275+0000","last_active":"2023-10-25T23:44:47.873207+0000","last_peered":"2023-10-25T23:44:47.873207+0000","last_clean":"2023-10-25T23:44:47.873207+0000","last_became_active":"2023-10-25T23:36:08.269065+0000","last_became_peered":"2023-10-25T23:36:08.269065+0000","last_unstale":"2023-10-25T23:44:47.873207+0000","last_undegraded":"2023-10-25T23:44:47.873207+0000","last_fullsized":"2023-10-25T23:44:47.873207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'482","last_scrub_stamp":"2023-10-25T23:44:46.025130+0000","last_deep_scrub":"40'482","last_deep_scrub_stamp":"2023-10-25T23:44:46.025130+0000","last_clean_scrub_stamp":"2023-10-25T23:44:46.025130+0000","objects_scrubbed":16,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:34:52.570294+0000","scrub_duration":0.049678989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":460,"num_write_kb":103224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":431890,"num_omap_keys":741,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"40'2036","reported_seq":4678,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:21.186455+0000","last_change":"2023-10-25T23:45:21.186508+0000","last_active":"2023-10-25T23:45:21.186455+0000","last_peered":"2023-10-25T23:45:21.186455+0000","last_clean":"2023-10-25T23:45:21.186455+0000","last_became_active":"2023-10-25T23:36:09.294494+0000","last_became_peered":"2023-10-25T23:36:09.294494+0000","last_unstale":"2023-10-25T23:45:21.186455+0000","last_undegraded":"2023-10-25T23:45:21.186455+0000","last_fullsized":"2023-10-25T23:45:21.186455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2036","last_scrub_stamp":"2023-10-25T23:45:21.186324+0000","last_deep_scrub":"40'2036","last_deep_scrub_stamp":"2023-10-25T23:45:21.186324+0000","last_clean_scrub_stamp":"2023-10-25T23:45:21.186324+0000","objects_scrubbed":0,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:39:41.386011+0000","scrub_duration":0.0034902169999999999,"objects_trimmed":0,"snaptrim_duration":0.043914717999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":9037,"num_write":1232,"num_write_kb":21545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"40'2057","reported_seq":4712,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:16.095080+0000","last_change":"2023-10-25T23:45:16.095132+0000","last_active":"2023-10-25T23:45:16.095080+0000","last_peered":"2023-10-25T23:45:16.095080+0000","last_clean":"2023-10-25T23:45:16.095080+0000","last_became_active":"2023-10-25T23:36:09.291665+0000","last_became_peered":"2023-10-25T23:36:09.291665+0000","last_unstale":"2023-10-25T23:45:16.095080+0000","last_undegraded":"2023-10-25T23:45:16.095080+0000","last_fullsized":"2023-10-25T23:45:16.095080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2057","last_scrub_stamp":"2023-10-25T23:45:16.094982+0000","last_deep_scrub":"40'2057","last_deep_scrub_stamp":"2023-10-25T23:45:16.094982+0000","last_clean_scrub_stamp":"2023-10-25T23:45:16.094982+0000","objects_scrubbed":0,"log_size":2057,"log_dups_size":0,"ondisk_log_size":2057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:40.788548+0000","scrub_duration":0.0064347279999999998,"objects_trimmed":0,"snaptrim_duration":0.048033508000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":23343,"num_write":1242,"num_write_kb":29102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"40'2179","reported_seq":4794,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:53.099051+0000","last_change":"2023-10-25T23:44:53.099104+0000","last_active":"2023-10-25T23:44:53.099051+0000","last_peered":"2023-10-25T23:44:53.099051+0000","last_clean":"2023-10-25T23:44:53.099051+0000","last_became_active":"2023-10-25T23:36:09.295817+0000","last_became_peered":"2023-10-25T23:36:09.295817+0000","last_unstale":"2023-10-25T23:44:53.099051+0000","last_undegraded":"2023-10-25T23:44:53.099051+0000","last_fullsized":"2023-10-25T23:44:53.099051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2179","last_scrub_stamp":"2023-10-25T23:44:53.098932+0000","last_deep_scrub":"40'2179","last_deep_scrub_stamp":"2023-10-25T23:44:53.098932+0000","last_clean_scrub_stamp":"2023-10-25T23:44:53.098932+0000","objects_scrubbed":0,"log_size":2179,"log_dups_size":0,"ondisk_log_size":2179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:52:57.502348+0000","scrub_duration":0.006673806,"objects_trimmed":0,"snaptrim_duration":0.038422899000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":12397,"num_write":1283,"num_write_kb":33443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"40'2078","reported_seq":4704,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:15.534199+0000","last_change":"2023-10-25T23:45:15.534252+0000","last_active":"2023-10-25T23:45:15.534199+0000","last_peered":"2023-10-25T23:45:15.534199+0000","last_clean":"2023-10-25T23:45:15.534199+0000","last_became_active":"2023-10-25T23:36:09.299024+0000","last_became_peered":"2023-10-25T23:36:09.299024+0000","last_unstale":"2023-10-25T23:45:15.534199+0000","last_undegraded":"2023-10-25T23:45:15.534199+0000","last_fullsized":"2023-10-25T23:45:15.534199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2078","last_scrub_stamp":"2023-10-25T23:45:15.534080+0000","last_deep_scrub":"40'2078","last_deep_scrub_stamp":"2023-10-25T23:45:15.534080+0000","last_clean_scrub_stamp":"2023-10-25T23:45:15.534080+0000","objects_scrubbed":0,"log_size":2078,"log_dups_size":0,"ondisk_log_size":2078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:14:22.315958+0000","scrub_duration":0.0053379250000000003,"objects_trimmed":0,"snaptrim_duration":0.14682810099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":4357,"num_write":1220,"num_write_kb":7384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"40'2239","reported_seq":4824,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:19.920818+0000","last_change":"2023-10-25T23:45:19.920869+0000","last_active":"2023-10-25T23:45:19.920818+0000","last_peered":"2023-10-25T23:45:19.920818+0000","last_clean":"2023-10-25T23:45:19.920818+0000","last_became_active":"2023-10-25T23:36:09.292344+0000","last_became_peered":"2023-10-25T23:36:09.292344+0000","last_unstale":"2023-10-25T23:45:19.920818+0000","last_undegraded":"2023-10-25T23:45:19.920818+0000","last_fullsized":"2023-10-25T23:45:19.920818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2239","last_scrub_stamp":"2023-10-25T23:45:19.920695+0000","last_deep_scrub":"40'2239","last_deep_scrub_stamp":"2023-10-25T23:45:19.920695+0000","last_clean_scrub_stamp":"2023-10-25T23:45:19.920695+0000","objects_scrubbed":0,"log_size":2239,"log_dups_size":0,"ondisk_log_size":2239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:39:25.719358+0000","scrub_duration":0.0050382639999999998,"objects_trimmed":0,"snaptrim_duration":0.21297281000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":3547,"num_write":1298,"num_write_kb":27693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"40'2020","reported_seq":4633,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:06.023530+0000","last_change":"2023-10-25T23:45:06.023588+0000","last_active":"2023-10-25T23:45:06.023530+0000","last_peered":"2023-10-25T23:45:06.023530+0000","last_clean":"2023-10-25T23:45:06.023530+0000","last_became_active":"2023-10-25T23:36:09.297202+0000","last_became_peered":"2023-10-25T23:36:09.297202+0000","last_unstale":"2023-10-25T23:45:06.023530+0000","last_undegraded":"2023-10-25T23:45:06.023530+0000","last_fullsized":"2023-10-25T23:45:06.023530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2020","last_scrub_stamp":"2023-10-25T23:45:06.023406+0000","last_deep_scrub":"40'2020","last_deep_scrub_stamp":"2023-10-25T23:45:06.023406+0000","last_clean_scrub_stamp":"2023-10-25T23:45:06.023406+0000","objects_scrubbed":0,"log_size":2020,"log_dups_size":0,"ondisk_log_size":2020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:25.217776+0000","scrub_duration":0.0053996699999999996,"objects_trimmed":0,"snaptrim_duration":0.040736076000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":7838,"num_write":1164,"num_write_kb":15586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"40'2026","reported_seq":4745,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:13.425105+0000","last_change":"2023-10-25T23:45:13.425180+0000","last_active":"2023-10-25T23:45:13.425105+0000","last_peered":"2023-10-25T23:45:13.425105+0000","last_clean":"2023-10-25T23:45:13.425105+0000","last_became_active":"2023-10-25T23:36:09.293157+0000","last_became_peered":"2023-10-25T23:36:09.293157+0000","last_unstale":"2023-10-25T23:45:13.425105+0000","last_undegraded":"2023-10-25T23:45:13.425105+0000","last_fullsized":"2023-10-25T23:45:13.425105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2026","last_scrub_stamp":"2023-10-25T23:45:13.424958+0000","last_deep_scrub":"40'2026","last_deep_scrub_stamp":"2023-10-25T23:45:13.424958+0000","last_clean_scrub_stamp":"2023-10-25T23:45:13.424958+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:16:28.966663+0000","scrub_duration":0.003821227,"objects_trimmed":0,"snaptrim_duration":0.052457090999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":301,"num_read_kb":22462,"num_write":1198,"num_write_kb":27011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"40'2171","reported_seq":4784,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:24.229389+0000","last_change":"2023-10-25T23:45:24.229437+0000","last_active":"2023-10-25T23:45:24.229389+0000","last_peered":"2023-10-25T23:45:24.229389+0000","last_clean":"2023-10-25T23:45:24.229389+0000","last_became_active":"2023-10-25T23:36:09.288127+0000","last_became_peered":"2023-10-25T23:36:09.288127+0000","last_unstale":"2023-10-25T23:45:24.229389+0000","last_undegraded":"2023-10-25T23:45:24.229389+0000","last_fullsized":"2023-10-25T23:45:24.229389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2171","last_scrub_stamp":"2023-10-25T23:45:24.229294+0000","last_deep_scrub":"40'2171","last_deep_scrub_stamp":"2023-10-25T23:45:24.229294+0000","last_clean_scrub_stamp":"2023-10-25T23:45:24.229294+0000","objects_scrubbed":0,"log_size":2171,"log_dups_size":0,"ondisk_log_size":2171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:19:50.026086+0000","scrub_duration":0.0047486469999999999,"objects_trimmed":0,"snaptrim_duration":0.055712415000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":4655,"num_write":1304,"num_write_kb":14899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"40'1998","reported_seq":4629,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.047861+0000","last_change":"2023-10-25T23:44:38.912556+0000","last_active":"2023-10-25T23:44:48.047861+0000","last_peered":"2023-10-25T23:44:48.047861+0000","last_clean":"2023-10-25T23:44:48.047861+0000","last_became_active":"2023-10-25T23:36:09.290160+0000","last_became_peered":"2023-10-25T23:36:09.290160+0000","last_unstale":"2023-10-25T23:44:48.047861+0000","last_undegraded":"2023-10-25T23:44:48.047861+0000","last_fullsized":"2023-10-25T23:44:48.047861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-25T23:36:08.251220+0000","last_clean_scrub_stamp":"2023-10-25T23:36:08.251220+0000","objects_scrubbed":0,"log_size":1998,"log_dups_size":0,"ondisk_log_size":1998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.038380149000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":16054,"num_write":1171,"num_write_kb":30881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"40'2015","reported_seq":4656,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:01.359181+0000","last_change":"2023-10-25T23:45:01.359231+0000","last_active":"2023-10-25T23:45:01.359181+0000","last_peered":"2023-10-25T23:45:01.359181+0000","last_clean":"2023-10-25T23:45:01.359181+0000","last_became_active":"2023-10-25T23:36:09.298637+0000","last_became_peered":"2023-10-25T23:36:09.298637+0000","last_unstale":"2023-10-25T23:45:01.359181+0000","last_undegraded":"2023-10-25T23:45:01.359181+0000","last_fullsized":"2023-10-25T23:45:01.359181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2015","last_scrub_stamp":"2023-10-25T23:45:01.359064+0000","last_deep_scrub":"40'2015","last_deep_scrub_stamp":"2023-10-25T23:45:01.359064+0000","last_clean_scrub_stamp":"2023-10-25T23:45:01.359064+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:40:54.188454+0000","scrub_duration":0.0052526810000000004,"objects_trimmed":0,"snaptrim_duration":0.16094475499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":3413,"num_write":1198,"num_write_kb":11362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"40'1990","reported_seq":4635,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:21.979296+0000","last_change":"2023-10-25T23:45:21.979400+0000","last_active":"2023-10-25T23:45:21.979296+0000","last_peered":"2023-10-25T23:45:21.979296+0000","last_clean":"2023-10-25T23:45:21.979296+0000","last_became_active":"2023-10-25T23:36:09.290546+0000","last_became_peered":"2023-10-25T23:36:09.290546+0000","last_unstale":"2023-10-25T23:45:21.979296+0000","last_undegraded":"2023-10-25T23:45:21.979296+0000","last_fullsized":"2023-10-25T23:45:21.979296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1990","last_scrub_stamp":"2023-10-25T23:45:21.979175+0000","last_deep_scrub":"40'1990","last_deep_scrub_stamp":"2023-10-25T23:45:21.979175+0000","last_clean_scrub_stamp":"2023-10-25T23:45:21.979175+0000","objects_scrubbed":0,"log_size":1990,"log_dups_size":0,"ondisk_log_size":1990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:14:28.761053+0000","scrub_duration":0.0060692280000000003,"objects_trimmed":0,"snaptrim_duration":0.041791974000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":7180,"num_write":1206,"num_write_kb":23829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"40'2170","reported_seq":4763,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:18.521742+0000","last_change":"2023-10-25T23:45:18.521846+0000","last_active":"2023-10-25T23:45:18.521742+0000","last_peered":"2023-10-25T23:45:18.521742+0000","last_clean":"2023-10-25T23:45:18.521742+0000","last_became_active":"2023-10-25T23:36:50.102780+0000","last_became_peered":"2023-10-25T23:36:50.102780+0000","last_unstale":"2023-10-25T23:45:18.521742+0000","last_undegraded":"2023-10-25T23:45:18.521742+0000","last_fullsized":"2023-10-25T23:45:18.521742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2170","last_scrub_stamp":"2023-10-25T23:45:18.521605+0000","last_deep_scrub":"40'2170","last_deep_scrub_stamp":"2023-10-25T23:45:18.521605+0000","last_clean_scrub_stamp":"2023-10-25T23:45:18.521605+0000","objects_scrubbed":0,"log_size":2170,"log_dups_size":0,"ondisk_log_size":2170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:56:59.030764+0000","scrub_duration":0.0058813160000000001,"objects_trimmed":0,"snaptrim_duration":0.058087943000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":4977,"num_write":1244,"num_write_kb":20718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"40'2082","reported_seq":4710,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:21.922348+0000","last_change":"2023-10-25T23:45:21.922439+0000","last_active":"2023-10-25T23:45:21.922348+0000","last_peered":"2023-10-25T23:45:21.922348+0000","last_clean":"2023-10-25T23:45:21.922348+0000","last_became_active":"2023-10-25T23:36:09.285610+0000","last_became_peered":"2023-10-25T23:36:09.285610+0000","last_unstale":"2023-10-25T23:45:21.922348+0000","last_undegraded":"2023-10-25T23:45:21.922348+0000","last_fullsized":"2023-10-25T23:45:21.922348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2082","last_scrub_stamp":"2023-10-25T23:45:21.922226+0000","last_deep_scrub":"40'2082","last_deep_scrub_stamp":"2023-10-25T23:45:21.922226+0000","last_clean_scrub_stamp":"2023-10-25T23:45:21.922226+0000","objects_scrubbed":0,"log_size":2082,"log_dups_size":0,"ondisk_log_size":2082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:12:17.815377+0000","scrub_duration":0.0053207369999999999,"objects_trimmed":0,"snaptrim_duration":0.19375678499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":4129,"num_write":1211,"num_write_kb":11664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"40'2134","reported_seq":4766,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:23.194100+0000","last_change":"2023-10-25T23:45:23.194149+0000","last_active":"2023-10-25T23:45:23.194100+0000","last_peered":"2023-10-25T23:45:23.194100+0000","last_clean":"2023-10-25T23:45:23.194100+0000","last_became_active":"2023-10-25T23:36:09.291566+0000","last_became_peered":"2023-10-25T23:36:09.291566+0000","last_unstale":"2023-10-25T23:45:23.194100+0000","last_undegraded":"2023-10-25T23:45:23.194100+0000","last_fullsized":"2023-10-25T23:45:23.194100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2134","last_scrub_stamp":"2023-10-25T23:45:23.193993+0000","last_deep_scrub":"40'2134","last_deep_scrub_stamp":"2023-10-25T23:45:23.193993+0000","last_clean_scrub_stamp":"2023-10-25T23:45:23.193993+0000","objects_scrubbed":0,"log_size":2134,"log_dups_size":0,"ondisk_log_size":2134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:52:31.773771+0000","scrub_duration":0.006258558,"objects_trimmed":0,"snaptrim_duration":0.052820837000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":9012,"num_write":1282,"num_write_kb":25857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":13919,"num_read_kb":527624,"num_write":78511,"num_write_kb":1459527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":40,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133210,"ondisk_log_size":133210,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":885503921,"num_objects":563,"num_object_clones":0,"num_object_copies":1126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":563,"num_whiteouts":0,"num_read":739,"num_read_kb":4869,"num_write":13298,"num_write_kb":3083597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":344,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34320062,"num_omap_keys":57187,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1771069440,"data_stored":1771007842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14265,"ondisk_log_size":14265,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":431200,"kb_used_data":295960,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":93940640,"statfs":{"total":96636764160,"available":96195215360,"internally_reserved":0,"allocated":303063040,"data_stored":302784975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":138475979},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.76300000000000001,"15min":0.59899999999999998},"min":{"1min":0.42299999999999999,"5min":0.25900000000000001,"15min":0.20399999999999999},"max":{"1min":1.117,"5min":34.116999999999997,"15min":34.116999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.47199999999999998,"15min":0.50600000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.222},"max":{"1min":0.71899999999999997,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.67400000000000004}]},{"osd":1,"last update":"Wed Oct 25 23:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.77400000000000002,"15min":0.61099999999999999},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65400000000000003,"5min":34.424999999999997,"15min":34.424999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.79100000000000004,"15min":0.621},"min":{"1min":0.36399999999999999,"5min":0.29599999999999999,"15min":0.28100000000000003},"max":{"1min":0.69799999999999995,"5min":32.781999999999996,"15min":32.781999999999996},"last":0.64400000000000002}]},{"osd":2,"last update":"Wed Oct 25 23:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.52200000000000002,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.28899999999999998,"15min":0.25600000000000001},"max":{"1min":1.4510000000000001,"5min":1.964,"15min":1.964},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.80400000000000005,"15min":0.63700000000000001},"min":{"1min":0.39000000000000001,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":34.066000000000003,"15min":34.066000000000003},"last":0.51300000000000001}]},{"osd":3,"last update":"Wed Oct 25 23:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.97999999999999998,"15min":0.68700000000000006},"min":{"1min":0.39000000000000001,"5min":0.313,"15min":0.28599999999999998},"max":{"1min":1.4179999999999999,"5min":50.606999999999999,"15min":50.606999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.91800000000000004,"15min":0.68899999999999995},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.30199999999999999},"max":{"1min":0.77600000000000002,"5min":41.027999999999999,"15min":41.027999999999999},"last":0.66000000000000003}]},{"osd":4,"last update":"Wed Oct 25 23:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.72799999999999998,"15min":0.55400000000000005},"min":{"1min":0.34300000000000003,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.65800000000000003,"5min":28,"15min":28},"last":0.376},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.76000000000000001,"15min":0.59499999999999997},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67100000000000004,"5min":28.25,"15min":28.25},"last":0.41499999999999998}]},{"osd":5,"last update":"Wed Oct 25 23:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.84799999999999998,"15min":0.63200000000000001},"min":{"1min":0.371,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.74099999999999999,"5min":34.393000000000001,"15min":34.393000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.64000000000000001,"15min":0.58199999999999996},"min":{"1min":0.374,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.752,"5min":10.099,"15min":10.099},"last":0.443}]},{"osd":6,"last update":"Wed Oct 25 23:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.73399999999999999,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.75900000000000001,"5min":18.271999999999998,"15min":18.271999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.99099999999999999,"15min":0.71299999999999997},"min":{"1min":0.34399999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82499999999999996,"5min":47.531999999999996,"15min":47.531999999999996},"last":0.49299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574965,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":358336,"kb_used_data":246712,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94013504,"statfs":{"total":96636764160,"available":96269828096,"internally_reserved":0,"allocated":252633088,"data_stored":252362455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":114293191},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.47999999999999998,"15min":0.51300000000000001},"min":{"1min":0.34000000000000002,"5min":0.26400000000000001,"15min":0.248},"max":{"1min":1.492,"5min":3.3140000000000001,"15min":3.3140000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.57899999999999996,"15min":0.55000000000000004},"min":{"1min":0.24399999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":2.9590000000000001,"5min":11.619,"15min":11.619},"last":0.60899999999999999}]},{"osd":1,"last update":"Wed Oct 25 23:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.30199999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.3200000000000001,"5min":3.468,"15min":3.468},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.53500000000000003,"15min":0.56000000000000005},"min":{"1min":0.29299999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.964,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.63800000000000001}]},{"osd":2,"last update":"Wed Oct 25 23:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.71099999999999997,"15min":0.59599999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":4.4509999999999996,"5min":11.683999999999999,"15min":11.683999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.629,"15min":0.56399999999999995},"min":{"1min":0.33200000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.754,"5min":11.784000000000001,"15min":11.784000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Wed Oct 25 23:45:14 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1870000000000001,"15min":0.80700000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":8.891,"5min":61.121000000000002,"15min":61.121000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.60199999999999998,"15min":0.58799999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":0.70799999999999996}]},{"osd":4,"last update":"Wed Oct 25 23:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.59099999999999997,"15min":0.53700000000000003},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.61599999999999999,"5min":12.169,"15min":12.169},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.65200000000000002,"15min":0.57999999999999996},"min":{"1min":0.245,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.7730000000000001,"5min":11.554,"15min":11.554},"last":0.41599999999999998}]},{"osd":5,"last update":"Wed Oct 25 23:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.62,"15min":0.55300000000000005},"min":{"1min":0.27500000000000002,"5min":0.26100000000000001,"15min":0.245},"max":{"1min":0.63500000000000001,"5min":11.755000000000001,"15min":11.755000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.8119999999999998,"5min":3.2879999999999998,"15min":3.2879999999999998},"last":0.47599999999999998}]},{"osd":7,"last update":"Wed Oct 25 23:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.99099999999999999,"15min":0.72099999999999997},"min":{"1min":0.34499999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.3839999999999999,"5min":29.977,"15min":29.977},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.97399999999999998,"15min":0.71099999999999997},"min":{"1min":0.36699999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69099999999999995,"5min":29.925000000000001,"15min":29.925000000000001},"last":0.58399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361884,"kb_used_data":254420,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94009956,"statfs":{"total":96636764160,"available":96266194944,"internally_reserved":0,"allocated":260526080,"data_stored":260256021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.377,"15min":0.36899999999999999},"min":{"1min":0.17599999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.624,"5min":4.2839999999999998,"15min":6.9370000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":1.0209999999999999,"15min":0.57099999999999995},"min":{"1min":0.28399999999999997,"5min":0.20999999999999999,"15min":0.19900000000000001},"max":{"1min":4.0140000000000002,"5min":66.522000000000006,"15min":66.522000000000006},"last":0.39300000000000002}]},{"osd":2,"last update":"Wed Oct 25 23:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.34999999999999998},"min":{"1min":0.222,"5min":0.20999999999999999,"15min":0.20399999999999999},"max":{"1min":0.51500000000000001,"5min":4.9180000000000001,"15min":4.9180000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":1.137,"5min":0.56799999999999995,"15min":0.441},"min":{"1min":0.25900000000000001,"5min":0.186,"15min":0.186},"max":{"1min":9.3620000000000001,"5min":9.3620000000000001,"15min":9.3620000000000001},"last":0.41499999999999998}]},{"osd":3,"last update":"Wed Oct 25 23:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.71499999999999997,"15min":0.504},"min":{"1min":0.30399999999999999,"5min":0.254,"15min":0.249},"max":{"1min":9.3149999999999995,"5min":21.943000000000001,"15min":21.943000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65400000000000003,"15min":0.49399999999999999},"min":{"1min":0.28599999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":4.0839999999999996,"5min":23.300999999999998,"15min":23.300999999999998},"last":0.42599999999999999}]},{"osd":4,"last update":"Wed Oct 25 23:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.69099999999999995,"15min":0.58399999999999996},"min":{"1min":0.41099999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77900000000000003,"5min":14.066000000000001,"15min":14.066000000000001},"last":0.747},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63400000000000001,"15min":0.58499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.32500000000000001},"max":{"1min":0.88900000000000001,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":0.72199999999999998}]},{"osd":5,"last update":"Wed Oct 25 23:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.64000000000000001,"15min":0.58999999999999997},"min":{"1min":0.45400000000000001,"5min":0.376,"15min":0.33300000000000002},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.41099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.88600000000000001,"5min":4.9960000000000004,"15min":9.7650000000000006},"last":0.66900000000000004}]},{"osd":6,"last update":"Wed Oct 25 23:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.65700000000000003,"15min":0.60999999999999999},"min":{"1min":0.45500000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.86199999999999999,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.84999999999999998,"15min":0.67300000000000004},"min":{"1min":0.47499999999999998,"5min":0.38400000000000001,"15min":0.35399999999999998},"max":{"1min":4.1879999999999997,"5min":21.876000000000001,"15min":21.876000000000001},"last":0.79000000000000004}]},{"osd":7,"last update":"Wed Oct 25 23:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.64200000000000002,"15min":0.60999999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.78000000000000003,"15min":0.65400000000000003},"min":{"1min":0.46300000000000002,"5min":0.371,"15min":0.36399999999999999},"max":{"1min":0.91700000000000004,"5min":18.754999999999999,"15min":18.754999999999999},"last":0.69199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":373980,"kb_used_data":230420,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":93997860,"statfs":{"total":96636764160,"available":96253808640,"internally_reserved":0,"allocated":235950080,"data_stored":235676152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 23:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.377,"15min":0.35899999999999999},"min":{"1min":0.224,"5min":0.20200000000000001,"15min":0.17899999999999999},"max":{"1min":0.502,"5min":4.649,"15min":4.649},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39900000000000002,"15min":0.36699999999999999},"min":{"1min":0.214,"5min":0.20499999999999999,"15min":0.19400000000000001},"max":{"1min":0.57299999999999995,"5min":5.1589999999999998,"15min":5.1589999999999998},"last":0.50800000000000001}]},{"osd":2,"last update":"Wed Oct 25 23:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.40999999999999998,"15min":0.38400000000000001},"min":{"1min":0.247,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.64000000000000001,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.31},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.43099999999999999,"15min":0.40699999999999997},"min":{"1min":0.28499999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57699999999999996,"5min":7.6870000000000003,"15min":7.6870000000000003},"last":0.38200000000000001}]},{"osd":3,"last update":"Wed Oct 25 23:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.439,"15min":0.39400000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.23899999999999999},"max":{"1min":0.59299999999999997,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48199999999999998,"15min":0.44400000000000001},"min":{"1min":0.29399999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.61799999999999999,"5min":5.0750000000000002,"15min":5.0750000000000002},"last":0.52900000000000003}]},{"osd":4,"last update":"Wed Oct 25 23:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.35799999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.78000000000000003,"5min":5.9729999999999999,"15min":5.9729999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61399999999999999,"15min":0.58799999999999997},"min":{"1min":0.42099999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77300000000000002,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.60299999999999998}]},{"osd":5,"last update":"Wed Oct 25 23:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.38,"5min":0.375,"15min":0.32300000000000001},"max":{"1min":0.83099999999999996,"5min":5.1120000000000001,"15min":8.5169999999999995},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.64600000000000002,"15min":0.60499999999999998},"min":{"1min":0.38900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.84699999999999998,"5min":6.0199999999999996,"15min":6.0199999999999996},"last":0.54900000000000004}]},{"osd":6,"last update":"Wed Oct 25 23:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.621,"15min":0.59399999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67300000000000004,"5min":4.9850000000000003,"15min":4.9850000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64800000000000002,"15min":0.63},"min":{"1min":0.44600000000000001,"5min":0.38100000000000001,"15min":0.32200000000000001},"max":{"1min":0.79400000000000004,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.626}]},{"osd":7,"last update":"Wed Oct 25 23:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65500000000000003,"15min":0.66200000000000003},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81499999999999995,"5min":6.0720000000000001,"15min":8.4979999999999993},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64300000000000002,"15min":0.60699999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81599999999999995,"5min":4.883,"15min":4.883},"last":0.56100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188108,"kb_used_data":102852,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94183732,"statfs":{"total":96636764160,"available":96444141568,"internally_reserved":0,"allocated":105320448,"data_stored":105061722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34000000000000002,"15min":0.76800000000000002},"min":{"1min":0.219,"5min":0.184,"15min":0.184},"max":{"1min":0.53600000000000003,"5min":2.7269999999999999,"15min":18.052},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.438,"5min":0.372,"15min":0.374},"min":{"1min":0.26100000000000001,"5min":0.215,"15min":0.20599999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.251}]},{"osd":1,"last update":"Wed Oct 25 23:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35099999999999998,"15min":0.79000000000000004},"min":{"1min":0.247,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.51400000000000001,"5min":1.03,"15min":18.175000000000001},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.35899999999999999,"15min":0.61499999999999999},"min":{"1min":0.23799999999999999,"5min":0.23200000000000001,"15min":0.22700000000000001},"max":{"1min":1.643,"5min":1.643,"15min":10.23},"last":0.33600000000000002}]},{"osd":3,"last update":"Wed Oct 25 23:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.376,"15min":0.83099999999999996},"min":{"1min":0.32000000000000001,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":0.57699999999999996,"5min":0.97999999999999998,"15min":18.236000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.432,"15min":0.86399999999999999},"min":{"1min":0.30399999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.60699999999999998,"5min":2.1339999999999999,"15min":18.004999999999999},"last":0.43099999999999999}]},{"osd":4,"last update":"Wed Oct 25 23:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56899999999999995,"15min":0.748},"min":{"1min":0.38100000000000001,"5min":0.35999999999999999,"15min":0.32100000000000001},"max":{"1min":0.79500000000000004,"5min":1.2589999999999999,"15min":8.1839999999999993},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.841,"5min":1.841,"15min":2.4580000000000002},"last":0.64300000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.57399999999999995,"15min":0.59499999999999997},"min":{"1min":0.45000000000000001,"5min":0.33700000000000002,"15min":0.31900000000000001},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":8.3520000000000003},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.58999999999999997,"15min":1.016},"min":{"1min":0.52300000000000002,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.78700000000000003,"5min":1.4419999999999999,"15min":18.143999999999998},"last":0.61899999999999999}]},{"osd":6,"last update":"Wed Oct 25 23:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58199999999999996,"15min":1.038},"min":{"1min":0.41499999999999998,"5min":0.34300000000000003,"15min":0.316},"max":{"1min":0.83099999999999996,"5min":1.012,"15min":18.206},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.754},"min":{"1min":0.46400000000000002,"5min":0.40600000000000003,"15min":0.35399999999999998},"max":{"1min":0.76400000000000001,"5min":1.3240000000000001,"15min":7.0060000000000002},"last":0.80200000000000005}]},{"osd":7,"last update":"Wed Oct 25 23:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.48999999999999999,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":1.788,"5min":1.788,"15min":2.3900000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70899999999999996,"15min":1.085},"min":{"1min":0.53500000000000003,"5min":0.41799999999999998,"15min":0.39500000000000002},"max":{"1min":0.85799999999999998,"5min":7.9850000000000003,"15min":18.109999999999999},"last":0.81499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574967,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314424,"kb_used_data":184752,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94057416,"statfs":{"total":96636764160,"available":96314793984,"internally_reserved":0,"allocated":189186048,"data_stored":188902628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":132774344},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.46400000000000002,"15min":0.40100000000000002},"min":{"1min":0.26900000000000002,"5min":0.17899999999999999,"15min":0.17799999999999999},"max":{"1min":7.3559999999999999,"5min":7.3559999999999999,"15min":7.3559999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.92700000000000005,"15min":0.55500000000000005},"min":{"1min":0.29899999999999999,"5min":0.218,"15min":0.19400000000000001},"max":{"1min":2.0209999999999999,"5min":55.152999999999999,"15min":55.152999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.27500000000000002,"5min":0.214,"15min":0.20100000000000001},"max":{"1min":0.57699999999999996,"5min":1.752,"15min":2.323},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.57699999999999996,"15min":0.46800000000000003},"min":{"1min":0.33100000000000002,"5min":0.245,"15min":0.24399999999999999},"max":{"1min":7.5309999999999997,"5min":7.5309999999999997,"15min":7.5309999999999997},"last":0.40000000000000002}]},{"osd":2,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":0.56399999999999995,"15min":0.48599999999999999},"min":{"1min":0.376,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":12.343999999999999,"5min":12.343999999999999,"15min":12.343999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.86899999999999999,"15min":0.56699999999999995},"min":{"1min":0.24399999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.3109999999999999,"5min":40.789000000000001,"15min":40.789000000000001},"last":0.46100000000000002}]},{"osd":4,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":1.155,"15min":0.78300000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.218,"5min":58.180999999999997,"15min":58.180999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.66300000000000003,"15min":0.60899999999999999},"min":{"1min":0.35299999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":7.4400000000000004,"5min":7.4400000000000004,"15min":7.4400000000000004},"last":0.61599999999999999}]},{"osd":5,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":1.2150000000000001,"15min":0.80600000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.29999999999999999},"max":{"1min":1.9299999999999999,"5min":60.893999999999998,"15min":60.893999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.65000000000000002,"15min":0.61299999999999999},"min":{"1min":0.44900000000000001,"5min":0.38300000000000001,"15min":0.378},"max":{"1min":0.76700000000000002,"5min":4.2489999999999997,"15min":4.2489999999999997},"last":0.53700000000000003}]},{"osd":6,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63300000000000001,"15min":0.60199999999999998},"min":{"1min":0.41199999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91300000000000003,"5min":2.331,"15min":2.3969999999999998},"last":0.50600000000000001},{"interface":"front","average":{"1min":1.0720000000000001,"5min":0.76300000000000001,"15min":0.67100000000000004},"min":{"1min":0.42299999999999999,"5min":0.372,"15min":0.372},"max":{"1min":7.476,"5min":7.476,"15min":7.476},"last":0.56999999999999995}]},{"osd":7,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.05,"15min":0.77800000000000002},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.38400000000000001},"max":{"1min":7.5049999999999999,"5min":33.006999999999998,"15min":33.006999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":1.1919999999999999,"15min":0.81399999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.986,"5min":56.667999999999999,"15min":56.667999999999999},"last":0.51900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326556,"kb_used_data":209364,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94045284,"statfs":{"total":96636764160,"available":96302370816,"internally_reserved":0,"allocated":214388736,"data_stored":214118638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51400000000000001,"15min":0.85799999999999998},"min":{"1min":0.27500000000000002,"5min":0.26300000000000001,"15min":0.23999999999999999},"max":{"1min":0.751,"5min":3.306,"15min":32.487000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.46000000000000002,"15min":0.51300000000000001},"min":{"1min":0.28999999999999998,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.115,"5min":1.115,"15min":6.0670000000000002},"last":0.57599999999999996}]},{"osd":1,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.75800000000000001,"15min":0.71299999999999997},"min":{"1min":0.34899999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.96599999999999997,"5min":23.579000000000001,"15min":32.417000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.82299999999999995,"15min":0.92300000000000004},"min":{"1min":0.313,"5min":0.248,"15min":0.248},"max":{"1min":0.73799999999999999,"5min":22.800000000000001,"15min":22.800000000000001},"last":0.49099999999999999}]},{"osd":2,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.54400000000000004,"15min":0.60899999999999999},"min":{"1min":0.34300000000000003,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":4.423,"5min":4.423,"15min":14.757999999999999},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.75800000000000001,"15min":0.66000000000000003},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.319,"5min":18.042999999999999,"15min":18.042999999999999},"last":0.41199999999999998}]},{"osd":3,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60199999999999998,"15min":0.73699999999999999},"min":{"1min":0.41799999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.3340000000000001,"5min":6.1360000000000001,"15min":55.222000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.61199999999999999,"15min":0.64500000000000002},"min":{"1min":0.37,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.343,"5min":6.3220000000000001,"15min":14.869999999999999},"last":0.51600000000000001}]},{"osd":5,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.502,"15min":0.56399999999999995},"min":{"1min":0.27300000000000002,"5min":0.26600000000000001,"15min":0.23699999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":6.508},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55000000000000004,"15min":0.61399999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.24199999999999999},"max":{"1min":0.75,"5min":2.403,"15min":6.5270000000000001},"last":0.622}]},{"osd":6,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.5,"15min":0.59899999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.74099999999999999,"5min":0.83599999999999997,"15min":14.805999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53500000000000003,"15min":0.58299999999999996},"min":{"1min":0.35399999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.53000000000000003}]},{"osd":7,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.65600000000000003,"15min":0.627},"min":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.315},"max":{"1min":0.70899999999999996,"5min":12.135999999999999,"15min":12.135999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.81599999999999995,"15min":0.73599999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.29699999999999999},"max":{"1min":0.78200000000000003,"5min":21.465,"15min":21.465},"last":0.54700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574967,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339560,"kb_used_data":209888,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94032280,"statfs":{"total":96636764160,"available":96289054720,"internally_reserved":0,"allocated":214925312,"data_stored":214659003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132774342},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.93000000000000005,"15min":0.66400000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":2.278,"5min":48.045999999999999,"15min":48.045999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.53000000000000003,"15min":0.53200000000000003},"min":{"1min":0.35999999999999999,"5min":0.27700000000000002,"15min":0.26000000000000001},"max":{"1min":2.339,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.63}]},{"osd":1,"last update":"Wed Oct 25 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.58399999999999996,"15min":0.53600000000000003},"min":{"1min":0.34799999999999998,"5min":0.30099999999999999,"15min":0.27200000000000002},"max":{"1min":4.8940000000000001,"5min":4.8940000000000001,"15min":4.8940000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":1.097,"5min":0.59999999999999998,"15min":0.58199999999999996},"min":{"1min":0.38,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":6.2069999999999999,"5min":6.2069999999999999,"15min":6.2069999999999999},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed Oct 25 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.623,"15min":0.56799999999999995},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.4140000000000001,"5min":13.271000000000001,"15min":13.271000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.60499999999999998,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.311,"15min":0.29399999999999998},"max":{"1min":4.1529999999999996,"5min":7.141,"15min":7.141},"last":0.49199999999999999}]},{"osd":3,"last update":"Wed Oct 25 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.95999999999999996,"15min":0.69499999999999995},"min":{"1min":0.35199999999999998,"5min":0.309,"15min":0.309},"max":{"1min":2.2029999999999998,"5min":47.875999999999998,"15min":47.875999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.65700000000000003,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":3.5790000000000002,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.44}]},{"osd":4,"last update":"Wed Oct 25 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52600000000000002,"15min":0.5},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":2.3610000000000002,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.316,"5min":0.254,"15min":0.254},"max":{"1min":0.61899999999999999,"5min":2.657,"15min":2.657},"last":0.58299999999999996}]},{"osd":6,"last update":"Wed Oct 25 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58899999999999997,"15min":0.54600000000000004},"min":{"1min":0.309,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.238,"5min":6.9050000000000002,"15min":6.9050000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60199999999999998,"15min":0.55800000000000005},"min":{"1min":0.33600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":2.3879999999999999,"5min":5.9770000000000003,"15min":5.9770000000000003},"last":0.53900000000000003}]},{"osd":7,"last update":"Wed Oct 25 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.36899999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.74099999999999999,"5min":3.8530000000000002,"15min":3.8530000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":2.4670000000000001,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":234893312,"data_stored":234881662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":260059136,"data_stored":260051894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":104857600,"data_stored":104857600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":188706816,"data_stored":188698486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":213925888,"data_stored":213914516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":214462464,"data_stored":214454881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":252170240,"data_stored":252158333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":301993984,"data_stored":301990470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":20,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":15,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-25T23:45:29.129 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:29.129 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:29.130 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:29.130 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:29.131 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:29.131 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:29.132 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:29.133 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:29.133 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2023-10-25T23:36:08.251220+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=36, tm_sec=8, tm_wday=2, tm_yday=298, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=25, tm_hour=23, tm_min=44, tm_sec=42, tm_wday=2, tm_yday=298, tm_isdst=0) 2023-10-25T23:45:29.134 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-25T23:45:47.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:45:47.690 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:45:49.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-25T23:45:49.271 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.269+0000 7f973ae40700 1 -- 172.21.15.81:0/1638469862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9724003a00 msgr2=0x7f9724003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.269+0000 7f973ae40700 1 --2- 172.21.15.81:0/1638469862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9724003a00 0x7f9724003e20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9728009c10 tx=0x7f9724005880 comp rx=0 tx=0).stop 2023-10-25T23:45:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.269+0000 7f97393dd700 1 -- 172.21.15.81:0/1638469862 reap_dead start 2023-10-25T23:45:49.272 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.269+0000 7f973ae40700 1 -- 172.21.15.81:0/1638469862 shutdown_connections 2023-10-25T23:45:49.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.269+0000 7f973ae40700 1 -- 172.21.15.81:0/1638469862 >> 172.21.15.81:0/1638469862 conn(0x7f97340c0a40 msgr2=0x7f97340c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:49.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.269+0000 7f973ae40700 1 -- 172.21.15.81:0/1638469862 shutdown_connections 2023-10-25T23:45:49.273 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.269+0000 7f973ae40700 1 -- 172.21.15.81:0/1638469862 wait complete. 2023-10-25T23:45:49.276 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.270+0000 7f973ae40700 1 Processor -- start 2023-10-25T23:45:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.271+0000 7f973ae40700 1 -- start start 2023-10-25T23:45:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.271+0000 7f973ae40700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9724003a00 0x7f97340ba760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.271+0000 7f973ae40700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97341e0790 0x7f973414a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:49.277 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.271+0000 7f973ae40700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973414abf0 0x7f97340b7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.271+0000 7f973ae40700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97340b94f0 con 0x7f973414abf0 2023-10-25T23:45:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.271+0000 7f973ae40700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973414e070 con 0x7f97341e0790 2023-10-25T23:45:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.271+0000 7f973ae40700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973414e5a0 con 0x7f9724003a00 2023-10-25T23:45:49.278 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.271+0000 7f97393dd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973414abf0 0x7f97340b7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:49.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.271+0000 7f97393dd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973414abf0 0x7f97340b7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37422/0 (socket says 172.21.15.81:37422) 2023-10-25T23:45:49.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.271+0000 7f97393dd700 1 -- 172.21.15.81:0/2785305183 learned_addr learned my addr 172.21.15.81:0/2785305183 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:45:49.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.272+0000 7f9733fff700 1 --2- 172.21.15.81:0/2785305183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97341e0790 0x7f973414a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:49.279 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.272+0000 7f9738bdc700 1 --2- 172.21.15.81:0/2785305183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9724003a00 0x7f97340ba760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:49.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.272+0000 7f97393dd700 1 -- 172.21.15.81:0/2785305183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9724003a00 msgr2=0x7f97340ba760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:49.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.272+0000 7f97393dd700 1 --2- 172.21.15.81:0/2785305183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9724003a00 0x7f97340ba760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.280 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.272+0000 7f97393dd700 1 -- 172.21.15.81:0/2785305183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97341e0790 msgr2=0x7f973414a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:49.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.272+0000 7f97393dd700 1 --2- 172.21.15.81:0/2785305183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97341e0790 0x7f973414a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.272+0000 7f97393dd700 1 -- 172.21.15.81:0/2785305183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97341dffd0 con 0x7f973414abf0 2023-10-25T23:45:49.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.272+0000 7f9733fff700 1 --2- 172.21.15.81:0/2785305183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97341e0790 0x7f973414a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:45:49.281 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.272+0000 7f97393dd700 1 --2- 172.21.15.81:0/2785305183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973414abf0 0x7f97340b7d40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f973406cc60 tx=0x7f972c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:49.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.272+0000 7f97317fa700 1 -- 172.21.15.81:0/2785305183 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c00cab0 con 0x7f973414abf0 2023-10-25T23:45:49.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.272+0000 7f97317fa700 1 -- 172.21.15.81:0/2785305183 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f972c00cd00 con 0x7f973414abf0 2023-10-25T23:45:49.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.272+0000 7f97317fa700 1 -- 172.21.15.81:0/2785305183 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0116c0 con 0x7f973414abf0 2023-10-25T23:45:49.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.272+0000 7f973ae40700 1 -- 172.21.15.81:0/2785305183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973414e2c0 con 0x7f973414abf0 2023-10-25T23:45:49.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.272+0000 7f973ae40700 1 -- 172.21.15.81:0/2785305183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9734133ac0 con 0x7f973414abf0 2023-10-25T23:45:49.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.273+0000 7f973ae40700 1 -- 172.21.15.81:0/2785305183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97341dfe30 con 0x7f973414abf0 2023-10-25T23:45:49.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.273+0000 7f97317fa700 1 -- 172.21.15.81:0/2785305183 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f972c011820 con 0x7f973414abf0 2023-10-25T23:45:49.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.274+0000 7f97317fa700 1 --2- 172.21.15.81:0/2785305183 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f971806aed0 0x7f971806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.274+0000 7f97317fa700 1 -- 172.21.15.81:0/2785305183 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f972c089ca0 con 0x7f973414abf0 2023-10-25T23:45:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.274+0000 7f9738bdc700 1 --2- 172.21.15.81:0/2785305183 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f971806aed0 0x7f971806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.274+0000 7f9738bdc700 1 --2- 172.21.15.81:0/2785305183 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f971806aed0 0x7f971806d390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9728009c10 tx=0x7f97280047c0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.278+0000 7f97317fa700 1 -- 172.21.15.81:0/2785305183 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f97341dfe30 con 0x7f973414abf0 2023-10-25T23:45:49.468 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.467+0000 7f973ae40700 1 -- 172.21.15.81:0/2785305183 --> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f973414f160 con 0x7f971806aed0 2023-10-25T23:45:49.477 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.476+0000 7f97317fa700 1 -- 172.21.15.81:0/2785305183 <== mgr.4133 v2:172.21.15.89:6832/3905428844 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+295484 (secure 0 0 0) 0x7f972801e040 con 0x7f971806aed0 2023-10-25T23:45:49.481 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:45:49.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.479+0000 7f973ae40700 1 -- 172.21.15.81:0/2785305183 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f971806aed0 msgr2=0x7f971806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:49.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.479+0000 7f973ae40700 1 --2- 172.21.15.81:0/2785305183 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f971806aed0 0x7f971806d390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9728009c10 tx=0x7f97280047c0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.479+0000 7f973ae40700 1 -- 172.21.15.81:0/2785305183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973414abf0 msgr2=0x7f97340b7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:49.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.479+0000 7f973ae40700 1 --2- 172.21.15.81:0/2785305183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973414abf0 0x7f97340b7d40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f973406cc60 tx=0x7f972c00ec10 comp rx=0 tx=0).stop 2023-10-25T23:45:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.479+0000 7f973ae40700 1 -- 172.21.15.81:0/2785305183 shutdown_connections 2023-10-25T23:45:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.479+0000 7f973ae40700 1 --2- 172.21.15.81:0/2785305183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973414abf0 0x7f97340b7d40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.479+0000 7f973ae40700 1 --2- 172.21.15.81:0/2785305183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9724003a00 0x7f97340ba760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.479+0000 7f973ae40700 1 --2- 172.21.15.81:0/2785305183 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f971806aed0 0x7f971806d390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.479+0000 7f973ae40700 1 --2- 172.21.15.81:0/2785305183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97341e0790 0x7f973414a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.479+0000 7f973ae40700 1 -- 172.21.15.81:0/2785305183 >> 172.21.15.81:0/2785305183 conn(0x7f97340c0a40 msgr2=0x7f9734132390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.479+0000 7f973ae40700 1 -- 172.21.15.81:0/2785305183 shutdown_connections 2023-10-25T23:45:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.479+0000 7f973ae40700 1 -- 172.21.15.81:0/2785305183 wait complete. 2023-10-25T23:45:49.487 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2023-10-25T23:45:49.493 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2023-10-25T23:45:49.136757+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":886094309,"num_objects":569,"num_object_clones":2,"num_object_copies":1138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":569,"num_whiteouts":0,"num_read":14774,"num_read_kb":532593,"num_write":91968,"num_write_kb":4545540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":344,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34320062,"num_omap_keys":57187,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147594,"ondisk_log_size":147594,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2694048,"kb_used_data":1734368,"kb_used_omap":12,"kb_used_meta":959603,"kb_avail":752280672,"statfs":{"total":773094113280,"available":770335408128,"internally_reserved":0,"allocated":1775992832,"data_stored":1773821594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":982634040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003150"},"pg_stats":[{"pgid":"3.3f","version":"40'1945","reported_seq":4574,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:31.220213+0000","last_change":"2023-10-25T23:45:31.220274+0000","last_active":"2023-10-25T23:45:31.220213+0000","last_peered":"2023-10-25T23:45:31.220213+0000","last_clean":"2023-10-25T23:45:31.220213+0000","last_became_active":"2023-10-25T23:36:09.292007+0000","last_became_peered":"2023-10-25T23:36:09.292007+0000","last_unstale":"2023-10-25T23:45:31.220213+0000","last_undegraded":"2023-10-25T23:45:31.220213+0000","last_fullsized":"2023-10-25T23:45:31.220213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1945","last_scrub_stamp":"2023-10-25T23:45:31.220095+0000","last_deep_scrub":"40'1945","last_deep_scrub_stamp":"2023-10-25T23:45:31.220095+0000","last_clean_scrub_stamp":"2023-10-25T23:45:31.220095+0000","objects_scrubbed":0,"log_size":1945,"log_dups_size":0,"ondisk_log_size":1945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:02:37.540377+0000","scrub_duration":0.0025931389999999999,"objects_trimmed":0,"snaptrim_duration":0.0441538,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":183,"num_read_kb":3053,"num_write":1182,"num_write_kb":17288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"40'1938","reported_seq":4584,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:16.456710+0000","last_change":"2023-10-25T23:45:16.456757+0000","last_active":"2023-10-25T23:45:16.456710+0000","last_peered":"2023-10-25T23:45:16.456710+0000","last_clean":"2023-10-25T23:45:16.456710+0000","last_became_active":"2023-10-25T23:36:09.281890+0000","last_became_peered":"2023-10-25T23:36:09.281890+0000","last_unstale":"2023-10-25T23:45:16.456710+0000","last_undegraded":"2023-10-25T23:45:16.456710+0000","last_fullsized":"2023-10-25T23:45:16.456710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1938","last_scrub_stamp":"2023-10-25T23:45:16.456585+0000","last_deep_scrub":"40'1938","last_deep_scrub_stamp":"2023-10-25T23:45:16.456585+0000","last_clean_scrub_stamp":"2023-10-25T23:45:16.456585+0000","objects_scrubbed":0,"log_size":1938,"log_dups_size":0,"ondisk_log_size":1938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:24:11.638742+0000","scrub_duration":0.0045226349999999997,"objects_trimmed":0,"snaptrim_duration":0.049488604999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":200,"num_read_kb":12821,"num_write":1152,"num_write_kb":16010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"40'2038","reported_seq":4647,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:29.034646+0000","last_change":"2023-10-25T23:45:29.034684+0000","last_active":"2023-10-25T23:45:29.034646+0000","last_peered":"2023-10-25T23:45:29.034646+0000","last_clean":"2023-10-25T23:45:29.034646+0000","last_became_active":"2023-10-25T23:36:09.284066+0000","last_became_peered":"2023-10-25T23:36:09.284066+0000","last_unstale":"2023-10-25T23:45:29.034646+0000","last_undegraded":"2023-10-25T23:45:29.034646+0000","last_fullsized":"2023-10-25T23:45:29.034646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2038","last_scrub_stamp":"2023-10-25T23:45:29.034551+0000","last_deep_scrub":"40'2038","last_deep_scrub_stamp":"2023-10-25T23:45:29.034551+0000","last_clean_scrub_stamp":"2023-10-25T23:45:29.034551+0000","objects_scrubbed":0,"log_size":2038,"log_dups_size":0,"ondisk_log_size":2038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:21:04.210361+0000","scrub_duration":0.003589058,"objects_trimmed":0,"snaptrim_duration":0.17887767900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":12209,"num_write":1200,"num_write_kb":24347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"40'2086","reported_seq":4795,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:07.490132+0000","last_change":"2023-10-25T23:45:07.490180+0000","last_active":"2023-10-25T23:45:07.490132+0000","last_peered":"2023-10-25T23:45:07.490132+0000","last_clean":"2023-10-25T23:45:07.490132+0000","last_became_active":"2023-10-25T23:36:09.299585+0000","last_became_peered":"2023-10-25T23:36:09.299585+0000","last_unstale":"2023-10-25T23:45:07.490132+0000","last_undegraded":"2023-10-25T23:45:07.490132+0000","last_fullsized":"2023-10-25T23:45:07.490132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2086","last_scrub_stamp":"2023-10-25T23:45:07.490007+0000","last_deep_scrub":"40'2086","last_deep_scrub_stamp":"2023-10-25T23:45:07.490007+0000","last_clean_scrub_stamp":"2023-10-25T23:45:07.490007+0000","objects_scrubbed":0,"log_size":2086,"log_dups_size":0,"ondisk_log_size":2086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:50:14.619692+0000","scrub_duration":0.0054681310000000002,"objects_trimmed":0,"snaptrim_duration":0.16786652399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":4442,"num_write":1222,"num_write_kb":17071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"40'2222","reported_seq":4829,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:08.948289+0000","last_change":"2023-10-25T23:45:08.948387+0000","last_active":"2023-10-25T23:45:08.948289+0000","last_peered":"2023-10-25T23:45:08.948289+0000","last_clean":"2023-10-25T23:45:08.948289+0000","last_became_active":"2023-10-25T23:36:09.287403+0000","last_became_peered":"2023-10-25T23:36:09.287403+0000","last_unstale":"2023-10-25T23:45:08.948289+0000","last_undegraded":"2023-10-25T23:45:08.948289+0000","last_fullsized":"2023-10-25T23:45:08.948289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2222","last_scrub_stamp":"2023-10-25T23:45:08.948168+0000","last_deep_scrub":"40'2222","last_deep_scrub_stamp":"2023-10-25T23:45:08.948168+0000","last_clean_scrub_stamp":"2023-10-25T23:45:08.948168+0000","objects_scrubbed":0,"log_size":2222,"log_dups_size":0,"ondisk_log_size":2222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:08:52.565380+0000","scrub_duration":0.004897607,"objects_trimmed":0,"snaptrim_duration":0.047660552000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":4323,"num_write":1325,"num_write_kb":21852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"40'1930","reported_seq":4571,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:18.504421+0000","last_change":"2023-10-25T23:45:18.504476+0000","last_active":"2023-10-25T23:45:18.504421+0000","last_peered":"2023-10-25T23:45:18.504421+0000","last_clean":"2023-10-25T23:45:18.504421+0000","last_became_active":"2023-10-25T23:36:09.301305+0000","last_became_peered":"2023-10-25T23:36:09.301305+0000","last_unstale":"2023-10-25T23:45:18.504421+0000","last_undegraded":"2023-10-25T23:45:18.504421+0000","last_fullsized":"2023-10-25T23:45:18.504421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1930","last_scrub_stamp":"2023-10-25T23:45:18.504298+0000","last_deep_scrub":"40'1930","last_deep_scrub_stamp":"2023-10-25T23:45:18.504298+0000","last_clean_scrub_stamp":"2023-10-25T23:45:18.504298+0000","objects_scrubbed":0,"log_size":1930,"log_dups_size":0,"ondisk_log_size":1930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:44:30.150735+0000","scrub_duration":0.0055159830000000003,"objects_trimmed":0,"snaptrim_duration":0.139844156,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":4600,"num_write":1162,"num_write_kb":16604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"40'2105","reported_seq":4717,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:19.102288+0000","last_change":"2023-10-25T23:45:19.102335+0000","last_active":"2023-10-25T23:45:19.102288+0000","last_peered":"2023-10-25T23:45:19.102288+0000","last_clean":"2023-10-25T23:45:19.102288+0000","last_became_active":"2023-10-25T23:36:09.293173+0000","last_became_peered":"2023-10-25T23:36:09.293173+0000","last_unstale":"2023-10-25T23:45:19.102288+0000","last_undegraded":"2023-10-25T23:45:19.102288+0000","last_fullsized":"2023-10-25T23:45:19.102288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2105","last_scrub_stamp":"2023-10-25T23:45:19.102174+0000","last_deep_scrub":"40'2105","last_deep_scrub_stamp":"2023-10-25T23:45:19.102174+0000","last_clean_scrub_stamp":"2023-10-25T23:45:19.102174+0000","objects_scrubbed":0,"log_size":2105,"log_dups_size":0,"ondisk_log_size":2105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:49:01.409962+0000","scrub_duration":0.0050245740000000004,"objects_trimmed":0,"snaptrim_duration":0.040145588000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":4028,"num_write":1252,"num_write_kb":24067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"40'1952","reported_seq":4597,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:29.977353+0000","last_change":"2023-10-25T23:45:29.977394+0000","last_active":"2023-10-25T23:45:29.977353+0000","last_peered":"2023-10-25T23:45:29.977353+0000","last_clean":"2023-10-25T23:45:29.977353+0000","last_became_active":"2023-10-25T23:36:09.295518+0000","last_became_peered":"2023-10-25T23:36:09.295518+0000","last_unstale":"2023-10-25T23:45:29.977353+0000","last_undegraded":"2023-10-25T23:45:29.977353+0000","last_fullsized":"2023-10-25T23:45:29.977353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1952","last_scrub_stamp":"2023-10-25T23:45:29.977263+0000","last_deep_scrub":"40'1952","last_deep_scrub_stamp":"2023-10-25T23:45:29.977263+0000","last_clean_scrub_stamp":"2023-10-25T23:45:29.977263+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:20:08.577261+0000","scrub_duration":0.0052096529999999999,"objects_trimmed":0,"snaptrim_duration":0.035739239999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":4005,"num_write":1156,"num_write_kb":40374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"40'2141","reported_seq":4773,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:24.202762+0000","last_change":"2023-10-25T23:45:24.202808+0000","last_active":"2023-10-25T23:45:24.202762+0000","last_peered":"2023-10-25T23:45:24.202762+0000","last_clean":"2023-10-25T23:45:24.202762+0000","last_became_active":"2023-10-25T23:36:09.297036+0000","last_became_peered":"2023-10-25T23:36:09.297036+0000","last_unstale":"2023-10-25T23:45:24.202762+0000","last_undegraded":"2023-10-25T23:45:24.202762+0000","last_fullsized":"2023-10-25T23:45:24.202762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2141","last_scrub_stamp":"2023-10-25T23:45:24.202641+0000","last_deep_scrub":"40'2141","last_deep_scrub_stamp":"2023-10-25T23:45:24.202641+0000","last_clean_scrub_stamp":"2023-10-25T23:45:24.202641+0000","objects_scrubbed":0,"log_size":2141,"log_dups_size":0,"ondisk_log_size":2141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:27:30.162972+0000","scrub_duration":0.004001274,"objects_trimmed":0,"snaptrim_duration":0.046296174000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":233,"num_read_kb":8236,"num_write":1280,"num_write_kb":21230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"40'1990","reported_seq":4615,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:26.197565+0000","last_change":"2023-10-25T23:45:26.197625+0000","last_active":"2023-10-25T23:45:26.197565+0000","last_peered":"2023-10-25T23:45:26.197565+0000","last_clean":"2023-10-25T23:45:26.197565+0000","last_became_active":"2023-10-25T23:36:09.297713+0000","last_became_peered":"2023-10-25T23:36:09.297713+0000","last_unstale":"2023-10-25T23:45:26.197565+0000","last_undegraded":"2023-10-25T23:45:26.197565+0000","last_fullsized":"2023-10-25T23:45:26.197565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1990","last_scrub_stamp":"2023-10-25T23:45:26.197423+0000","last_deep_scrub":"40'1990","last_deep_scrub_stamp":"2023-10-25T23:45:26.197423+0000","last_clean_scrub_stamp":"2023-10-25T23:45:26.197423+0000","objects_scrubbed":0,"log_size":1990,"log_dups_size":0,"ondisk_log_size":1990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:24:21.379579+0000","scrub_duration":0.0050436389999999999,"objects_trimmed":0,"snaptrim_duration":0.052261503000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":204,"num_read_kb":4128,"num_write":1151,"num_write_kb":8179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"40'2162","reported_seq":4768,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:27.245105+0000","last_change":"2023-10-25T23:45:27.245194+0000","last_active":"2023-10-25T23:45:27.245105+0000","last_peered":"2023-10-25T23:45:27.245105+0000","last_clean":"2023-10-25T23:45:27.245105+0000","last_became_active":"2023-10-25T23:36:50.071605+0000","last_became_peered":"2023-10-25T23:36:50.071605+0000","last_unstale":"2023-10-25T23:45:27.245105+0000","last_undegraded":"2023-10-25T23:45:27.245105+0000","last_fullsized":"2023-10-25T23:45:27.245105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2162","last_scrub_stamp":"2023-10-25T23:45:27.244959+0000","last_deep_scrub":"40'2162","last_deep_scrub_stamp":"2023-10-25T23:45:27.244959+0000","last_clean_scrub_stamp":"2023-10-25T23:45:27.244959+0000","objects_scrubbed":0,"log_size":2162,"log_dups_size":0,"ondisk_log_size":2162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:08:13.332264+0000","scrub_duration":0.0050532149999999998,"objects_trimmed":0,"snaptrim_duration":0.056199102000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":4889,"num_write":1231,"num_write_kb":19417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"40'2105","reported_seq":4720,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:01.541640+0000","last_change":"2023-10-25T23:45:01.541723+0000","last_active":"2023-10-25T23:45:01.541640+0000","last_peered":"2023-10-25T23:45:01.541640+0000","last_clean":"2023-10-25T23:45:01.541640+0000","last_became_active":"2023-10-25T23:36:09.291351+0000","last_became_peered":"2023-10-25T23:36:09.291351+0000","last_unstale":"2023-10-25T23:45:01.541640+0000","last_undegraded":"2023-10-25T23:45:01.541640+0000","last_fullsized":"2023-10-25T23:45:01.541640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2105","last_scrub_stamp":"2023-10-25T23:45:01.541514+0000","last_deep_scrub":"40'2105","last_deep_scrub_stamp":"2023-10-25T23:45:01.541514+0000","last_clean_scrub_stamp":"2023-10-25T23:45:01.541514+0000","objects_scrubbed":0,"log_size":2105,"log_dups_size":0,"ondisk_log_size":2105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:23:34.365717+0000","scrub_duration":0.0060231190000000004,"objects_trimmed":0,"snaptrim_duration":0.104157445,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":4997,"num_write":1220,"num_write_kb":33278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"40'2041","reported_seq":4665,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:05.023879+0000","last_change":"2023-10-25T23:45:05.023966+0000","last_active":"2023-10-25T23:45:05.023879+0000","last_peered":"2023-10-25T23:45:05.023879+0000","last_clean":"2023-10-25T23:45:05.023879+0000","last_became_active":"2023-10-25T23:36:09.289895+0000","last_became_peered":"2023-10-25T23:36:09.289895+0000","last_unstale":"2023-10-25T23:45:05.023879+0000","last_undegraded":"2023-10-25T23:45:05.023879+0000","last_fullsized":"2023-10-25T23:45:05.023879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2041","last_scrub_stamp":"2023-10-25T23:45:05.023771+0000","last_deep_scrub":"40'2041","last_deep_scrub_stamp":"2023-10-25T23:45:05.023771+0000","last_clean_scrub_stamp":"2023-10-25T23:45:05.023771+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:12:05.963637+0000","scrub_duration":0.0041081449999999997,"objects_trimmed":0,"snaptrim_duration":0.041092534,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":8364,"num_write":1160,"num_write_kb":24700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"40'2063","reported_seq":4704,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:54.786036+0000","last_change":"2023-10-25T23:44:54.786036+0000","last_active":"2023-10-25T23:44:54.786036+0000","last_peered":"2023-10-25T23:44:54.786036+0000","last_clean":"2023-10-25T23:44:54.786036+0000","last_became_active":"2023-10-25T23:36:09.283250+0000","last_became_peered":"2023-10-25T23:36:09.283250+0000","last_unstale":"2023-10-25T23:44:54.786036+0000","last_undegraded":"2023-10-25T23:44:54.786036+0000","last_fullsized":"2023-10-25T23:44:54.786036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2063","last_scrub_stamp":"2023-10-25T23:44:54.785822+0000","last_deep_scrub":"40'2063","last_deep_scrub_stamp":"2023-10-25T23:44:54.785822+0000","last_clean_scrub_stamp":"2023-10-25T23:44:54.785822+0000","objects_scrubbed":0,"log_size":2063,"log_dups_size":0,"ondisk_log_size":2063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:33:50.507803+0000","scrub_duration":0.0058257480000000004,"objects_trimmed":0,"snaptrim_duration":0.18494869999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":4523,"num_write":1222,"num_write_kb":24181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"40'2103","reported_seq":4730,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:09.383002+0000","last_change":"2023-10-25T23:45:09.383002+0000","last_active":"2023-10-25T23:45:09.383002+0000","last_peered":"2023-10-25T23:45:09.383002+0000","last_clean":"2023-10-25T23:45:09.383002+0000","last_became_active":"2023-10-25T23:36:09.286191+0000","last_became_peered":"2023-10-25T23:36:09.286191+0000","last_unstale":"2023-10-25T23:45:09.383002+0000","last_undegraded":"2023-10-25T23:45:09.383002+0000","last_fullsized":"2023-10-25T23:45:09.383002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2103","last_scrub_stamp":"2023-10-25T23:45:09.382855+0000","last_deep_scrub":"40'2103","last_deep_scrub_stamp":"2023-10-25T23:45:09.382855+0000","last_clean_scrub_stamp":"2023-10-25T23:45:09.382855+0000","objects_scrubbed":0,"log_size":2103,"log_dups_size":0,"ondisk_log_size":2103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:34.076421+0000","scrub_duration":0.0050155069999999998,"objects_trimmed":0,"snaptrim_duration":0.049576174000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":4088,"num_write":1280,"num_write_kb":29409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"40'2074","reported_seq":4712,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:09.471035+0000","last_change":"2023-10-25T23:45:09.471035+0000","last_active":"2023-10-25T23:45:09.471035+0000","last_peered":"2023-10-25T23:45:09.471035+0000","last_clean":"2023-10-25T23:45:09.471035+0000","last_became_active":"2023-10-25T23:36:09.301040+0000","last_became_peered":"2023-10-25T23:36:09.301040+0000","last_unstale":"2023-10-25T23:45:09.471035+0000","last_undegraded":"2023-10-25T23:45:09.471035+0000","last_fullsized":"2023-10-25T23:45:09.471035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2074","last_scrub_stamp":"2023-10-25T23:45:09.470837+0000","last_deep_scrub":"40'2074","last_deep_scrub_stamp":"2023-10-25T23:45:09.470837+0000","last_clean_scrub_stamp":"2023-10-25T23:45:09.470837+0000","objects_scrubbed":0,"log_size":2074,"log_dups_size":0,"ondisk_log_size":2074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:39:02.546704+0000","scrub_duration":0.0058892409999999999,"objects_trimmed":0,"snaptrim_duration":0.15382465100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":14548,"num_write":1224,"num_write_kb":47800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"40'2118","reported_seq":4769,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:54.066379+0000","last_change":"2023-10-25T23:44:54.066449+0000","last_active":"2023-10-25T23:44:54.066379+0000","last_peered":"2023-10-25T23:44:54.066379+0000","last_clean":"2023-10-25T23:44:54.066379+0000","last_became_active":"2023-10-25T23:36:50.103220+0000","last_became_peered":"2023-10-25T23:36:50.103220+0000","last_unstale":"2023-10-25T23:44:54.066379+0000","last_undegraded":"2023-10-25T23:44:54.066379+0000","last_fullsized":"2023-10-25T23:44:54.066379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2118","last_scrub_stamp":"2023-10-25T23:44:54.066263+0000","last_deep_scrub":"40'2118","last_deep_scrub_stamp":"2023-10-25T23:44:54.066263+0000","last_clean_scrub_stamp":"2023-10-25T23:44:54.066263+0000","objects_scrubbed":0,"log_size":2118,"log_dups_size":0,"ondisk_log_size":2118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:10:22.153336+0000","scrub_duration":0.0035887580000000001,"objects_trimmed":0,"snaptrim_duration":0.033066291999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":8493,"num_write":1280,"num_write_kb":14868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"40'2009","reported_seq":4632,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:51.045966+0000","last_change":"2023-10-25T23:44:51.045966+0000","last_active":"2023-10-25T23:44:51.045966+0000","last_peered":"2023-10-25T23:44:51.045966+0000","last_clean":"2023-10-25T23:44:51.045966+0000","last_became_active":"2023-10-25T23:36:09.282282+0000","last_became_peered":"2023-10-25T23:36:09.282282+0000","last_unstale":"2023-10-25T23:44:51.045966+0000","last_undegraded":"2023-10-25T23:44:51.045966+0000","last_fullsized":"2023-10-25T23:44:51.045966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2009","last_scrub_stamp":"2023-10-25T23:44:51.045757+0000","last_deep_scrub":"40'2009","last_deep_scrub_stamp":"2023-10-25T23:44:51.045757+0000","last_clean_scrub_stamp":"2023-10-25T23:44:51.045757+0000","objects_scrubbed":0,"log_size":2009,"log_dups_size":0,"ondisk_log_size":2009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:26:50.500449+0000","scrub_duration":0.0054215599999999997,"objects_trimmed":0,"snaptrim_duration":0.033856860000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":3064,"num_write":1152,"num_write_kb":24838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"40'2193","reported_seq":4813,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:56.023652+0000","last_change":"2023-10-25T23:44:56.023652+0000","last_active":"2023-10-25T23:44:56.023652+0000","last_peered":"2023-10-25T23:44:56.023652+0000","last_clean":"2023-10-25T23:44:56.023652+0000","last_became_active":"2023-10-25T23:36:09.289457+0000","last_became_peered":"2023-10-25T23:36:09.289457+0000","last_unstale":"2023-10-25T23:44:56.023652+0000","last_undegraded":"2023-10-25T23:44:56.023652+0000","last_fullsized":"2023-10-25T23:44:56.023652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2193","last_scrub_stamp":"2023-10-25T23:44:56.023426+0000","last_deep_scrub":"40'2193","last_deep_scrub_stamp":"2023-10-25T23:44:56.023426+0000","last_clean_scrub_stamp":"2023-10-25T23:44:56.023426+0000","objects_scrubbed":0,"log_size":2193,"log_dups_size":0,"ondisk_log_size":2193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:50:13.161520+0000","scrub_duration":0.0054959659999999997,"objects_trimmed":0,"snaptrim_duration":0.041861184000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":8808,"num_write":1334,"num_write_kb":38138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"41'383","reported_seq":428,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:51.809605+0000","last_change":"2023-10-25T23:44:51.809669+0000","last_active":"2023-10-25T23:44:51.809605+0000","last_peered":"2023-10-25T23:44:51.809605+0000","last_clean":"2023-10-25T23:44:51.809605+0000","last_became_active":"2023-10-25T23:36:08.270911+0000","last_became_peered":"2023-10-25T23:36:08.270911+0000","last_unstale":"2023-10-25T23:44:51.809605+0000","last_undegraded":"2023-10-25T23:44:51.809605+0000","last_fullsized":"2023-10-25T23:44:51.809605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'383","last_scrub_stamp":"2023-10-25T23:44:51.809528+0000","last_deep_scrub":"41'383","last_deep_scrub_stamp":"2023-10-25T23:44:51.809528+0000","last_clean_scrub_stamp":"2023-10-25T23:44:51.809528+0000","objects_scrubbed":20,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:01:37.777592+0000","scrub_duration":0.059215088999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33555014,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":323,"num_write_kb":78531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":351082,"num_omap_keys":627,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"40'1985","reported_seq":4589,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:19.944971+0000","last_change":"2023-10-25T23:45:19.945022+0000","last_active":"2023-10-25T23:45:19.944971+0000","last_peered":"2023-10-25T23:45:19.944971+0000","last_clean":"2023-10-25T23:45:19.944971+0000","last_became_active":"2023-10-25T23:36:09.290260+0000","last_became_peered":"2023-10-25T23:36:09.290260+0000","last_unstale":"2023-10-25T23:45:19.944971+0000","last_undegraded":"2023-10-25T23:45:19.944971+0000","last_fullsized":"2023-10-25T23:45:19.944971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1985","last_scrub_stamp":"2023-10-25T23:45:19.944875+0000","last_deep_scrub":"40'1985","last_deep_scrub_stamp":"2023-10-25T23:45:19.944875+0000","last_clean_scrub_stamp":"2023-10-25T23:45:19.944875+0000","objects_scrubbed":0,"log_size":1985,"log_dups_size":0,"ondisk_log_size":1985,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:39:37.526984+0000","scrub_duration":0.0050587460000000002,"objects_trimmed":0,"snaptrim_duration":0.036898185999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":3083,"num_write":1169,"num_write_kb":11022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"41'649","reported_seq":694,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:56.146522+0000","last_change":"2023-10-25T23:44:56.146628+0000","last_active":"2023-10-25T23:44:56.146522+0000","last_peered":"2023-10-25T23:44:56.146522+0000","last_clean":"2023-10-25T23:44:56.146522+0000","last_became_active":"2023-10-25T23:36:08.269443+0000","last_became_peered":"2023-10-25T23:36:08.269443+0000","last_unstale":"2023-10-25T23:44:56.146522+0000","last_undegraded":"2023-10-25T23:44:56.146522+0000","last_fullsized":"2023-10-25T23:44:56.146522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'649","last_scrub_stamp":"2023-10-25T23:44:56.146419+0000","last_deep_scrub":"41'649","last_deep_scrub_stamp":"2023-10-25T23:44:56.146419+0000","last_clean_scrub_stamp":"2023-10-25T23:44:56.146419+0000","objects_scrubbed":13,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:50:13.284513+0000","scrub_duration":0.054388904000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":598,"num_write_kb":86544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":149116,"num_omap_keys":265,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"40'1964","reported_seq":4610,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:25.986836+0000","last_change":"2023-10-25T23:45:25.986920+0000","last_active":"2023-10-25T23:45:25.986836+0000","last_peered":"2023-10-25T23:45:25.986836+0000","last_clean":"2023-10-25T23:45:25.986836+0000","last_became_active":"2023-10-25T23:36:09.299738+0000","last_became_peered":"2023-10-25T23:36:09.299738+0000","last_unstale":"2023-10-25T23:45:25.986836+0000","last_undegraded":"2023-10-25T23:45:25.986836+0000","last_fullsized":"2023-10-25T23:45:25.986836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1964","last_scrub_stamp":"2023-10-25T23:45:25.986697+0000","last_deep_scrub":"40'1964","last_deep_scrub_stamp":"2023-10-25T23:45:25.986697+0000","last_clean_scrub_stamp":"2023-10-25T23:45:25.986697+0000","objects_scrubbed":0,"log_size":1964,"log_dups_size":0,"ondisk_log_size":1964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:14:52.812902+0000","scrub_duration":0.0033618939999999998,"objects_trimmed":0,"snaptrim_duration":0.16688098700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":3695,"num_write":1175,"num_write_kb":20733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"41'628","reported_seq":672,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:07.043434+0000","last_change":"2023-10-25T23:45:07.043509+0000","last_active":"2023-10-25T23:45:07.043434+0000","last_peered":"2023-10-25T23:45:07.043434+0000","last_clean":"2023-10-25T23:45:07.043434+0000","last_became_active":"2023-10-25T23:36:08.273574+0000","last_became_peered":"2023-10-25T23:36:08.273574+0000","last_unstale":"2023-10-25T23:45:07.043434+0000","last_undegraded":"2023-10-25T23:45:07.043434+0000","last_fullsized":"2023-10-25T23:45:07.043434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'628","last_scrub_stamp":"2023-10-25T23:45:07.043349+0000","last_deep_scrub":"41'628","last_deep_scrub_stamp":"2023-10-25T23:45:07.043349+0000","last_clean_scrub_stamp":"2023-10-25T23:45:07.043349+0000","objects_scrubbed":21,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:10:01.813301+0000","scrub_duration":0.077303144000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":582,"num_write_kb":140942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1011184,"num_omap_keys":1546,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"40'2159","reported_seq":4771,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:27.385489+0000","last_change":"2023-10-25T23:45:27.385592+0000","last_active":"2023-10-25T23:45:27.385489+0000","last_peered":"2023-10-25T23:45:27.385489+0000","last_clean":"2023-10-25T23:45:27.385489+0000","last_became_active":"2023-10-25T23:36:09.299916+0000","last_became_peered":"2023-10-25T23:36:09.299916+0000","last_unstale":"2023-10-25T23:45:27.385489+0000","last_undegraded":"2023-10-25T23:45:27.385489+0000","last_fullsized":"2023-10-25T23:45:27.385489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2159","last_scrub_stamp":"2023-10-25T23:45:27.385371+0000","last_deep_scrub":"40'2159","last_deep_scrub_stamp":"2023-10-25T23:45:27.385371+0000","last_clean_scrub_stamp":"2023-10-25T23:45:27.385371+0000","objects_scrubbed":0,"log_size":2159,"log_dups_size":0,"ondisk_log_size":2159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:01:37.606807+0000","scrub_duration":0.0056802179999999999,"objects_trimmed":0,"snaptrim_duration":0.14014327800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":4255,"num_write":1272,"num_write_kb":13349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"41'414","reported_seq":458,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:06.063739+0000","last_change":"2023-10-25T23:45:06.063862+0000","last_active":"2023-10-25T23:45:06.063739+0000","last_peered":"2023-10-25T23:45:06.063739+0000","last_clean":"2023-10-25T23:45:06.063739+0000","last_became_active":"2023-10-25T23:36:08.271442+0000","last_became_peered":"2023-10-25T23:36:08.271442+0000","last_unstale":"2023-10-25T23:45:06.063739+0000","last_undegraded":"2023-10-25T23:45:06.063739+0000","last_fullsized":"2023-10-25T23:45:06.063739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'414","last_scrub_stamp":"2023-10-25T23:45:06.063634+0000","last_deep_scrub":"41'414","last_deep_scrub_stamp":"2023-10-25T23:45:06.063634+0000","last_clean_scrub_stamp":"2023-10-25T23:45:06.063634+0000","objects_scrubbed":21,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:14:32.889839+0000","scrub_duration":0.052590801,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":379,"num_write_kb":83039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":393616,"num_omap_keys":682,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"40'2019","reported_seq":4660,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:12.531974+0000","last_change":"2023-10-25T23:45:12.532035+0000","last_active":"2023-10-25T23:45:12.531974+0000","last_peered":"2023-10-25T23:45:12.531974+0000","last_clean":"2023-10-25T23:45:12.531974+0000","last_became_active":"2023-10-25T23:36:09.299130+0000","last_became_peered":"2023-10-25T23:36:09.299130+0000","last_unstale":"2023-10-25T23:45:12.531974+0000","last_undegraded":"2023-10-25T23:45:12.531974+0000","last_fullsized":"2023-10-25T23:45:12.531974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2019","last_scrub_stamp":"2023-10-25T23:45:12.531861+0000","last_deep_scrub":"40'2019","last_deep_scrub_stamp":"2023-10-25T23:45:12.531861+0000","last_clean_scrub_stamp":"2023-10-25T23:45:12.531861+0000","objects_scrubbed":0,"log_size":2019,"log_dups_size":0,"ondisk_log_size":2019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:22:05.277506+0000","scrub_duration":0.0053950580000000003,"objects_trimmed":0,"snaptrim_duration":0.14672489499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":3649,"num_write":1196,"num_write_kb":32686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"41'472","reported_seq":516,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:54.120320+0000","last_change":"2023-10-25T23:44:54.120431+0000","last_active":"2023-10-25T23:44:54.120320+0000","last_peered":"2023-10-25T23:44:54.120320+0000","last_clean":"2023-10-25T23:44:54.120320+0000","last_became_active":"2023-10-25T23:36:08.270138+0000","last_became_peered":"2023-10-25T23:36:08.270138+0000","last_unstale":"2023-10-25T23:44:54.120320+0000","last_undegraded":"2023-10-25T23:44:54.120320+0000","last_fullsized":"2023-10-25T23:44:54.120320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'472","last_scrub_stamp":"2023-10-25T23:44:54.120211+0000","last_deep_scrub":"41'472","last_deep_scrub_stamp":"2023-10-25T23:44:54.120211+0000","last_clean_scrub_stamp":"2023-10-25T23:44:54.120211+0000","objects_scrubbed":20,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:27:28.414292+0000","scrub_duration":0.071562769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":475,"num_write_kb":111638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4150944,"num_omap_keys":7343,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"40'2154","reported_seq":4775,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:58.501870+0000","last_change":"2023-10-25T23:44:58.501940+0000","last_active":"2023-10-25T23:44:58.501870+0000","last_peered":"2023-10-25T23:44:58.501870+0000","last_clean":"2023-10-25T23:44:58.501870+0000","last_became_active":"2023-10-25T23:36:09.287455+0000","last_became_peered":"2023-10-25T23:36:09.287455+0000","last_unstale":"2023-10-25T23:44:58.501870+0000","last_undegraded":"2023-10-25T23:44:58.501870+0000","last_fullsized":"2023-10-25T23:44:58.501870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2154","last_scrub_stamp":"2023-10-25T23:44:58.501771+0000","last_deep_scrub":"40'2154","last_deep_scrub_stamp":"2023-10-25T23:44:58.501771+0000","last_clean_scrub_stamp":"2023-10-25T23:44:58.501771+0000","objects_scrubbed":0,"log_size":2154,"log_dups_size":0,"ondisk_log_size":2154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:20:18.363567+0000","scrub_duration":0.0049148270000000001,"objects_trimmed":0,"snaptrim_duration":0.093404585999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":5171,"num_write":1282,"num_write_kb":34019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"41'545","reported_seq":589,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:50.958967+0000","last_change":"2023-10-25T23:44:50.959038+0000","last_active":"2023-10-25T23:44:50.958967+0000","last_peered":"2023-10-25T23:44:50.958967+0000","last_clean":"2023-10-25T23:44:50.958967+0000","last_became_active":"2023-10-25T23:36:08.271974+0000","last_became_peered":"2023-10-25T23:36:08.271974+0000","last_unstale":"2023-10-25T23:44:50.958967+0000","last_undegraded":"2023-10-25T23:44:50.958967+0000","last_fullsized":"2023-10-25T23:44:50.958967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'545","last_scrub_stamp":"2023-10-25T23:44:50.958861+0000","last_deep_scrub":"41'545","last_deep_scrub_stamp":"2023-10-25T23:44:50.958861+0000","last_clean_scrub_stamp":"2023-10-25T23:44:50.958861+0000","objects_scrubbed":8,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:21:29.815599+0000","scrub_duration":0.037452547000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":503,"num_write_kb":90640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":126186,"num_omap_keys":226,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"40'2101","reported_seq":4701,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:16.851062+0000","last_change":"2023-10-25T23:45:16.851115+0000","last_active":"2023-10-25T23:45:16.851062+0000","last_peered":"2023-10-25T23:45:16.851062+0000","last_clean":"2023-10-25T23:45:16.851062+0000","last_became_active":"2023-10-25T23:36:09.294176+0000","last_became_peered":"2023-10-25T23:36:09.294176+0000","last_unstale":"2023-10-25T23:45:16.851062+0000","last_undegraded":"2023-10-25T23:45:16.851062+0000","last_fullsized":"2023-10-25T23:45:16.851062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2101","last_scrub_stamp":"2023-10-25T23:45:16.850965+0000","last_deep_scrub":"40'2101","last_deep_scrub_stamp":"2023-10-25T23:45:16.850965+0000","last_clean_scrub_stamp":"2023-10-25T23:45:16.850965+0000","objects_scrubbed":0,"log_size":2101,"log_dups_size":0,"ondisk_log_size":2101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:35:54.742884+0000","scrub_duration":0.0048591720000000001,"objects_trimmed":0,"snaptrim_duration":0.20272068300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":27232,"num_write":1210,"num_write_kb":20727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"41'313","reported_seq":357,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:51.150889+0000","last_change":"2023-10-25T23:44:51.150961+0000","last_active":"2023-10-25T23:44:51.150889+0000","last_peered":"2023-10-25T23:44:51.150889+0000","last_clean":"2023-10-25T23:44:51.150889+0000","last_became_active":"2023-10-25T23:36:08.273035+0000","last_became_peered":"2023-10-25T23:36:08.273035+0000","last_unstale":"2023-10-25T23:44:51.150889+0000","last_undegraded":"2023-10-25T23:44:51.150889+0000","last_fullsized":"2023-10-25T23:44:51.150889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'313","last_scrub_stamp":"2023-10-25T23:44:51.150805+0000","last_deep_scrub":"41'313","last_deep_scrub_stamp":"2023-10-25T23:44:51.150805+0000","last_clean_scrub_stamp":"2023-10-25T23:44:51.150805+0000","objects_scrubbed":13,"log_size":313,"log_dups_size":0,"ondisk_log_size":313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:58:17.029784+0000","scrub_duration":0.051535087,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20925654,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":275,"num_write_kb":80040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1602763,"num_omap_keys":2447,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"40'2324","reported_seq":4927,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:26.990463+0000","last_change":"2023-10-25T23:45:26.990508+0000","last_active":"2023-10-25T23:45:26.990463+0000","last_peered":"2023-10-25T23:45:26.990463+0000","last_clean":"2023-10-25T23:45:26.990463+0000","last_became_active":"2023-10-25T23:36:09.292546+0000","last_became_peered":"2023-10-25T23:36:09.292546+0000","last_unstale":"2023-10-25T23:45:26.990463+0000","last_undegraded":"2023-10-25T23:45:26.990463+0000","last_fullsized":"2023-10-25T23:45:26.990463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2324","last_scrub_stamp":"2023-10-25T23:45:26.990352+0000","last_deep_scrub":"40'2324","last_deep_scrub_stamp":"2023-10-25T23:45:26.990352+0000","last_clean_scrub_stamp":"2023-10-25T23:45:26.990352+0000","objects_scrubbed":0,"log_size":2324,"log_dups_size":0,"ondisk_log_size":2324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:44:38.636788+0000","scrub_duration":0.005751557,"objects_trimmed":0,"snaptrim_duration":0.035319162000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":250,"num_read_kb":23958,"num_write":1360,"num_write_kb":38473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"41'1039","reported_seq":1083,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:58.509448+0000","last_change":"2023-10-25T23:44:58.509524+0000","last_active":"2023-10-25T23:44:58.509448+0000","last_peered":"2023-10-25T23:44:58.509448+0000","last_clean":"2023-10-25T23:44:58.509448+0000","last_became_active":"2023-10-25T23:36:08.277138+0000","last_became_peered":"2023-10-25T23:36:08.277138+0000","last_unstale":"2023-10-25T23:44:58.509448+0000","last_undegraded":"2023-10-25T23:44:58.509448+0000","last_fullsized":"2023-10-25T23:44:58.509448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'1039","last_scrub_stamp":"2023-10-25T23:44:58.509365+0000","last_deep_scrub":"41'1039","last_deep_scrub_stamp":"2023-10-25T23:44:58.509365+0000","last_clean_scrub_stamp":"2023-10-25T23:44:58.509365+0000","objects_scrubbed":22,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:29:10.829596+0000","scrub_duration":0.093800564000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":989,"num_write_kb":120913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1331763,"num_omap_keys":2391,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"40'2067","reported_seq":4685,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:14.421388+0000","last_change":"2023-10-25T23:45:14.421436+0000","last_active":"2023-10-25T23:45:14.421388+0000","last_peered":"2023-10-25T23:45:14.421388+0000","last_clean":"2023-10-25T23:45:14.421388+0000","last_became_active":"2023-10-25T23:36:09.290456+0000","last_became_peered":"2023-10-25T23:36:09.290456+0000","last_unstale":"2023-10-25T23:45:14.421388+0000","last_undegraded":"2023-10-25T23:45:14.421388+0000","last_fullsized":"2023-10-25T23:45:14.421388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2067","last_scrub_stamp":"2023-10-25T23:45:14.421273+0000","last_deep_scrub":"40'2067","last_deep_scrub_stamp":"2023-10-25T23:45:14.421273+0000","last_clean_scrub_stamp":"2023-10-25T23:45:14.421273+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:29:57.100609+0000","scrub_duration":0.0039362030000000001,"objects_trimmed":0,"snaptrim_duration":0.058251507000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":31667,"num_write":1204,"num_write_kb":33454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"41'372","reported_seq":493,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:58.089431+0000","last_change":"2023-10-25T23:44:58.089534+0000","last_active":"2023-10-25T23:44:58.089431+0000","last_peered":"2023-10-25T23:44:58.089431+0000","last_clean":"2023-10-25T23:44:58.089431+0000","last_became_active":"2023-10-25T23:36:08.272120+0000","last_became_peered":"2023-10-25T23:36:08.272120+0000","last_unstale":"2023-10-25T23:44:58.089431+0000","last_undegraded":"2023-10-25T23:44:58.089431+0000","last_fullsized":"2023-10-25T23:44:58.089431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'372","last_scrub_stamp":"2023-10-25T23:44:58.089308+0000","last_deep_scrub":"41'372","last_deep_scrub_stamp":"2023-10-25T23:44:58.089308+0000","last_clean_scrub_stamp":"2023-10-25T23:44:58.089308+0000","objects_scrubbed":17,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:17:25.802848+0000","scrub_duration":0.058194296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21516807,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":85,"num_read_kb":582,"num_write":349,"num_write_kb":84048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":536150,"num_omap_keys":952,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"40'2013","reported_seq":4635,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:05.451533+0000","last_change":"2023-10-25T23:45:05.451575+0000","last_active":"2023-10-25T23:45:05.451533+0000","last_peered":"2023-10-25T23:45:05.451533+0000","last_clean":"2023-10-25T23:45:05.451533+0000","last_became_active":"2023-10-25T23:36:09.293132+0000","last_became_peered":"2023-10-25T23:36:09.293132+0000","last_unstale":"2023-10-25T23:45:05.451533+0000","last_undegraded":"2023-10-25T23:45:05.451533+0000","last_fullsized":"2023-10-25T23:45:05.451533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2013","last_scrub_stamp":"2023-10-25T23:45:05.451437+0000","last_deep_scrub":"40'2013","last_deep_scrub_stamp":"2023-10-25T23:45:05.451437+0000","last_clean_scrub_stamp":"2023-10-25T23:45:05.451437+0000","objects_scrubbed":0,"log_size":2013,"log_dups_size":0,"ondisk_log_size":2013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:14:32.277642+0000","scrub_duration":0.0046978360000000004,"objects_trimmed":0,"snaptrim_duration":0.167893237,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":3351,"num_write":1194,"num_write_kb":12593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"41'695","reported_seq":739,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:50.371199+0000","last_change":"2023-10-25T23:44:50.371272+0000","last_active":"2023-10-25T23:44:50.371199+0000","last_peered":"2023-10-25T23:44:50.371199+0000","last_clean":"2023-10-25T23:44:50.371199+0000","last_became_active":"2023-10-25T23:36:08.272596+0000","last_became_peered":"2023-10-25T23:36:08.272596+0000","last_unstale":"2023-10-25T23:44:50.371199+0000","last_undegraded":"2023-10-25T23:44:50.371199+0000","last_fullsized":"2023-10-25T23:44:50.371199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'695","last_scrub_stamp":"2023-10-25T23:44:50.371115+0000","last_deep_scrub":"41'695","last_deep_scrub_stamp":"2023-10-25T23:44:50.371115+0000","last_clean_scrub_stamp":"2023-10-25T23:44:50.371115+0000","objects_scrubbed":19,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:58:16.250094+0000","scrub_duration":0.077208414000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":681,"num_write_kb":114510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3072130,"num_omap_keys":5404,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"40'2412","reported_seq":4894,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:07.658306+0000","last_change":"2023-10-25T23:45:07.658354+0000","last_active":"2023-10-25T23:45:07.658306+0000","last_peered":"2023-10-25T23:45:07.658306+0000","last_clean":"2023-10-25T23:45:07.658306+0000","last_became_active":"2023-10-25T23:36:09.299938+0000","last_became_peered":"2023-10-25T23:36:09.299938+0000","last_unstale":"2023-10-25T23:45:07.658306+0000","last_undegraded":"2023-10-25T23:45:07.658306+0000","last_fullsized":"2023-10-25T23:45:07.658306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2412","last_scrub_stamp":"2023-10-25T23:45:07.658192+0000","last_deep_scrub":"40'2412","last_deep_scrub_stamp":"2023-10-25T23:45:07.658192+0000","last_clean_scrub_stamp":"2023-10-25T23:45:07.658192+0000","objects_scrubbed":0,"log_size":2412,"log_dups_size":0,"ondisk_log_size":2412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:42.116930+0000","scrub_duration":0.0049575330000000001,"objects_trimmed":0,"snaptrim_duration":0.20328459099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":3949,"num_write":1292,"num_write_kb":20710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"41'684","reported_seq":728,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:54.301455+0000","last_change":"2023-10-25T23:44:54.301510+0000","last_active":"2023-10-25T23:44:54.301455+0000","last_peered":"2023-10-25T23:44:54.301455+0000","last_clean":"2023-10-25T23:44:54.301455+0000","last_became_active":"2023-10-25T23:36:08.279509+0000","last_became_peered":"2023-10-25T23:36:08.279509+0000","last_unstale":"2023-10-25T23:44:54.301455+0000","last_undegraded":"2023-10-25T23:44:54.301455+0000","last_fullsized":"2023-10-25T23:44:54.301455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'684","last_scrub_stamp":"2023-10-25T23:44:54.301377+0000","last_deep_scrub":"41'684","last_deep_scrub_stamp":"2023-10-25T23:44:54.301377+0000","last_clean_scrub_stamp":"2023-10-25T23:44:54.301377+0000","objects_scrubbed":14,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:24:35.077752+0000","scrub_duration":0.039027157,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777306,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":675,"num_write_kb":75678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":833477,"num_omap_keys":1408,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"40'2111","reported_seq":4736,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:03.536599+0000","last_change":"2023-10-25T23:45:03.536599+0000","last_active":"2023-10-25T23:45:03.536599+0000","last_peered":"2023-10-25T23:45:03.536599+0000","last_clean":"2023-10-25T23:45:03.536599+0000","last_became_active":"2023-10-25T23:36:09.285196+0000","last_became_peered":"2023-10-25T23:36:09.285196+0000","last_unstale":"2023-10-25T23:45:03.536599+0000","last_undegraded":"2023-10-25T23:45:03.536599+0000","last_fullsized":"2023-10-25T23:45:03.536599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2111","last_scrub_stamp":"2023-10-25T23:45:03.536397+0000","last_deep_scrub":"40'2111","last_deep_scrub_stamp":"2023-10-25T23:45:03.536397+0000","last_clean_scrub_stamp":"2023-10-25T23:45:03.536397+0000","objects_scrubbed":0,"log_size":2111,"log_dups_size":0,"ondisk_log_size":2111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:31:40.764015+0000","scrub_duration":0.0051017290000000002,"objects_trimmed":0,"snaptrim_duration":0.093006917999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":5156,"num_write":1232,"num_write_kb":26142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"41'539","reported_seq":584,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:57.033037+0000","last_change":"2023-10-25T23:44:57.033037+0000","last_active":"2023-10-25T23:44:57.033037+0000","last_peered":"2023-10-25T23:44:57.033037+0000","last_clean":"2023-10-25T23:44:57.033037+0000","last_became_active":"2023-10-25T23:36:08.272248+0000","last_became_peered":"2023-10-25T23:36:08.272248+0000","last_unstale":"2023-10-25T23:44:57.033037+0000","last_undegraded":"2023-10-25T23:44:57.033037+0000","last_fullsized":"2023-10-25T23:44:57.033037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'539","last_scrub_stamp":"2023-10-25T23:44:57.032834+0000","last_deep_scrub":"41'539","last_deep_scrub_stamp":"2023-10-25T23:44:57.032834+0000","last_clean_scrub_stamp":"2023-10-25T23:44:57.032834+0000","objects_scrubbed":14,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:24:37.809209+0000","scrub_duration":0.047065255,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25166496,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":487,"num_write_kb":123604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":275248,"num_omap_keys":407,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"40'2017","reported_seq":4653,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.113462+0000","last_change":"2023-10-25T23:44:48.113512+0000","last_active":"2023-10-25T23:44:48.113462+0000","last_peered":"2023-10-25T23:44:48.113462+0000","last_clean":"2023-10-25T23:44:48.113462+0000","last_became_active":"2023-10-25T23:36:09.292300+0000","last_became_peered":"2023-10-25T23:36:09.292300+0000","last_unstale":"2023-10-25T23:44:48.113462+0000","last_undegraded":"2023-10-25T23:44:48.113462+0000","last_fullsized":"2023-10-25T23:44:48.113462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2017","last_scrub_stamp":"2023-10-25T23:44:48.113376+0000","last_deep_scrub":"40'2017","last_deep_scrub_stamp":"2023-10-25T23:44:48.113376+0000","last_clean_scrub_stamp":"2023-10-25T23:44:48.113376+0000","objects_scrubbed":3,"log_size":2017,"log_dups_size":0,"ondisk_log_size":2017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:14:52.977935+0000","scrub_duration":0.0058894630000000002,"objects_trimmed":0,"snaptrim_duration":0.041370048,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":2,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":211,"num_read_kb":3693,"num_write":1198,"num_write_kb":20850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"40'229","reported_seq":274,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.664551+0000","last_change":"2023-10-25T23:44:44.810353+0000","last_active":"2023-10-25T23:44:48.664551+0000","last_peered":"2023-10-25T23:44:48.664551+0000","last_clean":"2023-10-25T23:44:48.664551+0000","last_became_active":"2023-10-25T23:36:08.274162+0000","last_became_peered":"2023-10-25T23:36:08.274162+0000","last_unstale":"2023-10-25T23:44:48.664551+0000","last_undegraded":"2023-10-25T23:44:48.664551+0000","last_fullsized":"2023-10-25T23:44:48.664551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'229","last_scrub_stamp":"2023-10-25T23:44:44.810222+0000","last_deep_scrub":"40'229","last_deep_scrub_stamp":"2023-10-25T23:44:44.810222+0000","last_clean_scrub_stamp":"2023-10-25T23:44:44.810222+0000","objects_scrubbed":19,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:05:42.612397+0000","scrub_duration":0.067816369000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360162,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":202,"num_write_kb":93162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2596919,"num_omap_keys":4542,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"40'2312","reported_seq":4821,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:01.645594+0000","last_change":"2023-10-25T23:45:01.645594+0000","last_active":"2023-10-25T23:45:01.645594+0000","last_peered":"2023-10-25T23:45:01.645594+0000","last_clean":"2023-10-25T23:45:01.645594+0000","last_became_active":"2023-10-25T23:36:09.284386+0000","last_became_peered":"2023-10-25T23:36:09.284386+0000","last_unstale":"2023-10-25T23:45:01.645594+0000","last_undegraded":"2023-10-25T23:45:01.645594+0000","last_fullsized":"2023-10-25T23:45:01.645594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2312","last_scrub_stamp":"2023-10-25T23:45:01.645430+0000","last_deep_scrub":"40'2312","last_deep_scrub_stamp":"2023-10-25T23:45:01.645430+0000","last_clean_scrub_stamp":"2023-10-25T23:45:01.645430+0000","objects_scrubbed":0,"log_size":2312,"log_dups_size":0,"ondisk_log_size":2312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:02:03.581760+0000","scrub_duration":0.0060352870000000003,"objects_trimmed":0,"snaptrim_duration":0.17573393000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":8533,"num_write":1240,"num_write_kb":24417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"41'191","reported_seq":236,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:49.302547+0000","last_change":"2023-10-25T23:44:49.302547+0000","last_active":"2023-10-25T23:44:49.302547+0000","last_peered":"2023-10-25T23:44:49.302547+0000","last_clean":"2023-10-25T23:44:49.302547+0000","last_became_active":"2023-10-25T23:36:08.271188+0000","last_became_peered":"2023-10-25T23:36:08.271188+0000","last_unstale":"2023-10-25T23:44:49.302547+0000","last_undegraded":"2023-10-25T23:44:49.302547+0000","last_fullsized":"2023-10-25T23:44:49.302547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'191","last_scrub_stamp":"2023-10-25T23:44:49.302368+0000","last_deep_scrub":"41'191","last_deep_scrub_stamp":"2023-10-25T23:44:49.302368+0000","last_clean_scrub_stamp":"2023-10-25T23:44:49.302368+0000","objects_scrubbed":11,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:20:08.912260+0000","scrub_duration":0.028664325000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":160,"num_write_kb":61795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":145850,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"40'2163","reported_seq":4774,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:11.008060+0000","last_change":"2023-10-25T23:45:11.008060+0000","last_active":"2023-10-25T23:45:11.008060+0000","last_peered":"2023-10-25T23:45:11.008060+0000","last_clean":"2023-10-25T23:45:11.008060+0000","last_became_active":"2023-10-25T23:36:09.294200+0000","last_became_peered":"2023-10-25T23:36:09.294200+0000","last_unstale":"2023-10-25T23:45:11.008060+0000","last_undegraded":"2023-10-25T23:45:11.008060+0000","last_fullsized":"2023-10-25T23:45:11.008060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2163","last_scrub_stamp":"2023-10-25T23:45:11.007857+0000","last_deep_scrub":"40'2163","last_deep_scrub_stamp":"2023-10-25T23:45:11.007857+0000","last_clean_scrub_stamp":"2023-10-25T23:45:11.007857+0000","objects_scrubbed":0,"log_size":2163,"log_dups_size":0,"ondisk_log_size":2163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:25:56.561399+0000","scrub_duration":0.0049179410000000003,"objects_trimmed":0,"snaptrim_duration":0.047064776000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":3992,"num_write":1263,"num_write_kb":18428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"41'415","reported_seq":461,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:55.046636+0000","last_change":"2023-10-25T23:44:55.046636+0000","last_active":"2023-10-25T23:44:55.046636+0000","last_peered":"2023-10-25T23:44:55.046636+0000","last_clean":"2023-10-25T23:44:55.046636+0000","last_became_active":"2023-10-25T23:36:08.272301+0000","last_became_peered":"2023-10-25T23:36:08.272301+0000","last_unstale":"2023-10-25T23:44:55.046636+0000","last_undegraded":"2023-10-25T23:44:55.046636+0000","last_fullsized":"2023-10-25T23:44:55.046636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'415","last_scrub_stamp":"2023-10-25T23:44:55.046459+0000","last_deep_scrub":"41'415","last_deep_scrub_stamp":"2023-10-25T23:44:55.046459+0000","last_clean_scrub_stamp":"2023-10-25T23:44:55.046459+0000","objects_scrubbed":27,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:04:17.601081+0000","scrub_duration":0.103266866,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":376,"num_write_kb":99496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":428421,"num_omap_keys":766,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"40'2015","reported_seq":4649,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:13.085351+0000","last_change":"2023-10-25T23:45:13.085351+0000","last_active":"2023-10-25T23:45:13.085351+0000","last_peered":"2023-10-25T23:45:13.085351+0000","last_clean":"2023-10-25T23:45:13.085351+0000","last_became_active":"2023-10-25T23:36:09.291305+0000","last_became_peered":"2023-10-25T23:36:09.291305+0000","last_unstale":"2023-10-25T23:45:13.085351+0000","last_undegraded":"2023-10-25T23:45:13.085351+0000","last_fullsized":"2023-10-25T23:45:13.085351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2015","last_scrub_stamp":"2023-10-25T23:45:13.085125+0000","last_deep_scrub":"40'2015","last_deep_scrub_stamp":"2023-10-25T23:45:13.085125+0000","last_clean_scrub_stamp":"2023-10-25T23:45:13.085125+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:27:19.691270+0000","scrub_duration":0.0065419679999999996,"objects_trimmed":0,"snaptrim_duration":0.044631746999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":3822,"num_write":1210,"num_write_kb":15603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"41'353","reported_seq":398,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:49.036427+0000","last_change":"2023-10-25T23:44:49.036427+0000","last_active":"2023-10-25T23:44:49.036427+0000","last_peered":"2023-10-25T23:44:49.036427+0000","last_clean":"2023-10-25T23:44:49.036427+0000","last_became_active":"2023-10-25T23:36:08.277327+0000","last_became_peered":"2023-10-25T23:36:08.277327+0000","last_unstale":"2023-10-25T23:44:49.036427+0000","last_undegraded":"2023-10-25T23:44:49.036427+0000","last_fullsized":"2023-10-25T23:44:49.036427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'353","last_scrub_stamp":"2023-10-25T23:44:49.036269+0000","last_deep_scrub":"41'353","last_deep_scrub_stamp":"2023-10-25T23:44:49.036269+0000","last_clean_scrub_stamp":"2023-10-25T23:44:49.036269+0000","objects_scrubbed":19,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:59:01.177225+0000","scrub_duration":0.043642932000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":349,"num_write_kb":89245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":985085,"num_omap_keys":1249,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"40'2084","reported_seq":4743,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:17.092068+0000","last_change":"2023-10-25T23:45:17.092068+0000","last_active":"2023-10-25T23:45:17.092068+0000","last_peered":"2023-10-25T23:45:17.092068+0000","last_clean":"2023-10-25T23:45:17.092068+0000","last_became_active":"2023-10-25T23:36:09.295231+0000","last_became_peered":"2023-10-25T23:36:09.295231+0000","last_unstale":"2023-10-25T23:45:17.092068+0000","last_undegraded":"2023-10-25T23:45:17.092068+0000","last_fullsized":"2023-10-25T23:45:17.092068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2084","last_scrub_stamp":"2023-10-25T23:45:17.091849+0000","last_deep_scrub":"40'2084","last_deep_scrub_stamp":"2023-10-25T23:45:17.091849+0000","last_clean_scrub_stamp":"2023-10-25T23:45:17.091849+0000","objects_scrubbed":0,"log_size":2084,"log_dups_size":0,"ondisk_log_size":2084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:56:10.175191+0000","scrub_duration":0.0056155550000000004,"objects_trimmed":0,"snaptrim_duration":0.037920328000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":12104,"num_write":1268,"num_write_kb":24673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"41'408","reported_seq":453,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:51.531995+0000","last_change":"2023-10-25T23:44:51.531995+0000","last_active":"2023-10-25T23:44:51.531995+0000","last_peered":"2023-10-25T23:44:51.531995+0000","last_clean":"2023-10-25T23:44:51.531995+0000","last_became_active":"2023-10-25T23:36:08.263264+0000","last_became_peered":"2023-10-25T23:36:08.263264+0000","last_unstale":"2023-10-25T23:44:51.531995+0000","last_undegraded":"2023-10-25T23:44:51.531995+0000","last_fullsized":"2023-10-25T23:44:51.531995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'408","last_scrub_stamp":"2023-10-25T23:44:51.531833+0000","last_deep_scrub":"41'408","last_deep_scrub_stamp":"2023-10-25T23:44:51.531833+0000","last_clean_scrub_stamp":"2023-10-25T23:44:51.531833+0000","objects_scrubbed":21,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:14:41.177258+0000","scrub_duration":0.064666293999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554454,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":368,"num_write_kb":90831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":303629,"num_omap_keys":534,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"40'2070","reported_seq":4709,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:22.162144+0000","last_change":"2023-10-25T23:45:22.162191+0000","last_active":"2023-10-25T23:45:22.162144+0000","last_peered":"2023-10-25T23:45:22.162144+0000","last_clean":"2023-10-25T23:45:22.162144+0000","last_became_active":"2023-10-25T23:36:09.294298+0000","last_became_peered":"2023-10-25T23:36:09.294298+0000","last_unstale":"2023-10-25T23:45:22.162144+0000","last_undegraded":"2023-10-25T23:45:22.162144+0000","last_fullsized":"2023-10-25T23:45:22.162144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2070","last_scrub_stamp":"2023-10-25T23:45:22.162003+0000","last_deep_scrub":"40'2070","last_deep_scrub_stamp":"2023-10-25T23:45:22.162003+0000","last_clean_scrub_stamp":"2023-10-25T23:45:22.162003+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:19:09.916230+0000","scrub_duration":0.0050462509999999999,"objects_trimmed":0,"snaptrim_duration":0.040324974999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":8972,"num_write":1223,"num_write_kb":21636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"40'339","reported_seq":384,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-25T23:44:45.236992+0000","last_change":"2023-10-25T23:44:45.236992+0000","last_active":"2023-10-25T23:44:45.236992+0000","last_peered":"2023-10-25T23:44:45.236992+0000","last_clean":"2023-10-25T23:44:45.236992+0000","last_became_active":"2023-10-25T23:36:08.277087+0000","last_became_peered":"2023-10-25T23:36:08.277087+0000","last_unstale":"2023-10-25T23:44:45.236992+0000","last_undegraded":"2023-10-25T23:44:45.236992+0000","last_fullsized":"2023-10-25T23:44:45.236992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'339","last_scrub_stamp":"2023-10-25T23:44:45.236835+0000","last_deep_scrub":"40'339","last_deep_scrub_stamp":"2023-10-25T23:44:45.236835+0000","last_clean_scrub_stamp":"2023-10-25T23:44:45.236835+0000","objects_scrubbed":23,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:38:57.739655+0000","scrub_duration":0.071032165999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":307,"num_write_kb":115956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":959437,"num_omap_keys":1709,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"40'2156","reported_seq":4774,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:02.409958+0000","last_change":"2023-10-25T23:45:02.410009+0000","last_active":"2023-10-25T23:45:02.409958+0000","last_peered":"2023-10-25T23:45:02.409958+0000","last_clean":"2023-10-25T23:45:02.409958+0000","last_became_active":"2023-10-25T23:36:50.069951+0000","last_became_peered":"2023-10-25T23:36:50.069951+0000","last_unstale":"2023-10-25T23:45:02.409958+0000","last_undegraded":"2023-10-25T23:45:02.409958+0000","last_fullsized":"2023-10-25T23:45:02.409958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2156","last_scrub_stamp":"2023-10-25T23:45:02.409846+0000","last_deep_scrub":"40'2156","last_deep_scrub_stamp":"2023-10-25T23:45:02.409846+0000","last_clean_scrub_stamp":"2023-10-25T23:45:02.409846+0000","objects_scrubbed":0,"log_size":2156,"log_dups_size":0,"ondisk_log_size":2156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:19:24.191246+0000","scrub_duration":0.0063092230000000001,"objects_trimmed":0,"snaptrim_duration":0.160884052,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":24659,"num_write":1256,"num_write_kb":46504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"41'308","reported_seq":353,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:51.399474+0000","last_change":"2023-10-25T23:44:51.399552+0000","last_active":"2023-10-25T23:44:51.399474+0000","last_peered":"2023-10-25T23:44:51.399474+0000","last_clean":"2023-10-25T23:44:51.399474+0000","last_became_active":"2023-10-25T23:36:08.279302+0000","last_became_peered":"2023-10-25T23:36:08.279302+0000","last_unstale":"2023-10-25T23:44:51.399474+0000","last_undegraded":"2023-10-25T23:44:51.399474+0000","last_fullsized":"2023-10-25T23:44:51.399474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'308","last_scrub_stamp":"2023-10-25T23:44:51.399374+0000","last_deep_scrub":"41'308","last_deep_scrub_stamp":"2023-10-25T23:44:51.399374+0000","last_clean_scrub_stamp":"2023-10-25T23:44:51.399374+0000","objects_scrubbed":16,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:05:25.858112+0000","scrub_duration":0.073867762000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":257,"num_write_kb":101207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2453176,"num_omap_keys":4372,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"40'2040","reported_seq":4681,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:04.566238+0000","last_change":"2023-10-25T23:45:04.566311+0000","last_active":"2023-10-25T23:45:04.566238+0000","last_peered":"2023-10-25T23:45:04.566238+0000","last_clean":"2023-10-25T23:45:04.566238+0000","last_became_active":"2023-10-25T23:36:09.292670+0000","last_became_peered":"2023-10-25T23:36:09.292670+0000","last_unstale":"2023-10-25T23:45:04.566238+0000","last_undegraded":"2023-10-25T23:45:04.566238+0000","last_fullsized":"2023-10-25T23:45:04.566238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2040","last_scrub_stamp":"2023-10-25T23:45:04.566100+0000","last_deep_scrub":"40'2040","last_deep_scrub_stamp":"2023-10-25T23:45:04.566100+0000","last_clean_scrub_stamp":"2023-10-25T23:45:04.566100+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:26:33.627605+0000","scrub_duration":0.0053032269999999998,"objects_trimmed":0,"snaptrim_duration":0.104196124,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":209,"num_read_kb":4275,"num_write":1236,"num_write_kb":22107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"40'2118","reported_seq":4736,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:07.329140+0000","last_change":"2023-10-25T23:45:07.329194+0000","last_active":"2023-10-25T23:45:07.329140+0000","last_peered":"2023-10-25T23:45:07.329140+0000","last_clean":"2023-10-25T23:45:07.329140+0000","last_became_active":"2023-10-25T23:36:09.283766+0000","last_became_peered":"2023-10-25T23:36:09.283766+0000","last_unstale":"2023-10-25T23:45:07.329140+0000","last_undegraded":"2023-10-25T23:45:07.329140+0000","last_fullsized":"2023-10-25T23:45:07.329140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2118","last_scrub_stamp":"2023-10-25T23:45:07.329001+0000","last_deep_scrub":"40'2118","last_deep_scrub_stamp":"2023-10-25T23:45:07.329001+0000","last_clean_scrub_stamp":"2023-10-25T23:45:07.329001+0000","objects_scrubbed":0,"log_size":2118,"log_dups_size":0,"ondisk_log_size":2118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:27:13.935146+0000","scrub_duration":0.0046581849999999996,"objects_trimmed":0,"snaptrim_duration":0.055043175999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":219,"num_read_kb":3969,"num_write":1247,"num_write_kb":17464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"41'565","reported_seq":903,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:50.098163+0000","last_change":"2023-10-25T23:44:50.098228+0000","last_active":"2023-10-25T23:44:50.098163+0000","last_peered":"2023-10-25T23:44:50.098163+0000","last_clean":"2023-10-25T23:44:50.098163+0000","last_became_active":"2023-10-25T23:36:08.263842+0000","last_became_peered":"2023-10-25T23:36:08.263842+0000","last_unstale":"2023-10-25T23:44:50.098163+0000","last_undegraded":"2023-10-25T23:44:50.098163+0000","last_fullsized":"2023-10-25T23:44:50.098163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'565","last_scrub_stamp":"2023-10-25T23:44:50.098069+0000","last_deep_scrub":"41'565","last_deep_scrub_stamp":"2023-10-25T23:44:50.098069+0000","last_clean_scrub_stamp":"2023-10-25T23:44:50.098069+0000","objects_scrubbed":15,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:37:16.219278+0000","scrub_duration":0.058695506000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":301,"num_read_kb":4287,"num_write":520,"num_write_kb":107914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":890223,"num_omap_keys":1552,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"40'2114","reported_seq":4715,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:02.137087+0000","last_change":"2023-10-25T23:45:02.137146+0000","last_active":"2023-10-25T23:45:02.137087+0000","last_peered":"2023-10-25T23:45:02.137087+0000","last_clean":"2023-10-25T23:45:02.137087+0000","last_became_active":"2023-10-25T23:36:09.295595+0000","last_became_peered":"2023-10-25T23:36:09.295595+0000","last_unstale":"2023-10-25T23:45:02.137087+0000","last_undegraded":"2023-10-25T23:45:02.137087+0000","last_fullsized":"2023-10-25T23:45:02.137087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2114","last_scrub_stamp":"2023-10-25T23:45:02.136918+0000","last_deep_scrub":"40'2114","last_deep_scrub_stamp":"2023-10-25T23:45:02.136918+0000","last_clean_scrub_stamp":"2023-10-25T23:45:02.136918+0000","objects_scrubbed":0,"log_size":2114,"log_dups_size":0,"ondisk_log_size":2114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-26T23:58:26.116142+0000","scrub_duration":0.0051631990000000003,"objects_trimmed":0,"snaptrim_duration":0.038517528000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":3321,"num_write":1232,"num_write_kb":16686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"41'231","reported_seq":276,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:53.344277+0000","last_change":"2023-10-25T23:44:53.344346+0000","last_active":"2023-10-25T23:44:53.344277+0000","last_peered":"2023-10-25T23:44:53.344277+0000","last_clean":"2023-10-25T23:44:53.344277+0000","last_became_active":"2023-10-25T23:36:08.271640+0000","last_became_peered":"2023-10-25T23:36:08.271640+0000","last_unstale":"2023-10-25T23:44:53.344277+0000","last_undegraded":"2023-10-25T23:44:53.344277+0000","last_fullsized":"2023-10-25T23:44:53.344277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'231","last_scrub_stamp":"2023-10-25T23:44:53.344188+0000","last_deep_scrub":"41'231","last_deep_scrub_stamp":"2023-10-25T23:44:53.344188+0000","last_clean_scrub_stamp":"2023-10-25T23:44:53.344188+0000","objects_scrubbed":11,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:50:10.482282+0000","scrub_duration":0.021348121000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":15,"num_read_kb":0,"num_write":206,"num_write_kb":71125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":827399,"num_omap_keys":1449,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"41'119","reported_seq":200,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:57.051874+0000","last_change":"2023-10-25T23:44:57.051994+0000","last_active":"2023-10-25T23:44:57.051874+0000","last_peered":"2023-10-25T23:44:57.051874+0000","last_clean":"2023-10-25T23:44:57.051874+0000","last_became_active":"2023-10-25T23:35:58.276606+0000","last_became_peered":"2023-10-25T23:35:58.276606+0000","last_unstale":"2023-10-25T23:44:57.051874+0000","last_undegraded":"2023-10-25T23:44:57.051874+0000","last_fullsized":"2023-10-25T23:44:57.051874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'119","last_scrub_stamp":"2023-10-25T23:44:57.051784+0000","last_deep_scrub":"41'119","last_deep_scrub_stamp":"2023-10-25T23:44:57.051784+0000","last_clean_scrub_stamp":"2023-10-25T23:44:57.051784+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:35:34.943703+0000","scrub_duration":0.0053083490000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"40'1947","reported_seq":4568,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:53.768499+0000","last_change":"2023-10-25T23:44:53.768591+0000","last_active":"2023-10-25T23:44:53.768499+0000","last_peered":"2023-10-25T23:44:53.768499+0000","last_clean":"2023-10-25T23:44:53.768499+0000","last_became_active":"2023-10-25T23:36:09.291072+0000","last_became_peered":"2023-10-25T23:36:09.291072+0000","last_unstale":"2023-10-25T23:44:53.768499+0000","last_undegraded":"2023-10-25T23:44:53.768499+0000","last_fullsized":"2023-10-25T23:44:53.768499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1947","last_scrub_stamp":"2023-10-25T23:44:53.768341+0000","last_deep_scrub":"40'1947","last_deep_scrub_stamp":"2023-10-25T23:44:53.768341+0000","last_clean_scrub_stamp":"2023-10-25T23:44:53.768341+0000","objects_scrubbed":0,"log_size":1947,"log_dups_size":0,"ondisk_log_size":1947,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:51:02.117926+0000","scrub_duration":0.0055393680000000002,"objects_trimmed":0,"snaptrim_duration":0.185957752,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":180,"num_read_kb":28650,"num_write":1164,"num_write_kb":22232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"41'257","reported_seq":302,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:04.095508+0000","last_change":"2023-10-25T23:45:04.095628+0000","last_active":"2023-10-25T23:45:04.095508+0000","last_peered":"2023-10-25T23:45:04.095508+0000","last_clean":"2023-10-25T23:45:04.095508+0000","last_became_active":"2023-10-25T23:36:08.277663+0000","last_became_peered":"2023-10-25T23:36:08.277663+0000","last_unstale":"2023-10-25T23:45:04.095508+0000","last_undegraded":"2023-10-25T23:45:04.095508+0000","last_fullsized":"2023-10-25T23:45:04.095508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'257","last_scrub_stamp":"2023-10-25T23:45:04.095393+0000","last_deep_scrub":"41'257","last_deep_scrub_stamp":"2023-10-25T23:45:04.095393+0000","last_clean_scrub_stamp":"2023-10-25T23:45:04.095393+0000","objects_scrubbed":17,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:19:25.876792+0000","scrub_duration":0.044802369000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":226,"num_write_kb":82970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":343372,"num_omap_keys":597,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"41'498","reported_seq":543,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:08.030347+0000","last_change":"2023-10-25T23:45:08.030411+0000","last_active":"2023-10-25T23:45:08.030347+0000","last_peered":"2023-10-25T23:45:08.030347+0000","last_clean":"2023-10-25T23:45:08.030347+0000","last_became_active":"2023-10-25T23:36:08.269896+0000","last_became_peered":"2023-10-25T23:36:08.269896+0000","last_unstale":"2023-10-25T23:45:08.030347+0000","last_undegraded":"2023-10-25T23:45:08.030347+0000","last_fullsized":"2023-10-25T23:45:08.030347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'498","last_scrub_stamp":"2023-10-25T23:45:08.030257+0000","last_deep_scrub":"41'498","last_deep_scrub_stamp":"2023-10-25T23:45:08.030257+0000","last_clean_scrub_stamp":"2023-10-25T23:45:08.030257+0000","objects_scrubbed":13,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:58:58.522191+0000","scrub_duration":0.067194090999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":446,"num_write_kb":94912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336512,"num_omap_keys":600,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"40'2036","reported_seq":4681,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:11.455726+0000","last_change":"2023-10-25T23:45:11.455810+0000","last_active":"2023-10-25T23:45:11.455726+0000","last_peered":"2023-10-25T23:45:11.455726+0000","last_clean":"2023-10-25T23:45:11.455726+0000","last_became_active":"2023-10-25T23:36:09.278967+0000","last_became_peered":"2023-10-25T23:36:09.278967+0000","last_unstale":"2023-10-25T23:45:11.455726+0000","last_undegraded":"2023-10-25T23:45:11.455726+0000","last_fullsized":"2023-10-25T23:45:11.455726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2036","last_scrub_stamp":"2023-10-25T23:45:11.455577+0000","last_deep_scrub":"40'2036","last_deep_scrub_stamp":"2023-10-25T23:45:11.455577+0000","last_clean_scrub_stamp":"2023-10-25T23:45:11.455577+0000","objects_scrubbed":0,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:40:27.120347+0000","scrub_duration":0.0057848709999999996,"objects_trimmed":0,"snaptrim_duration":0.055404268,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":3903,"num_write":1243,"num_write_kb":26062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"41'379","reported_seq":424,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:04.342729+0000","last_change":"2023-10-25T23:45:04.342838+0000","last_active":"2023-10-25T23:45:04.342729+0000","last_peered":"2023-10-25T23:45:04.342729+0000","last_clean":"2023-10-25T23:45:04.342729+0000","last_became_active":"2023-10-25T23:36:08.279082+0000","last_became_peered":"2023-10-25T23:36:08.279082+0000","last_unstale":"2023-10-25T23:45:04.342729+0000","last_undegraded":"2023-10-25T23:45:04.342729+0000","last_fullsized":"2023-10-25T23:45:04.342729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'379","last_scrub_stamp":"2023-10-25T23:45:04.342644+0000","last_deep_scrub":"41'379","last_deep_scrub_stamp":"2023-10-25T23:45:04.342644+0000","last_clean_scrub_stamp":"2023-10-25T23:45:04.342644+0000","objects_scrubbed":14,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:44:05.654623+0000","scrub_duration":0.051811070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":470,"num_write_kb":81486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":175294,"num_omap_keys":314,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"40'1963","reported_seq":4583,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:35.801441+0000","last_change":"2023-10-25T23:45:35.801496+0000","last_active":"2023-10-25T23:45:35.801441+0000","last_peered":"2023-10-25T23:45:35.801441+0000","last_clean":"2023-10-25T23:45:35.801441+0000","last_became_active":"2023-10-25T23:36:09.289751+0000","last_became_peered":"2023-10-25T23:36:09.289751+0000","last_unstale":"2023-10-25T23:45:35.801441+0000","last_undegraded":"2023-10-25T23:45:35.801441+0000","last_fullsized":"2023-10-25T23:45:35.801441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1963","last_scrub_stamp":"2023-10-25T23:45:35.801332+0000","last_deep_scrub":"40'1963","last_deep_scrub_stamp":"2023-10-25T23:45:35.801332+0000","last_clean_scrub_stamp":"2023-10-25T23:45:35.801332+0000","objects_scrubbed":0,"log_size":1963,"log_dups_size":0,"ondisk_log_size":1963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:19:23.555559+0000","scrub_duration":0.0048586419999999998,"objects_trimmed":0,"snaptrim_duration":0.039560708999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":4389,"num_write":1130,"num_write_kb":12211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"41'425","reported_seq":470,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:05.052342+0000","last_change":"2023-10-25T23:45:05.052420+0000","last_active":"2023-10-25T23:45:05.052342+0000","last_peered":"2023-10-25T23:45:05.052342+0000","last_clean":"2023-10-25T23:45:05.052342+0000","last_became_active":"2023-10-25T23:36:08.273029+0000","last_became_peered":"2023-10-25T23:36:08.273029+0000","last_unstale":"2023-10-25T23:45:05.052342+0000","last_undegraded":"2023-10-25T23:45:05.052342+0000","last_fullsized":"2023-10-25T23:45:05.052342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'425","last_scrub_stamp":"2023-10-25T23:45:05.052255+0000","last_deep_scrub":"41'425","last_deep_scrub_stamp":"2023-10-25T23:45:05.052255+0000","last_clean_scrub_stamp":"2023-10-25T23:45:05.052255+0000","objects_scrubbed":17,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:44:06.364234+0000","scrub_duration":0.089985721000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":396,"num_write_kb":80384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1784242,"num_omap_keys":3118,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"40'1994","reported_seq":4630,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:20.925328+0000","last_change":"2023-10-25T23:45:20.925426+0000","last_active":"2023-10-25T23:45:20.925328+0000","last_peered":"2023-10-25T23:45:20.925328+0000","last_clean":"2023-10-25T23:45:20.925328+0000","last_became_active":"2023-10-25T23:36:09.287532+0000","last_became_peered":"2023-10-25T23:36:09.287532+0000","last_unstale":"2023-10-25T23:45:20.925328+0000","last_undegraded":"2023-10-25T23:45:20.925328+0000","last_fullsized":"2023-10-25T23:45:20.925328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1994","last_scrub_stamp":"2023-10-25T23:45:20.925194+0000","last_deep_scrub":"40'1994","last_deep_scrub_stamp":"2023-10-25T23:45:20.925194+0000","last_clean_scrub_stamp":"2023-10-25T23:45:20.925194+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:12:21.865060+0000","scrub_duration":0.0050023979999999999,"objects_trimmed":0,"snaptrim_duration":0.194145863,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":4941,"num_write":1181,"num_write_kb":9554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"41'262","reported_seq":307,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:58.158213+0000","last_change":"2023-10-25T23:44:58.158287+0000","last_active":"2023-10-25T23:44:58.158213+0000","last_peered":"2023-10-25T23:44:58.158213+0000","last_clean":"2023-10-25T23:44:58.158213+0000","last_became_active":"2023-10-25T23:36:08.266648+0000","last_became_peered":"2023-10-25T23:36:08.266648+0000","last_unstale":"2023-10-25T23:44:58.158213+0000","last_undegraded":"2023-10-25T23:44:58.158213+0000","last_fullsized":"2023-10-25T23:44:58.158213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'262","last_scrub_stamp":"2023-10-25T23:44:58.158124+0000","last_deep_scrub":"41'262","last_deep_scrub_stamp":"2023-10-25T23:44:58.158124+0000","last_clean_scrub_stamp":"2023-10-25T23:44:58.158124+0000","objects_scrubbed":24,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:39:03.956788+0000","scrub_duration":0.103703136,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":194,"num_write_kb":95518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3191637,"num_omap_keys":4061,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"40'2107","reported_seq":4740,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:54.474516+0000","last_change":"2023-10-25T23:44:54.474641+0000","last_active":"2023-10-25T23:44:54.474516+0000","last_peered":"2023-10-25T23:44:54.474516+0000","last_clean":"2023-10-25T23:44:54.474516+0000","last_became_active":"2023-10-25T23:36:09.284666+0000","last_became_peered":"2023-10-25T23:36:09.284666+0000","last_unstale":"2023-10-25T23:44:54.474516+0000","last_undegraded":"2023-10-25T23:44:54.474516+0000","last_fullsized":"2023-10-25T23:44:54.474516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2107","last_scrub_stamp":"2023-10-25T23:44:54.474411+0000","last_deep_scrub":"40'2107","last_deep_scrub_stamp":"2023-10-25T23:44:54.474411+0000","last_clean_scrub_stamp":"2023-10-25T23:44:54.474411+0000","objects_scrubbed":0,"log_size":2107,"log_dups_size":0,"ondisk_log_size":2107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:59:09.268570+0000","scrub_duration":0.0048174560000000003,"objects_trimmed":0,"snaptrim_duration":0.075073965000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":4417,"num_write":1270,"num_write_kb":29307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"41'413","reported_seq":458,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:06.380183+0000","last_change":"2023-10-25T23:45:06.380244+0000","last_active":"2023-10-25T23:45:06.380183+0000","last_peered":"2023-10-25T23:45:06.380183+0000","last_clean":"2023-10-25T23:45:06.380183+0000","last_became_active":"2023-10-25T23:36:08.277873+0000","last_became_peered":"2023-10-25T23:36:08.277873+0000","last_unstale":"2023-10-25T23:45:06.380183+0000","last_undegraded":"2023-10-25T23:45:06.380183+0000","last_fullsized":"2023-10-25T23:45:06.380183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'413","last_scrub_stamp":"2023-10-25T23:45:06.380094+0000","last_deep_scrub":"41'413","last_deep_scrub_stamp":"2023-10-25T23:45:06.380094+0000","last_clean_scrub_stamp":"2023-10-25T23:45:06.380094+0000","objects_scrubbed":23,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:04:30.418912+0000","scrub_duration":0.082684259999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":385,"num_write_kb":96608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1359456,"num_omap_keys":1930,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"41'2141","reported_seq":4770,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:10.106724+0000","last_change":"2023-10-25T23:45:10.106779+0000","last_active":"2023-10-25T23:45:10.106724+0000","last_peered":"2023-10-25T23:45:10.106724+0000","last_clean":"2023-10-25T23:45:10.106724+0000","last_became_active":"2023-10-25T23:36:09.289320+0000","last_became_peered":"2023-10-25T23:36:09.289320+0000","last_unstale":"2023-10-25T23:45:10.106724+0000","last_undegraded":"2023-10-25T23:45:10.106724+0000","last_fullsized":"2023-10-25T23:45:10.106724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'2141","last_scrub_stamp":"2023-10-25T23:45:10.106629+0000","last_deep_scrub":"41'2141","last_deep_scrub_stamp":"2023-10-25T23:45:10.106629+0000","last_clean_scrub_stamp":"2023-10-25T23:45:10.106629+0000","objects_scrubbed":1,"log_size":2141,"log_dups_size":0,"ondisk_log_size":2141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:10:04.876582+0000","scrub_duration":0.0085135999999999996,"objects_trimmed":0,"snaptrim_duration":0.037048923999999997,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":230,"num_read_kb":4443,"num_write":1269,"num_write_kb":26048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"41'641","reported_seq":686,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:58.338708+0000","last_change":"2023-10-25T23:44:58.338811+0000","last_active":"2023-10-25T23:44:58.338708+0000","last_peered":"2023-10-25T23:44:58.338708+0000","last_clean":"2023-10-25T23:44:58.338708+0000","last_became_active":"2023-10-25T23:36:08.278656+0000","last_became_peered":"2023-10-25T23:36:08.278656+0000","last_unstale":"2023-10-25T23:44:58.338708+0000","last_undegraded":"2023-10-25T23:44:58.338708+0000","last_fullsized":"2023-10-25T23:44:58.338708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'641","last_scrub_stamp":"2023-10-25T23:44:58.338617+0000","last_deep_scrub":"41'641","last_deep_scrub_stamp":"2023-10-25T23:44:58.338617+0000","last_clean_scrub_stamp":"2023-10-25T23:44:58.338617+0000","objects_scrubbed":23,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:34:14.170088+0000","scrub_duration":0.089561260000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":598,"num_write_kb":115954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":812553,"num_omap_keys":1430,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"40'2112","reported_seq":4718,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:57.063664+0000","last_change":"2023-10-25T23:44:57.063664+0000","last_active":"2023-10-25T23:44:57.063664+0000","last_peered":"2023-10-25T23:44:57.063664+0000","last_clean":"2023-10-25T23:44:57.063664+0000","last_became_active":"2023-10-25T23:36:09.292345+0000","last_became_peered":"2023-10-25T23:36:09.292345+0000","last_unstale":"2023-10-25T23:44:57.063664+0000","last_undegraded":"2023-10-25T23:44:57.063664+0000","last_fullsized":"2023-10-25T23:44:57.063664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2112","last_scrub_stamp":"2023-10-25T23:44:57.063525+0000","last_deep_scrub":"40'2112","last_deep_scrub_stamp":"2023-10-25T23:44:57.063525+0000","last_clean_scrub_stamp":"2023-10-25T23:44:57.063525+0000","objects_scrubbed":0,"log_size":2112,"log_dups_size":0,"ondisk_log_size":2112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:35:34.955444+0000","scrub_duration":0.0042181479999999997,"objects_trimmed":0,"snaptrim_duration":0.039941503000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":8471,"num_write":1242,"num_write_kb":22974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"41'431","reported_seq":476,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:05.082243+0000","last_change":"2023-10-25T23:45:05.082243+0000","last_active":"2023-10-25T23:45:05.082243+0000","last_peered":"2023-10-25T23:45:05.082243+0000","last_clean":"2023-10-25T23:45:05.082243+0000","last_became_active":"2023-10-25T23:36:08.268753+0000","last_became_peered":"2023-10-25T23:36:08.268753+0000","last_unstale":"2023-10-25T23:45:05.082243+0000","last_undegraded":"2023-10-25T23:45:05.082243+0000","last_fullsized":"2023-10-25T23:45:05.082243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'431","last_scrub_stamp":"2023-10-25T23:45:05.082053+0000","last_deep_scrub":"41'431","last_deep_scrub_stamp":"2023-10-25T23:45:05.082053+0000","last_clean_scrub_stamp":"2023-10-25T23:45:05.082053+0000","objects_scrubbed":15,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:24.276423+0000","scrub_duration":0.047061694000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":415,"num_write_kb":99792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":353948,"num_omap_keys":624,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"40'2029","reported_seq":4668,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:25.233513+0000","last_change":"2023-10-25T23:45:25.233587+0000","last_active":"2023-10-25T23:45:25.233513+0000","last_peered":"2023-10-25T23:45:25.233513+0000","last_clean":"2023-10-25T23:45:25.233513+0000","last_became_active":"2023-10-25T23:36:09.290151+0000","last_became_peered":"2023-10-25T23:36:09.290151+0000","last_unstale":"2023-10-25T23:45:25.233513+0000","last_undegraded":"2023-10-25T23:45:25.233513+0000","last_fullsized":"2023-10-25T23:45:25.233513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2029","last_scrub_stamp":"2023-10-25T23:45:25.233379+0000","last_deep_scrub":"40'2029","last_deep_scrub_stamp":"2023-10-25T23:45:25.233379+0000","last_clean_scrub_stamp":"2023-10-25T23:45:25.233379+0000","objects_scrubbed":0,"log_size":2029,"log_dups_size":0,"ondisk_log_size":2029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:07:54.294883+0000","scrub_duration":0.0061963959999999998,"objects_trimmed":0,"snaptrim_duration":0.047955154,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":5633,"num_write":1198,"num_write_kb":13442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"41'239","reported_seq":284,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.059663+0000","last_change":"2023-10-25T23:44:48.059663+0000","last_active":"2023-10-25T23:44:48.059663+0000","last_peered":"2023-10-25T23:44:48.059663+0000","last_clean":"2023-10-25T23:44:48.059663+0000","last_became_active":"2023-10-25T23:36:08.271846+0000","last_became_peered":"2023-10-25T23:36:08.271846+0000","last_unstale":"2023-10-25T23:44:48.059663+0000","last_undegraded":"2023-10-25T23:44:48.059663+0000","last_fullsized":"2023-10-25T23:44:48.059663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'239","last_scrub_stamp":"2023-10-25T23:44:48.059439+0000","last_deep_scrub":"41'239","last_deep_scrub_stamp":"2023-10-25T23:44:48.059439+0000","last_clean_scrub_stamp":"2023-10-25T23:44:48.059439+0000","objects_scrubbed":13,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T11:23:30.202942+0000","scrub_duration":0.071935235,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":195,"num_write_kb":98810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":281074,"num_omap_keys":484,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"40'2031","reported_seq":4654,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:15.006483+0000","last_change":"2023-10-25T23:45:15.006533+0000","last_active":"2023-10-25T23:45:15.006483+0000","last_peered":"2023-10-25T23:45:15.006483+0000","last_clean":"2023-10-25T23:45:15.006483+0000","last_became_active":"2023-10-25T23:36:09.295635+0000","last_became_peered":"2023-10-25T23:36:09.295635+0000","last_unstale":"2023-10-25T23:45:15.006483+0000","last_undegraded":"2023-10-25T23:45:15.006483+0000","last_fullsized":"2023-10-25T23:45:15.006483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2031","last_scrub_stamp":"2023-10-25T23:45:15.006366+0000","last_deep_scrub":"40'2031","last_deep_scrub_stamp":"2023-10-25T23:45:15.006366+0000","last_clean_scrub_stamp":"2023-10-25T23:45:15.006366+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:35:33.630970+0000","scrub_duration":0.0051643940000000001,"objects_trimmed":0,"snaptrim_duration":0.046467368000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":10038,"num_write":1186,"num_write_kb":32237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"41'466","reported_seq":511,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:48.225686+0000","last_change":"2023-10-25T23:44:48.225686+0000","last_active":"2023-10-25T23:44:48.225686+0000","last_peered":"2023-10-25T23:44:48.225686+0000","last_clean":"2023-10-25T23:44:48.225686+0000","last_became_active":"2023-10-25T23:36:08.277344+0000","last_became_peered":"2023-10-25T23:36:08.277344+0000","last_unstale":"2023-10-25T23:44:48.225686+0000","last_undegraded":"2023-10-25T23:44:48.225686+0000","last_fullsized":"2023-10-25T23:44:48.225686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'466","last_scrub_stamp":"2023-10-25T23:44:48.225545+0000","last_deep_scrub":"41'466","last_deep_scrub_stamp":"2023-10-25T23:44:48.225545+0000","last_clean_scrub_stamp":"2023-10-25T23:44:48.225545+0000","objects_scrubbed":24,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:28:40.923648+0000","scrub_duration":0.059957362,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25170780,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":452,"num_write_kb":113081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1826286,"num_omap_keys":3161,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"40'2042","reported_seq":4679,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:06.491512+0000","last_change":"2023-10-25T23:45:06.491512+0000","last_active":"2023-10-25T23:45:06.491512+0000","last_peered":"2023-10-25T23:45:06.491512+0000","last_clean":"2023-10-25T23:45:06.491512+0000","last_became_active":"2023-10-25T23:36:09.299234+0000","last_became_peered":"2023-10-25T23:36:09.299234+0000","last_unstale":"2023-10-25T23:45:06.491512+0000","last_undegraded":"2023-10-25T23:45:06.491512+0000","last_fullsized":"2023-10-25T23:45:06.491512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2042","last_scrub_stamp":"2023-10-25T23:45:06.491349+0000","last_deep_scrub":"40'2042","last_deep_scrub_stamp":"2023-10-25T23:45:06.491349+0000","last_clean_scrub_stamp":"2023-10-25T23:45:06.491349+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T08:10:01.261301+0000","scrub_duration":0.0050064489999999996,"objects_trimmed":0,"snaptrim_duration":0.15372042599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":4213,"num_write":1231,"num_write_kb":8559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"40'482","reported_seq":527,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:47.873207+0000","last_change":"2023-10-25T23:44:46.025275+0000","last_active":"2023-10-25T23:44:47.873207+0000","last_peered":"2023-10-25T23:44:47.873207+0000","last_clean":"2023-10-25T23:44:47.873207+0000","last_became_active":"2023-10-25T23:36:08.269065+0000","last_became_peered":"2023-10-25T23:36:08.269065+0000","last_unstale":"2023-10-25T23:44:47.873207+0000","last_undegraded":"2023-10-25T23:44:47.873207+0000","last_fullsized":"2023-10-25T23:44:47.873207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'482","last_scrub_stamp":"2023-10-25T23:44:46.025130+0000","last_deep_scrub":"40'482","last_deep_scrub_stamp":"2023-10-25T23:44:46.025130+0000","last_clean_scrub_stamp":"2023-10-25T23:44:46.025130+0000","objects_scrubbed":16,"log_size":482,"log_dups_size":0,"ondisk_log_size":482,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:34:52.570294+0000","scrub_duration":0.049678989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":460,"num_write_kb":103224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":431890,"num_omap_keys":741,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"40'2036","reported_seq":4678,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:21.186455+0000","last_change":"2023-10-25T23:45:21.186508+0000","last_active":"2023-10-25T23:45:21.186455+0000","last_peered":"2023-10-25T23:45:21.186455+0000","last_clean":"2023-10-25T23:45:21.186455+0000","last_became_active":"2023-10-25T23:36:09.294494+0000","last_became_peered":"2023-10-25T23:36:09.294494+0000","last_unstale":"2023-10-25T23:45:21.186455+0000","last_undegraded":"2023-10-25T23:45:21.186455+0000","last_fullsized":"2023-10-25T23:45:21.186455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2036","last_scrub_stamp":"2023-10-25T23:45:21.186324+0000","last_deep_scrub":"40'2036","last_deep_scrub_stamp":"2023-10-25T23:45:21.186324+0000","last_clean_scrub_stamp":"2023-10-25T23:45:21.186324+0000","objects_scrubbed":0,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T01:39:41.386011+0000","scrub_duration":0.0034902169999999999,"objects_trimmed":0,"snaptrim_duration":0.043914717999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":9037,"num_write":1232,"num_write_kb":21545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"40'2057","reported_seq":4712,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:16.095080+0000","last_change":"2023-10-25T23:45:16.095132+0000","last_active":"2023-10-25T23:45:16.095080+0000","last_peered":"2023-10-25T23:45:16.095080+0000","last_clean":"2023-10-25T23:45:16.095080+0000","last_became_active":"2023-10-25T23:36:09.291665+0000","last_became_peered":"2023-10-25T23:36:09.291665+0000","last_unstale":"2023-10-25T23:45:16.095080+0000","last_undegraded":"2023-10-25T23:45:16.095080+0000","last_fullsized":"2023-10-25T23:45:16.095080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2057","last_scrub_stamp":"2023-10-25T23:45:16.094982+0000","last_deep_scrub":"40'2057","last_deep_scrub_stamp":"2023-10-25T23:45:16.094982+0000","last_clean_scrub_stamp":"2023-10-25T23:45:16.094982+0000","objects_scrubbed":0,"log_size":2057,"log_dups_size":0,"ondisk_log_size":2057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:19:40.788548+0000","scrub_duration":0.0064347279999999998,"objects_trimmed":0,"snaptrim_duration":0.048033508000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":231,"num_read_kb":23343,"num_write":1242,"num_write_kb":29102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"40'2179","reported_seq":4794,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:44:53.099051+0000","last_change":"2023-10-25T23:44:53.099104+0000","last_active":"2023-10-25T23:44:53.099051+0000","last_peered":"2023-10-25T23:44:53.099051+0000","last_clean":"2023-10-25T23:44:53.099051+0000","last_became_active":"2023-10-25T23:36:09.295817+0000","last_became_peered":"2023-10-25T23:36:09.295817+0000","last_unstale":"2023-10-25T23:44:53.099051+0000","last_undegraded":"2023-10-25T23:44:53.099051+0000","last_fullsized":"2023-10-25T23:44:53.099051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2179","last_scrub_stamp":"2023-10-25T23:44:53.098932+0000","last_deep_scrub":"40'2179","last_deep_scrub_stamp":"2023-10-25T23:44:53.098932+0000","last_clean_scrub_stamp":"2023-10-25T23:44:53.098932+0000","objects_scrubbed":0,"log_size":2179,"log_dups_size":0,"ondisk_log_size":2179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T00:52:57.502348+0000","scrub_duration":0.006673806,"objects_trimmed":0,"snaptrim_duration":0.038422899000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":12397,"num_write":1283,"num_write_kb":33443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"40'2078","reported_seq":4704,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:15.534199+0000","last_change":"2023-10-25T23:45:15.534252+0000","last_active":"2023-10-25T23:45:15.534199+0000","last_peered":"2023-10-25T23:45:15.534199+0000","last_clean":"2023-10-25T23:45:15.534199+0000","last_became_active":"2023-10-25T23:36:09.299024+0000","last_became_peered":"2023-10-25T23:36:09.299024+0000","last_unstale":"2023-10-25T23:45:15.534199+0000","last_undegraded":"2023-10-25T23:45:15.534199+0000","last_fullsized":"2023-10-25T23:45:15.534199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2078","last_scrub_stamp":"2023-10-25T23:45:15.534080+0000","last_deep_scrub":"40'2078","last_deep_scrub_stamp":"2023-10-25T23:45:15.534080+0000","last_clean_scrub_stamp":"2023-10-25T23:45:15.534080+0000","objects_scrubbed":0,"log_size":2078,"log_dups_size":0,"ondisk_log_size":2078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:14:22.315958+0000","scrub_duration":0.0053379250000000003,"objects_trimmed":0,"snaptrim_duration":0.14682810099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":4357,"num_write":1220,"num_write_kb":7384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"40'2239","reported_seq":4824,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:19.920818+0000","last_change":"2023-10-25T23:45:19.920869+0000","last_active":"2023-10-25T23:45:19.920818+0000","last_peered":"2023-10-25T23:45:19.920818+0000","last_clean":"2023-10-25T23:45:19.920818+0000","last_became_active":"2023-10-25T23:36:09.292344+0000","last_became_peered":"2023-10-25T23:36:09.292344+0000","last_unstale":"2023-10-25T23:45:19.920818+0000","last_undegraded":"2023-10-25T23:45:19.920818+0000","last_fullsized":"2023-10-25T23:45:19.920818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2239","last_scrub_stamp":"2023-10-25T23:45:19.920695+0000","last_deep_scrub":"40'2239","last_deep_scrub_stamp":"2023-10-25T23:45:19.920695+0000","last_clean_scrub_stamp":"2023-10-25T23:45:19.920695+0000","objects_scrubbed":0,"log_size":2239,"log_dups_size":0,"ondisk_log_size":2239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T04:39:25.719358+0000","scrub_duration":0.0050382639999999998,"objects_trimmed":0,"snaptrim_duration":0.21297281000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":3547,"num_write":1298,"num_write_kb":27693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"40'2020","reported_seq":4633,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:06.023530+0000","last_change":"2023-10-25T23:45:06.023588+0000","last_active":"2023-10-25T23:45:06.023530+0000","last_peered":"2023-10-25T23:45:06.023530+0000","last_clean":"2023-10-25T23:45:06.023530+0000","last_became_active":"2023-10-25T23:36:09.297202+0000","last_became_peered":"2023-10-25T23:36:09.297202+0000","last_unstale":"2023-10-25T23:45:06.023530+0000","last_undegraded":"2023-10-25T23:45:06.023530+0000","last_fullsized":"2023-10-25T23:45:06.023530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2020","last_scrub_stamp":"2023-10-25T23:45:06.023406+0000","last_deep_scrub":"40'2020","last_deep_scrub_stamp":"2023-10-25T23:45:06.023406+0000","last_clean_scrub_stamp":"2023-10-25T23:45:06.023406+0000","objects_scrubbed":0,"log_size":2020,"log_dups_size":0,"ondisk_log_size":2020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:56:25.217776+0000","scrub_duration":0.0053996699999999996,"objects_trimmed":0,"snaptrim_duration":0.040736076000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":7838,"num_write":1164,"num_write_kb":15586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"40'2026","reported_seq":4745,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:13.425105+0000","last_change":"2023-10-25T23:45:13.425180+0000","last_active":"2023-10-25T23:45:13.425105+0000","last_peered":"2023-10-25T23:45:13.425105+0000","last_clean":"2023-10-25T23:45:13.425105+0000","last_became_active":"2023-10-25T23:36:09.293157+0000","last_became_peered":"2023-10-25T23:36:09.293157+0000","last_unstale":"2023-10-25T23:45:13.425105+0000","last_undegraded":"2023-10-25T23:45:13.425105+0000","last_fullsized":"2023-10-25T23:45:13.425105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2026","last_scrub_stamp":"2023-10-25T23:45:13.424958+0000","last_deep_scrub":"40'2026","last_deep_scrub_stamp":"2023-10-25T23:45:13.424958+0000","last_clean_scrub_stamp":"2023-10-25T23:45:13.424958+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T02:16:28.966663+0000","scrub_duration":0.003821227,"objects_trimmed":0,"snaptrim_duration":0.052457090999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":301,"num_read_kb":22462,"num_write":1198,"num_write_kb":27011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"40'2171","reported_seq":4784,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:24.229389+0000","last_change":"2023-10-25T23:45:24.229437+0000","last_active":"2023-10-25T23:45:24.229389+0000","last_peered":"2023-10-25T23:45:24.229389+0000","last_clean":"2023-10-25T23:45:24.229389+0000","last_became_active":"2023-10-25T23:36:09.288127+0000","last_became_peered":"2023-10-25T23:36:09.288127+0000","last_unstale":"2023-10-25T23:45:24.229389+0000","last_undegraded":"2023-10-25T23:45:24.229389+0000","last_fullsized":"2023-10-25T23:45:24.229389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2171","last_scrub_stamp":"2023-10-25T23:45:24.229294+0000","last_deep_scrub":"40'2171","last_deep_scrub_stamp":"2023-10-25T23:45:24.229294+0000","last_clean_scrub_stamp":"2023-10-25T23:45:24.229294+0000","objects_scrubbed":0,"log_size":2171,"log_dups_size":0,"ondisk_log_size":2171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T06:19:50.026086+0000","scrub_duration":0.0047486469999999999,"objects_trimmed":0,"snaptrim_duration":0.055712415000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":4655,"num_write":1304,"num_write_kb":14899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"40'1998","reported_seq":4637,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:32.899692+0000","last_change":"2023-10-25T23:45:32.899750+0000","last_active":"2023-10-25T23:45:32.899692+0000","last_peered":"2023-10-25T23:45:32.899692+0000","last_clean":"2023-10-25T23:45:32.899692+0000","last_became_active":"2023-10-25T23:36:09.290160+0000","last_became_peered":"2023-10-25T23:36:09.290160+0000","last_unstale":"2023-10-25T23:45:32.899692+0000","last_undegraded":"2023-10-25T23:45:32.899692+0000","last_fullsized":"2023-10-25T23:45:32.899692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1998","last_scrub_stamp":"2023-10-25T23:45:32.899591+0000","last_deep_scrub":"40'1998","last_deep_scrub_stamp":"2023-10-25T23:45:32.899591+0000","last_clean_scrub_stamp":"2023-10-25T23:45:32.899591+0000","objects_scrubbed":0,"log_size":1998,"log_dups_size":0,"ondisk_log_size":1998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T03:25:14.855155+0000","scrub_duration":0.003843562,"objects_trimmed":0,"snaptrim_duration":0.038380149000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":16054,"num_write":1171,"num_write_kb":30881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"40'2015","reported_seq":4656,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:01.359181+0000","last_change":"2023-10-25T23:45:01.359231+0000","last_active":"2023-10-25T23:45:01.359181+0000","last_peered":"2023-10-25T23:45:01.359181+0000","last_clean":"2023-10-25T23:45:01.359181+0000","last_became_active":"2023-10-25T23:36:09.298637+0000","last_became_peered":"2023-10-25T23:36:09.298637+0000","last_unstale":"2023-10-25T23:45:01.359181+0000","last_undegraded":"2023-10-25T23:45:01.359181+0000","last_fullsized":"2023-10-25T23:45:01.359181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2015","last_scrub_stamp":"2023-10-25T23:45:01.359064+0000","last_deep_scrub":"40'2015","last_deep_scrub_stamp":"2023-10-25T23:45:01.359064+0000","last_clean_scrub_stamp":"2023-10-25T23:45:01.359064+0000","objects_scrubbed":0,"log_size":2015,"log_dups_size":0,"ondisk_log_size":2015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:40:54.188454+0000","scrub_duration":0.0052526810000000004,"objects_trimmed":0,"snaptrim_duration":0.16094475499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":3413,"num_write":1198,"num_write_kb":11362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"40'1990","reported_seq":4635,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:21.979296+0000","last_change":"2023-10-25T23:45:21.979400+0000","last_active":"2023-10-25T23:45:21.979296+0000","last_peered":"2023-10-25T23:45:21.979296+0000","last_clean":"2023-10-25T23:45:21.979296+0000","last_became_active":"2023-10-25T23:36:09.290546+0000","last_became_peered":"2023-10-25T23:36:09.290546+0000","last_unstale":"2023-10-25T23:45:21.979296+0000","last_undegraded":"2023-10-25T23:45:21.979296+0000","last_fullsized":"2023-10-25T23:45:21.979296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'1990","last_scrub_stamp":"2023-10-25T23:45:21.979175+0000","last_deep_scrub":"40'1990","last_deep_scrub_stamp":"2023-10-25T23:45:21.979175+0000","last_clean_scrub_stamp":"2023-10-25T23:45:21.979175+0000","objects_scrubbed":0,"log_size":1990,"log_dups_size":0,"ondisk_log_size":1990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T05:14:28.761053+0000","scrub_duration":0.0060692280000000003,"objects_trimmed":0,"snaptrim_duration":0.041791974000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":7180,"num_write":1206,"num_write_kb":23829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"40'2170","reported_seq":4763,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:18.521742+0000","last_change":"2023-10-25T23:45:18.521846+0000","last_active":"2023-10-25T23:45:18.521742+0000","last_peered":"2023-10-25T23:45:18.521742+0000","last_clean":"2023-10-25T23:45:18.521742+0000","last_became_active":"2023-10-25T23:36:50.102780+0000","last_became_peered":"2023-10-25T23:36:50.102780+0000","last_unstale":"2023-10-25T23:45:18.521742+0000","last_undegraded":"2023-10-25T23:45:18.521742+0000","last_fullsized":"2023-10-25T23:45:18.521742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2170","last_scrub_stamp":"2023-10-25T23:45:18.521605+0000","last_deep_scrub":"40'2170","last_deep_scrub_stamp":"2023-10-25T23:45:18.521605+0000","last_clean_scrub_stamp":"2023-10-25T23:45:18.521605+0000","objects_scrubbed":0,"log_size":2170,"log_dups_size":0,"ondisk_log_size":2170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T09:56:59.030764+0000","scrub_duration":0.0058813160000000001,"objects_trimmed":0,"snaptrim_duration":0.058087943000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":4977,"num_write":1244,"num_write_kb":20718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"40'2082","reported_seq":4710,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:21.922348+0000","last_change":"2023-10-25T23:45:21.922439+0000","last_active":"2023-10-25T23:45:21.922348+0000","last_peered":"2023-10-25T23:45:21.922348+0000","last_clean":"2023-10-25T23:45:21.922348+0000","last_became_active":"2023-10-25T23:36:09.285610+0000","last_became_peered":"2023-10-25T23:36:09.285610+0000","last_unstale":"2023-10-25T23:45:21.922348+0000","last_undegraded":"2023-10-25T23:45:21.922348+0000","last_fullsized":"2023-10-25T23:45:21.922348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2082","last_scrub_stamp":"2023-10-25T23:45:21.922226+0000","last_deep_scrub":"40'2082","last_deep_scrub_stamp":"2023-10-25T23:45:21.922226+0000","last_clean_scrub_stamp":"2023-10-25T23:45:21.922226+0000","objects_scrubbed":0,"log_size":2082,"log_dups_size":0,"ondisk_log_size":2082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T10:12:17.815377+0000","scrub_duration":0.0053207369999999999,"objects_trimmed":0,"snaptrim_duration":0.19375678499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":4129,"num_write":1211,"num_write_kb":11664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"40'2134","reported_seq":4766,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-25T23:45:23.194100+0000","last_change":"2023-10-25T23:45:23.194149+0000","last_active":"2023-10-25T23:45:23.194100+0000","last_peered":"2023-10-25T23:45:23.194100+0000","last_clean":"2023-10-25T23:45:23.194100+0000","last_became_active":"2023-10-25T23:36:09.291566+0000","last_became_peered":"2023-10-25T23:36:09.291566+0000","last_unstale":"2023-10-25T23:45:23.194100+0000","last_undegraded":"2023-10-25T23:45:23.194100+0000","last_fullsized":"2023-10-25T23:45:23.194100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'2134","last_scrub_stamp":"2023-10-25T23:45:23.193993+0000","last_deep_scrub":"40'2134","last_deep_scrub_stamp":"2023-10-25T23:45:23.193993+0000","last_clean_scrub_stamp":"2023-10-25T23:45:23.193993+0000","objects_scrubbed":0,"log_size":2134,"log_dups_size":0,"ondisk_log_size":2134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-27T07:52:31.773771+0000","scrub_duration":0.006258558,"objects_trimmed":0,"snaptrim_duration":0.052820837000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":9012,"num_write":1282,"num_write_kb":25857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":20,"num_objects":4,"num_object_clones":2,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":13919,"num_read_kb":527624,"num_write":78511,"num_write_kb":1459527,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":40,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133210,"ondisk_log_size":133210,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":885503921,"num_objects":563,"num_object_clones":0,"num_object_copies":1126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":563,"num_whiteouts":0,"num_read":739,"num_read_kb":4869,"num_write":13298,"num_write_kb":3083597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":344,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34320062,"num_omap_keys":57187,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1771069440,"data_stored":1771007842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14265,"ondisk_log_size":14265,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574971,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":431200,"kb_used_data":295960,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":93940640,"statfs":{"total":96636764160,"available":96195215360,"internally_reserved":0,"allocated":303063040,"data_stored":302784975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":138475979},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.76300000000000001,"15min":0.59899999999999998},"min":{"1min":0.42299999999999999,"5min":0.25900000000000001,"15min":0.20399999999999999},"max":{"1min":1.117,"5min":34.116999999999997,"15min":34.116999999999997},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.47199999999999998,"15min":0.50600000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.222},"max":{"1min":0.71899999999999997,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.67200000000000004}]},{"osd":1,"last update":"Wed Oct 25 23:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.77400000000000002,"15min":0.61099999999999999},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65400000000000003,"5min":34.424999999999997,"15min":34.424999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.79100000000000004,"15min":0.621},"min":{"1min":0.36399999999999999,"5min":0.29599999999999999,"15min":0.28100000000000003},"max":{"1min":0.69799999999999995,"5min":32.781999999999996,"15min":32.781999999999996},"last":0.71099999999999997}]},{"osd":2,"last update":"Wed Oct 25 23:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.52200000000000002,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.28899999999999998,"15min":0.25600000000000001},"max":{"1min":1.4510000000000001,"5min":1.964,"15min":1.964},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.80400000000000005,"15min":0.63700000000000001},"min":{"1min":0.39000000000000001,"5min":0.30199999999999999,"15min":0.28999999999999998},"max":{"1min":0.68799999999999994,"5min":34.066000000000003,"15min":34.066000000000003},"last":0.54000000000000004}]},{"osd":3,"last update":"Wed Oct 25 23:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.97999999999999998,"15min":0.68700000000000006},"min":{"1min":0.39000000000000001,"5min":0.313,"15min":0.28599999999999998},"max":{"1min":1.4179999999999999,"5min":50.606999999999999,"15min":50.606999999999999},"last":0.628},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.91800000000000004,"15min":0.68899999999999995},"min":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.30199999999999999},"max":{"1min":0.77600000000000002,"5min":41.027999999999999,"15min":41.027999999999999},"last":0.74299999999999999}]},{"osd":4,"last update":"Wed Oct 25 23:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.72799999999999998,"15min":0.55400000000000005},"min":{"1min":0.34300000000000003,"5min":0.246,"15min":0.23899999999999999},"max":{"1min":0.65800000000000003,"5min":28,"15min":28},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.76000000000000001,"15min":0.59499999999999997},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67100000000000004,"5min":28.25,"15min":28.25},"last":0.51800000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.84799999999999998,"15min":0.63200000000000001},"min":{"1min":0.371,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.74099999999999999,"5min":34.393000000000001,"15min":34.393000000000001},"last":0.5},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.64000000000000001,"15min":0.58199999999999996},"min":{"1min":0.374,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.752,"5min":10.099,"15min":10.099},"last":0.64800000000000002}]},{"osd":6,"last update":"Wed Oct 25 23:45:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.73399999999999999,"15min":0.621},"min":{"1min":0.41799999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.75900000000000001,"5min":18.271999999999998,"15min":18.271999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.99099999999999999,"15min":0.71299999999999997},"min":{"1min":0.34399999999999997,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82499999999999996,"5min":47.531999999999996,"15min":47.531999999999996},"last":0.58299999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574969,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":358336,"kb_used_data":246712,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94013504,"statfs":{"total":96636764160,"available":96269828096,"internally_reserved":0,"allocated":252633088,"data_stored":252362455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":114293191},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.47999999999999998,"15min":0.51300000000000001},"min":{"1min":0.34000000000000002,"5min":0.26400000000000001,"15min":0.248},"max":{"1min":1.492,"5min":3.3140000000000001,"15min":3.3140000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.57899999999999996,"15min":0.55000000000000004},"min":{"1min":0.24399999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":2.9590000000000001,"5min":11.619,"15min":11.619},"last":0.46600000000000003}]},{"osd":1,"last update":"Wed Oct 25 23:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.30199999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.3200000000000001,"5min":3.468,"15min":3.468},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.53500000000000003,"15min":0.56000000000000005},"min":{"1min":0.29299999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.964,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.58399999999999996}]},{"osd":2,"last update":"Wed Oct 25 23:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.71099999999999997,"15min":0.59599999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":4.4509999999999996,"5min":11.683999999999999,"15min":11.683999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.629,"15min":0.56399999999999995},"min":{"1min":0.33200000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.754,"5min":11.784000000000001,"15min":11.784000000000001},"last":0.59799999999999998}]},{"osd":3,"last update":"Wed Oct 25 23:45:14 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1870000000000001,"15min":0.80700000000000005},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":8.891,"5min":61.121000000000002,"15min":61.121000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.60199999999999998,"15min":0.58799999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.8580000000000001,"5min":2.8580000000000001,"15min":2.8580000000000001},"last":0.57099999999999995}]},{"osd":4,"last update":"Wed Oct 25 23:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.59099999999999997,"15min":0.53700000000000003},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.61599999999999999,"5min":12.169,"15min":12.169},"last":0.373},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.65200000000000002,"15min":0.57999999999999996},"min":{"1min":0.245,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.7730000000000001,"5min":11.554,"15min":11.554},"last":0.42399999999999999}]},{"osd":5,"last update":"Wed Oct 25 23:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.62,"15min":0.55300000000000005},"min":{"1min":0.27500000000000002,"5min":0.26100000000000001,"15min":0.245},"max":{"1min":0.63500000000000001,"5min":11.755000000000001,"15min":11.755000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.8119999999999998,"5min":3.2879999999999998,"15min":3.2879999999999998},"last":0.443}]},{"osd":7,"last update":"Wed Oct 25 23:45:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.99099999999999999,"15min":0.72099999999999997},"min":{"1min":0.34499999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.3839999999999999,"5min":29.977,"15min":29.977},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.97399999999999998,"15min":0.71099999999999997},"min":{"1min":0.36699999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69099999999999995,"5min":29.925000000000001,"15min":29.925000000000001},"last":0.39600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574971,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361884,"kb_used_data":254420,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94009956,"statfs":{"total":96636764160,"available":96266194944,"internally_reserved":0,"allocated":260526080,"data_stored":260256021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.377,"15min":0.36899999999999999},"min":{"1min":0.17599999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.624,"5min":4.2839999999999998,"15min":6.9370000000000003},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":1.0209999999999999,"15min":0.57099999999999995},"min":{"1min":0.28399999999999997,"5min":0.20999999999999999,"15min":0.19900000000000001},"max":{"1min":4.0140000000000002,"5min":66.522000000000006,"15min":66.522000000000006},"last":0.376}]},{"osd":2,"last update":"Wed Oct 25 23:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.34999999999999998},"min":{"1min":0.222,"5min":0.20999999999999999,"15min":0.20399999999999999},"max":{"1min":0.51500000000000001,"5min":4.9180000000000001,"15min":4.9180000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":1.137,"5min":0.56799999999999995,"15min":0.441},"min":{"1min":0.25900000000000001,"5min":0.186,"15min":0.186},"max":{"1min":9.3620000000000001,"5min":9.3620000000000001,"15min":9.3620000000000001},"last":0.54300000000000004}]},{"osd":3,"last update":"Wed Oct 25 23:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.71499999999999997,"15min":0.504},"min":{"1min":0.30399999999999999,"5min":0.254,"15min":0.249},"max":{"1min":9.3149999999999995,"5min":21.943000000000001,"15min":21.943000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65400000000000003,"15min":0.49399999999999999},"min":{"1min":0.28599999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":4.0839999999999996,"5min":23.300999999999998,"15min":23.300999999999998},"last":0.49199999999999999}]},{"osd":4,"last update":"Wed Oct 25 23:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.69099999999999995,"15min":0.58399999999999996},"min":{"1min":0.41099999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77900000000000003,"5min":14.066000000000001,"15min":14.066000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.63400000000000001,"15min":0.58499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.32500000000000001},"max":{"1min":0.88900000000000001,"5min":4.5620000000000003,"15min":4.5620000000000003},"last":0.64800000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.64000000000000001,"15min":0.58999999999999997},"min":{"1min":0.45400000000000001,"5min":0.376,"15min":0.33300000000000002},"max":{"1min":4.1580000000000004,"5min":4.1580000000000004,"15min":4.1580000000000004},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61399999999999999,"15min":0.60799999999999998},"min":{"1min":0.41099999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.88600000000000001,"5min":4.9960000000000004,"15min":9.7650000000000006},"last":0.63400000000000001}]},{"osd":6,"last update":"Wed Oct 25 23:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.65700000000000003,"15min":0.60999999999999999},"min":{"1min":0.45500000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.86199999999999999,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.84999999999999998,"15min":0.67300000000000004},"min":{"1min":0.47499999999999998,"5min":0.38400000000000001,"15min":0.35399999999999998},"max":{"1min":4.1879999999999997,"5min":21.876000000000001,"15min":21.876000000000001},"last":0.61499999999999999}]},{"osd":7,"last update":"Wed Oct 25 23:45:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.64200000000000002,"15min":0.60999999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.78000000000000003,"15min":0.65400000000000003},"min":{"1min":0.46300000000000002,"5min":0.371,"15min":0.36399999999999999},"max":{"1min":0.91700000000000004,"5min":18.754999999999999,"15min":18.754999999999999},"last":0.68000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574970,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":373980,"kb_used_data":230420,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":93997860,"statfs":{"total":96636764160,"available":96253808640,"internally_reserved":0,"allocated":235950080,"data_stored":235676152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":146995654},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 25 23:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.377,"15min":0.35899999999999999},"min":{"1min":0.224,"5min":0.20200000000000001,"15min":0.17899999999999999},"max":{"1min":0.502,"5min":4.649,"15min":4.649},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39900000000000002,"15min":0.36699999999999999},"min":{"1min":0.214,"5min":0.20499999999999999,"15min":0.19400000000000001},"max":{"1min":0.57299999999999995,"5min":5.1589999999999998,"15min":5.1589999999999998},"last":0.36199999999999999}]},{"osd":2,"last update":"Wed Oct 25 23:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.40999999999999998,"15min":0.38400000000000001},"min":{"1min":0.247,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.64000000000000001,"5min":5.0289999999999999,"15min":5.0289999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.43099999999999999,"15min":0.40699999999999997},"min":{"1min":0.28499999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57699999999999996,"5min":7.6870000000000003,"15min":7.6870000000000003},"last":0.51200000000000001}]},{"osd":3,"last update":"Wed Oct 25 23:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.439,"15min":0.39400000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.23899999999999999},"max":{"1min":0.59299999999999997,"5min":4.7720000000000002,"15min":4.7720000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48199999999999998,"15min":0.44400000000000001},"min":{"1min":0.29399999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.61799999999999999,"5min":5.0750000000000002,"15min":5.0750000000000002},"last":0.43099999999999999}]},{"osd":4,"last update":"Wed Oct 25 23:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.35799999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.78000000000000003,"5min":5.9729999999999999,"15min":5.9729999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.61399999999999999,"15min":0.58799999999999997},"min":{"1min":0.42099999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.77300000000000002,"5min":5.0469999999999997,"15min":5.0469999999999997},"last":0.68000000000000005}]},{"osd":5,"last update":"Wed Oct 25 23:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.38,"5min":0.375,"15min":0.32300000000000001},"max":{"1min":0.83099999999999996,"5min":5.1120000000000001,"15min":8.5169999999999995},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.64600000000000002,"15min":0.60499999999999998},"min":{"1min":0.38900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.84699999999999998,"5min":6.0199999999999996,"15min":6.0199999999999996},"last":0.71699999999999997}]},{"osd":6,"last update":"Wed Oct 25 23:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.621,"15min":0.59399999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67300000000000004,"5min":4.9850000000000003,"15min":4.9850000000000003},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.64800000000000002,"15min":0.63},"min":{"1min":0.44600000000000001,"5min":0.38100000000000001,"15min":0.32200000000000001},"max":{"1min":0.79400000000000004,"5min":5.1399999999999997,"15min":5.1399999999999997},"last":0.80100000000000005}]},{"osd":7,"last update":"Wed Oct 25 23:45:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65500000000000003,"15min":0.66200000000000003},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81499999999999995,"5min":6.0720000000000001,"15min":8.4979999999999993},"last":0.63},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.64300000000000002,"15min":0.60699999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81599999999999995,"5min":4.883,"15min":4.883},"last":0.754}]}]},{"osd":2,"up_from":13,"seq":55834574972,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188108,"kb_used_data":102852,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94183732,"statfs":{"total":96636764160,"available":96444141568,"internally_reserved":0,"allocated":105320448,"data_stored":105061722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":87292358},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34000000000000002,"15min":0.76800000000000002},"min":{"1min":0.219,"5min":0.184,"15min":0.184},"max":{"1min":0.53600000000000003,"5min":2.7269999999999999,"15min":18.052},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.372,"15min":0.374},"min":{"1min":0.26100000000000001,"5min":0.215,"15min":0.20599999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.43099999999999999}]},{"osd":1,"last update":"Wed Oct 25 23:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35099999999999998,"15min":0.79000000000000004},"min":{"1min":0.247,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.51400000000000001,"5min":1.03,"15min":18.175000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.35899999999999999,"15min":0.61499999999999999},"min":{"1min":0.23799999999999999,"5min":0.23200000000000001,"15min":0.22700000000000001},"max":{"1min":1.643,"5min":1.643,"15min":10.23},"last":0.39200000000000002}]},{"osd":3,"last update":"Wed Oct 25 23:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.376,"15min":0.83099999999999996},"min":{"1min":0.32000000000000001,"5min":0.23499999999999999,"15min":0.22800000000000001},"max":{"1min":0.57699999999999996,"5min":0.97999999999999998,"15min":18.236000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.432,"15min":0.86399999999999999},"min":{"1min":0.30399999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.60699999999999998,"5min":2.1339999999999999,"15min":18.004999999999999},"last":0.40799999999999997}]},{"osd":4,"last update":"Wed Oct 25 23:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56899999999999995,"15min":0.748},"min":{"1min":0.38100000000000001,"5min":0.35999999999999999,"15min":0.32100000000000001},"max":{"1min":0.79500000000000004,"5min":1.2589999999999999,"15min":8.1839999999999993},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58899999999999997,"15min":0.58999999999999997},"min":{"1min":0.39800000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.841,"5min":1.841,"15min":2.4580000000000002},"last":0.84299999999999997}]},{"osd":5,"last update":"Wed Oct 25 23:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.57399999999999995,"15min":0.59499999999999997},"min":{"1min":0.45000000000000001,"5min":0.33700000000000002,"15min":0.31900000000000001},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":8.3520000000000003},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.58999999999999997,"15min":1.016},"min":{"1min":0.52300000000000002,"5min":0.35499999999999998,"15min":0.35399999999999998},"max":{"1min":0.78700000000000003,"5min":1.4419999999999999,"15min":18.143999999999998},"last":0.69299999999999995}]},{"osd":6,"last update":"Wed Oct 25 23:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58199999999999996,"15min":1.038},"min":{"1min":0.41499999999999998,"5min":0.34300000000000003,"15min":0.316},"max":{"1min":0.83099999999999996,"5min":1.012,"15min":18.206},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60199999999999998,"15min":0.754},"min":{"1min":0.46400000000000002,"5min":0.40600000000000003,"15min":0.35399999999999998},"max":{"1min":0.76400000000000001,"5min":1.3240000000000001,"15min":7.0060000000000002},"last":0.78000000000000003}]},{"osd":7,"last update":"Wed Oct 25 23:45:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.48999999999999999,"5min":0.378,"15min":0.34499999999999997},"max":{"1min":1.788,"5min":1.788,"15min":2.3900000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.70899999999999996,"15min":1.085},"min":{"1min":0.53500000000000003,"5min":0.41799999999999998,"15min":0.39500000000000002},"max":{"1min":0.85799999999999998,"5min":7.9850000000000003,"15min":18.109999999999999},"last":0.80100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574971,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314424,"kb_used_data":184752,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94057416,"statfs":{"total":96636764160,"available":96314793984,"internally_reserved":0,"allocated":189186048,"data_stored":188902628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":132774344},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.46400000000000002,"15min":0.40100000000000002},"min":{"1min":0.26900000000000002,"5min":0.17899999999999999,"15min":0.17799999999999999},"max":{"1min":7.3559999999999999,"5min":7.3559999999999999,"15min":7.3559999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.92700000000000005,"15min":0.55500000000000005},"min":{"1min":0.29899999999999999,"5min":0.218,"15min":0.19400000000000001},"max":{"1min":2.0209999999999999,"5min":55.152999999999999,"15min":55.152999999999999},"last":0.48999999999999999}]},{"osd":1,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.37,"15min":0.36799999999999999},"min":{"1min":0.27500000000000002,"5min":0.214,"15min":0.20100000000000001},"max":{"1min":0.57699999999999996,"5min":1.752,"15min":2.323},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.57699999999999996,"15min":0.46800000000000003},"min":{"1min":0.33100000000000002,"5min":0.245,"15min":0.24399999999999999},"max":{"1min":7.5309999999999997,"5min":7.5309999999999997,"15min":7.5309999999999997},"last":0.60399999999999998}]},{"osd":2,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":0.56399999999999995,"15min":0.48599999999999999},"min":{"1min":0.376,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":12.343999999999999,"5min":12.343999999999999,"15min":12.343999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.86899999999999999,"15min":0.56699999999999995},"min":{"1min":0.24399999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.3109999999999999,"5min":40.789000000000001,"15min":40.789000000000001},"last":0.54700000000000004}]},{"osd":4,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":1.155,"15min":0.78300000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.218,"5min":58.180999999999997,"15min":58.180999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.66300000000000003,"15min":0.60899999999999999},"min":{"1min":0.35299999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":7.4400000000000004,"5min":7.4400000000000004,"15min":7.4400000000000004},"last":0.64900000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":1.2150000000000001,"15min":0.80600000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.29999999999999999},"max":{"1min":1.9299999999999999,"5min":60.893999999999998,"15min":60.893999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.65000000000000002,"15min":0.61299999999999999},"min":{"1min":0.44900000000000001,"5min":0.38300000000000001,"15min":0.378},"max":{"1min":0.76700000000000002,"5min":4.2489999999999997,"15min":4.2489999999999997},"last":0.71899999999999997}]},{"osd":6,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.63300000000000001,"15min":0.60199999999999998},"min":{"1min":0.41199999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91300000000000003,"5min":2.331,"15min":2.3969999999999998},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.0720000000000001,"5min":0.76300000000000001,"15min":0.67100000000000004},"min":{"1min":0.42299999999999999,"5min":0.372,"15min":0.372},"max":{"1min":7.476,"5min":7.476,"15min":7.476},"last":0.755}]},{"osd":7,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.05,"15min":0.77800000000000002},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.38400000000000001},"max":{"1min":7.5049999999999999,"5min":33.006999999999998,"15min":33.006999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":1.1919999999999999,"15min":0.81399999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.986,"5min":56.667999999999999,"15min":56.667999999999999},"last":0.73799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574970,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326556,"kb_used_data":209364,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94045284,"statfs":{"total":96636764160,"available":96302370816,"internally_reserved":0,"allocated":214388736,"data_stored":214118638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51400000000000001,"15min":0.85799999999999998},"min":{"1min":0.27500000000000002,"5min":0.26300000000000001,"15min":0.23999999999999999},"max":{"1min":0.751,"5min":3.306,"15min":32.487000000000002},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.46000000000000002,"15min":0.51300000000000001},"min":{"1min":0.28999999999999998,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":1.115,"5min":1.115,"15min":6.0670000000000002},"last":0.623}]},{"osd":1,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.75800000000000001,"15min":0.71299999999999997},"min":{"1min":0.34899999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.96599999999999997,"5min":23.579000000000001,"15min":32.417000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.82299999999999995,"15min":0.92300000000000004},"min":{"1min":0.313,"5min":0.248,"15min":0.248},"max":{"1min":0.73799999999999999,"5min":22.800000000000001,"15min":22.800000000000001},"last":0.73999999999999999}]},{"osd":2,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.54400000000000004,"15min":0.60899999999999999},"min":{"1min":0.34300000000000003,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":4.423,"5min":4.423,"15min":14.757999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.75800000000000001,"15min":0.66000000000000003},"min":{"1min":0.36099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.319,"5min":18.042999999999999,"15min":18.042999999999999},"last":0.68899999999999995}]},{"osd":3,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60199999999999998,"15min":0.73699999999999999},"min":{"1min":0.41799999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.3340000000000001,"5min":6.1360000000000001,"15min":55.222000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.61199999999999999,"15min":0.64500000000000002},"min":{"1min":0.37,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.343,"5min":6.3220000000000001,"15min":14.869999999999999},"last":0.77100000000000002}]},{"osd":5,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.502,"15min":0.56399999999999995},"min":{"1min":0.27300000000000002,"5min":0.26600000000000001,"15min":0.23699999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":6.508},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55000000000000004,"15min":0.61399999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.24199999999999999},"max":{"1min":0.75,"5min":2.403,"15min":6.5270000000000001},"last":0.70599999999999996}]},{"osd":6,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.5,"15min":0.59899999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.74099999999999999,"5min":0.83599999999999997,"15min":14.805999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53500000000000003,"15min":0.58299999999999996},"min":{"1min":0.35399999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.752}]},{"osd":7,"last update":"Wed Oct 25 23:45:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.65600000000000003,"15min":0.627},"min":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.315},"max":{"1min":0.70899999999999996,"5min":12.135999999999999,"15min":12.135999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.81599999999999995,"15min":0.73599999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.29699999999999999},"max":{"1min":0.78200000000000003,"5min":21.465,"15min":21.465},"last":0.80800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574971,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":339560,"kb_used_data":209888,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94032280,"statfs":{"total":96636764160,"available":96289054720,"internally_reserved":0,"allocated":214925312,"data_stored":214659003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":132774342},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 25 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.93000000000000005,"15min":0.66400000000000003},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":2.278,"5min":48.045999999999999,"15min":48.045999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.53000000000000003,"15min":0.53200000000000003},"min":{"1min":0.35999999999999999,"5min":0.27700000000000002,"15min":0.26000000000000001},"max":{"1min":2.339,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.71699999999999997}]},{"osd":1,"last update":"Wed Oct 25 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.58399999999999996,"15min":0.53600000000000003},"min":{"1min":0.34799999999999998,"5min":0.30099999999999999,"15min":0.27200000000000002},"max":{"1min":4.8940000000000001,"5min":4.8940000000000001,"15min":4.8940000000000001},"last":0.624},{"interface":"front","average":{"1min":1.097,"5min":0.59999999999999998,"15min":0.58199999999999996},"min":{"1min":0.38,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":6.2069999999999999,"5min":6.2069999999999999,"15min":6.2069999999999999},"last":0.747}]},{"osd":2,"last update":"Wed Oct 25 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.623,"15min":0.56799999999999995},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":2.4140000000000001,"5min":13.271000000000001,"15min":13.271000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.60499999999999998,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.311,"15min":0.29399999999999998},"max":{"1min":4.1529999999999996,"5min":7.141,"15min":7.141},"last":0.58799999999999997}]},{"osd":3,"last update":"Wed Oct 25 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.95999999999999996,"15min":0.69499999999999995},"min":{"1min":0.35199999999999998,"5min":0.309,"15min":0.309},"max":{"1min":2.2029999999999998,"5min":47.875999999999998,"15min":47.875999999999998},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.65700000000000003,"15min":0.59499999999999997},"min":{"1min":0.36699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":3.5790000000000002,"5min":4.0919999999999996,"15min":4.0919999999999996},"last":0.56999999999999995}]},{"osd":4,"last update":"Wed Oct 25 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52600000000000002,"15min":0.5},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":2.3610000000000002,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.316,"5min":0.254,"15min":0.254},"max":{"1min":0.61899999999999999,"5min":2.657,"15min":2.657},"last":0.5}]},{"osd":6,"last update":"Wed Oct 25 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58899999999999997,"15min":0.54600000000000004},"min":{"1min":0.309,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.238,"5min":6.9050000000000002,"15min":6.9050000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60199999999999998,"15min":0.55800000000000005},"min":{"1min":0.33600000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":2.3879999999999999,"5min":5.9770000000000003,"15min":5.9770000000000003},"last":0.52300000000000002}]},{"osd":7,"last update":"Wed Oct 25 23:45:12 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.56399999999999995,"15min":0.55400000000000005},"min":{"1min":0.36899999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.74099999999999999,"5min":3.8530000000000002,"15min":3.8530000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":2.4670000000000001,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.60399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":234893312,"data_stored":234881662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":260059136,"data_stored":260051894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":104857600,"data_stored":104857600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":188706816,"data_stored":188698486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":213925888,"data_stored":213914516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":214462464,"data_stored":214454881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":252170240,"data_stored":252158333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":301993984,"data_stored":301990470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":20,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":15,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-25T23:45:49.500 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-25T23:45:49.654 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.652+0000 7f889b423700 1 -- 172.21.15.81:0/1187842006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88940bdb00 msgr2=0x7f889414e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:49.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.652+0000 7f889b423700 1 --2- 172.21.15.81:0/1187842006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88940bdb00 0x7f889414e570 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f88940bb1f0 tx=0x7f888c00b380 comp rx=0 tx=0).stop 2023-10-25T23:45:49.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.652+0000 7f889b423700 1 -- 172.21.15.81:0/1187842006 shutdown_connections 2023-10-25T23:45:49.655 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.652+0000 7f889b423700 1 --2- 172.21.15.81:0/1187842006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88940bdb00 0x7f889414e570 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.652+0000 7f889b423700 1 --2- 172.21.15.81:0/1187842006 >> v2:172.21.15.89:3300/0 conn(0x7f8894144f60 0x7f889414b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.652+0000 7f889b423700 1 --2- 172.21.15.81:0/1187842006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88940bb530 0x7f88940bd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.652+0000 7f889b423700 1 -- 172.21.15.81:0/1187842006 >> 172.21.15.81:0/1187842006 conn(0x7f889406b320 msgr2=0x7f889406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:49.656 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.652+0000 7f889b423700 1 -- 172.21.15.81:0/1187842006 shutdown_connections 2023-10-25T23:45:49.657 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.652+0000 7f889b423700 1 -- 172.21.15.81:0/1187842006 wait complete. 2023-10-25T23:45:49.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.653+0000 7f889b423700 1 Processor -- start 2023-10-25T23:45:49.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.653+0000 7f889b423700 1 -- start start 2023-10-25T23:45:49.660 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f889b423700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88940bb530 0x7f88940bf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:49.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f889b423700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88940bdb00 0x7f88941d4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:49.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f889b423700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8894144f60 0x7f88941d4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:49.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f889b423700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88941d44f0 con 0x7f88940bb530 2023-10-25T23:45:49.661 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f889b423700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889413c980 con 0x7f8894144f60 2023-10-25T23:45:49.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f889b423700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88940bfd40 con 0x7f88940bdb00 2023-10-25T23:45:49.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f88991bf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88940bb530 0x7f88940bf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:49.662 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f88991bf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88940bb530 0x7f88940bf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37432/0 (socket says 172.21.15.81:37432) 2023-10-25T23:45:49.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f88991bf700 1 -- 172.21.15.81:0/3191122267 learned_addr learned my addr 172.21.15.81:0/3191122267 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:45:49.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f88989be700 1 --2- 172.21.15.81:0/3191122267 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88940bdb00 0x7f88941d4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:49.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f88999c0700 1 --2- 172.21.15.81:0/3191122267 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8894144f60 0x7f88941d4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:49.663 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f88991bf700 1 -- 172.21.15.81:0/3191122267 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88940bdb00 msgr2=0x7f88941d4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:49.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f88991bf700 1 --2- 172.21.15.81:0/3191122267 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88940bdb00 0x7f88941d4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f88991bf700 1 -- 172.21.15.81:0/3191122267 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8894144f60 msgr2=0x7f88941d4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:49.664 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f88991bf700 1 --2- 172.21.15.81:0/3191122267 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8894144f60 0x7f88941d4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f88991bf700 1 -- 172.21.15.81:0/3191122267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c009d00 con 0x7f88940bb530 2023-10-25T23:45:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f88999c0700 1 --2- 172.21.15.81:0/3191122267 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8894144f60 0x7f88941d4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:45:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f88991bf700 1 --2- 172.21.15.81:0/3191122267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88940bb530 0x7f88940bf800 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f889000e9a0 tx=0x7f889000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f8889ffb700 1 -- 172.21.15.81:0/3191122267 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890009790 con 0x7f88940bb530 2023-10-25T23:45:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f8889ffb700 1 -- 172.21.15.81:0/3191122267 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f889000ccc0 con 0x7f88940bb530 2023-10-25T23:45:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f8889ffb700 1 -- 172.21.15.81:0/3191122267 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890010690 con 0x7f88940bb530 2023-10-25T23:45:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.654+0000 7f889b423700 1 -- 172.21.15.81:0/3191122267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88940bea70 con 0x7f88940bb530 2023-10-25T23:45:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.655+0000 7f889b423700 1 -- 172.21.15.81:0/3191122267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889413f2d0 con 0x7f88940bb530 2023-10-25T23:45:49.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.655+0000 7f889b423700 1 -- 172.21.15.81:0/3191122267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889406dcc0 con 0x7f88940bb530 2023-10-25T23:45:49.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.656+0000 7f8889ffb700 1 -- 172.21.15.81:0/3191122267 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f88900107f0 con 0x7f88940bb530 2023-10-25T23:45:49.667 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.656+0000 7f8889ffb700 1 --2- 172.21.15.81:0/3191122267 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f887806af00 0x7f887806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:49.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.656+0000 7f8889ffb700 1 -- 172.21.15.81:0/3191122267 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8890014070 con 0x7f88940bb530 2023-10-25T23:45:49.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.657+0000 7f88989be700 1 --2- 172.21.15.81:0/3191122267 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f887806af00 0x7f887806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:49.668 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.657+0000 7f88989be700 1 --2- 172.21.15.81:0/3191122267 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f887806af00 0x7f887806d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8894144f30 tx=0x7f888400b2e0 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:49.669 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.661+0000 7f8889ffb700 1 -- 172.21.15.81:0/3191122267 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8890051ca0 con 0x7f88940bb530 2023-10-25T23:45:49.849 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.847+0000 7f889b423700 1 -- 172.21.15.81:0/3191122267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f889404e4c0 con 0x7f88940bb530 2023-10-25T23:45:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.850+0000 7f8889ffb700 1 -- 172.21.15.81:0/3191122267 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v27)=0 v27) v1 ==== 123+0+0 (secure 0 0 0) 0x7f8890055000 con 0x7f88940bb530 2023-10-25T23:45:49.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.851+0000 7f8889ffb700 1 -- 172.21.15.81:0/3191122267 <== mon.0 v2:172.21.15.81:3300/0 8 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8890055000 con 0x7f88940bb530 2023-10-25T23:45:49.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.853+0000 7f889b423700 1 -- 172.21.15.81:0/3191122267 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f887806af00 msgr2=0x7f887806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:49.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.853+0000 7f889b423700 1 --2- 172.21.15.81:0/3191122267 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f887806af00 0x7f887806d3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8894144f30 tx=0x7f888400b2e0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.853+0000 7f889b423700 1 -- 172.21.15.81:0/3191122267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88940bb530 msgr2=0x7f88940bf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.853+0000 7f889b423700 1 --2- 172.21.15.81:0/3191122267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88940bb530 0x7f88940bf800 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f889000e9a0 tx=0x7f889000ecb0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.853+0000 7f889b423700 1 -- 172.21.15.81:0/3191122267 shutdown_connections 2023-10-25T23:45:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.853+0000 7f889b423700 1 --2- 172.21.15.81:0/3191122267 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f887806af00 0x7f887806d3c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.853+0000 7f889b423700 1 --2- 172.21.15.81:0/3191122267 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8894144f60 0x7f88941d4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.853+0000 7f889b423700 1 --2- 172.21.15.81:0/3191122267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88940bb530 0x7f88940bf800 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.853+0000 7f889b423700 1 --2- 172.21.15.81:0/3191122267 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88940bdb00 0x7f88941d4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.853+0000 7f889b423700 1 -- 172.21.15.81:0/3191122267 >> 172.21.15.81:0/3191122267 conn(0x7f889406b320 msgr2=0x7f88941443d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:49.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.853+0000 7f889b423700 1 -- 172.21.15.81:0/3191122267 shutdown_connections 2023-10-25T23:45:49.858 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.853+0000 7f889b423700 1 -- 172.21.15.81:0/3191122267 wait complete. 2023-10-25T23:45:49.867 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-25T23:45:49.868 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T23:45:49.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.987+0000 7f8418cd3700 1 -- 172.21.15.81:0/2146579639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140a5580 msgr2=0x7f841414b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:49.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.987+0000 7f8418cd3700 1 --2- 172.21.15.81:0/2146579639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140a5580 0x7f841414b4c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f84140a6220 tx=0x7f8404009c70 comp rx=0 tx=0).stop 2023-10-25T23:45:49.990 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.987+0000 7f8418cd3700 1 -- 172.21.15.81:0/2146579639 shutdown_connections 2023-10-25T23:45:49.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.987+0000 7f8418cd3700 1 --2- 172.21.15.81:0/2146579639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84140a5ad0 0x7f8414148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.987+0000 7f8418cd3700 1 --2- 172.21.15.81:0/2146579639 >> v2:172.21.15.89:3300/0 conn(0x7f84140bc550 0x7f841406b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.991 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.987+0000 7f8418cd3700 1 --2- 172.21.15.81:0/2146579639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140a5580 0x7f841414b4c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.987+0000 7f8418cd3700 1 -- 172.21.15.81:0/2146579639 >> 172.21.15.81:0/2146579639 conn(0x7f841406d8b0 msgr2=0x7f841406dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:49.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.987+0000 7f8418cd3700 1 -- 172.21.15.81:0/2146579639 shutdown_connections 2023-10-25T23:45:49.992 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.987+0000 7f8418cd3700 1 -- 172.21.15.81:0/2146579639 wait complete. 2023-10-25T23:45:49.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.989+0000 7f8418cd3700 1 Processor -- start 2023-10-25T23:45:49.995 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.989+0000 7f8418cd3700 1 -- start start 2023-10-25T23:45:49.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.989+0000 7f8418cd3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84140a5ad0 0x7f841414b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:49.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.989+0000 7f8418cd3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140bc550 0x7f8414146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:49.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.989+0000 7f8418cd3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84140bead0 0x7f84141e8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:49.996 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.989+0000 7f8418cd3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84141e8050 con 0x7f84140bc550 2023-10-25T23:45:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.989+0000 7f8418cd3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841414b7b0 con 0x7f84140bead0 2023-10-25T23:45:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.989+0000 7f8418cd3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8414146a40 con 0x7f84140a5ad0 2023-10-25T23:45:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.989+0000 7f8411d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140bc550 0x7f8414146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:49.997 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.989+0000 7f8411d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140bc550 0x7f8414146500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37448/0 (socket says 172.21.15.81:37448) 2023-10-25T23:45:49.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.989+0000 7f8411d9b700 1 -- 172.21.15.81:0/928216676 learned_addr learned my addr 172.21.15.81:0/928216676 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:45:49.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.990+0000 7f841259c700 1 --2- 172.21.15.81:0/928216676 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84140a5ad0 0x7f841414b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:49.998 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.990+0000 7f8412d9d700 1 --2- 172.21.15.81:0/928216676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84140bead0 0x7f84141e8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.990+0000 7f8411d9b700 1 -- 172.21.15.81:0/928216676 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84140a5ad0 msgr2=0x7f841414b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.990+0000 7f8411d9b700 1 --2- 172.21.15.81:0/928216676 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84140a5ad0 0x7f841414b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.990+0000 7f8411d9b700 1 -- 172.21.15.81:0/928216676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84140bead0 msgr2=0x7f84141e8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:49.999 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.990+0000 7f8411d9b700 1 --2- 172.21.15.81:0/928216676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84140bead0 0x7f84141e8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.990+0000 7f8411d9b700 1 -- 172.21.15.81:0/928216676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84040095f0 con 0x7f84140bc550 2023-10-25T23:45:50.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.990+0000 7f841259c700 1 --2- 172.21.15.81:0/928216676 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84140a5ad0 0x7f841414b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:45:50.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.990+0000 7f8411d9b700 1 --2- 172.21.15.81:0/928216676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140bc550 0x7f8414146500 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8414070330 tx=0x7f8404005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:50.000 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.990+0000 7f8402ffd700 1 -- 172.21.15.81:0/928216676 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840401d070 con 0x7f84140bc550 2023-10-25T23:45:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.990+0000 7f8402ffd700 1 -- 172.21.15.81:0/928216676 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8404003890 con 0x7f84140bc550 2023-10-25T23:45:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.990+0000 7f8418cd3700 1 -- 172.21.15.81:0/928216676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84140a39d0 con 0x7f84140bc550 2023-10-25T23:45:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.990+0000 7f8402ffd700 1 -- 172.21.15.81:0/928216676 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8404003c80 con 0x7f84140bc550 2023-10-25T23:45:50.001 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.990+0000 7f8418cd3700 1 -- 172.21.15.81:0/928216676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84140a3410 con 0x7f84140bc550 2023-10-25T23:45:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.991+0000 7f8418cd3700 1 -- 172.21.15.81:0/928216676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8414067490 con 0x7f84140bc550 2023-10-25T23:45:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.991+0000 7f8402ffd700 1 -- 172.21.15.81:0/928216676 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8404022470 con 0x7f84140bc550 2023-10-25T23:45:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.992+0000 7f8402ffd700 1 --2- 172.21.15.81:0/928216676 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f83f406aed0 0x7f83f406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:50.002 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.992+0000 7f8402ffd700 1 -- 172.21.15.81:0/928216676 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f840408aee0 con 0x7f84140bc550 2023-10-25T23:45:50.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.992+0000 7f841259c700 1 --2- 172.21.15.81:0/928216676 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f83f406aed0 0x7f83f406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:50.003 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.992+0000 7f841259c700 1 --2- 172.21.15.81:0/928216676 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f83f406aed0 0x7f83f406d390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8408005fd0 tx=0x7f8408005e40 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:50.004 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:49.996+0000 7f8402ffd700 1 -- 172.21.15.81:0/928216676 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8404055f90 con 0x7f84140bc550 2023-10-25T23:45:50.228 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.227+0000 7f8418cd3700 1 -- 172.21.15.81:0/928216676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84141e8190 con 0x7f84140bc550 2023-10-25T23:45:50.229 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.227+0000 7f8402ffd700 1 -- 172.21.15.81:0/928216676 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f84141e8190 con 0x7f84140bc550 2023-10-25T23:45:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:45:50.230 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2649006434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2649006434},{"type":"v1","addr":"172.21.15.89:6836","nonce":2649006434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1805624382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1805624382},{"type":"v1","addr":"172.21.15.89:6837","nonce":1805624382}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/1925858148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1925858148},{"type":"v1","addr":"172.21.15.81:6834","nonce":1925858148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T23:36:08.648444+0000","modified":"2023-10-25T23:36:11.695560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4350":{"gid":4350,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1640191478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1640191478},{"type":"v1","addr":"172.21.15.81:6835","nonce":1640191478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-25T23:45:50.231 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.229+0000 7f8418cd3700 1 -- 172.21.15.81:0/928216676 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f83f406aed0 msgr2=0x7f83f406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:50.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.229+0000 7f8418cd3700 1 --2- 172.21.15.81:0/928216676 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f83f406aed0 0x7f83f406d390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8408005fd0 tx=0x7f8408005e40 comp rx=0 tx=0).stop 2023-10-25T23:45:50.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.229+0000 7f8418cd3700 1 -- 172.21.15.81:0/928216676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140bc550 msgr2=0x7f8414146500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:50.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.229+0000 7f8418cd3700 1 --2- 172.21.15.81:0/928216676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140bc550 0x7f8414146500 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8414070330 tx=0x7f8404005b00 comp rx=0 tx=0).stop 2023-10-25T23:45:50.232 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.229+0000 7f8418cd3700 1 -- 172.21.15.81:0/928216676 shutdown_connections 2023-10-25T23:45:50.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.229+0000 7f8418cd3700 1 --2- 172.21.15.81:0/928216676 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f83f406aed0 0x7f83f406d390 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.229+0000 7f8418cd3700 1 --2- 172.21.15.81:0/928216676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f84140bead0 0x7f84141e8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.229+0000 7f8418cd3700 1 --2- 172.21.15.81:0/928216676 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f84140a5ad0 0x7f841414b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.233 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.229+0000 7f8418cd3700 1 --2- 172.21.15.81:0/928216676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84140bc550 0x7f8414146500 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.229+0000 7f8418cd3700 1 -- 172.21.15.81:0/928216676 >> 172.21.15.81:0/928216676 conn(0x7f841406d8b0 msgr2=0x7f84141da8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:50.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.229+0000 7f8418cd3700 1 -- 172.21.15.81:0/928216676 shutdown_connections 2023-10-25T23:45:50.234 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.230+0000 7f8418cd3700 1 -- 172.21.15.81:0/928216676 wait complete. 2023-10-25T23:45:50.235 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2023-10-25T23:45:50.243 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-25T23:45:50.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.364+0000 7f9796f26700 1 -- 172.21.15.81:0/1741853412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f979006cd80 msgr2=0x7f979014b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:50.367 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.364+0000 7f9796f26700 1 --2- 172.21.15.81:0/1741853412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f979006cd80 0x7f979014b760 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f97900b7b80 tx=0x7f978800b380 comp rx=0 tx=0).stop 2023-10-25T23:45:50.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.364+0000 7f9796f26700 1 -- 172.21.15.81:0/1741853412 shutdown_connections 2023-10-25T23:45:50.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.364+0000 7f9796f26700 1 --2- 172.21.15.81:0/1741853412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f979006cd80 0x7f979014b760 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.364+0000 7f9796f26700 1 --2- 172.21.15.81:0/1741853412 >> v2:172.21.15.89:3300/0 conn(0x7f979014f330 0x7f979014b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.368 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.364+0000 7f9796f26700 1 -- 172.21.15.81:0/1741853412 >> 172.21.15.81:0/1741853412 conn(0x7f97900c0a40 msgr2=0x7f97900c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.364+0000 7f9796f26700 1 -- 172.21.15.81:0/1741853412 shutdown_connections 2023-10-25T23:45:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.364+0000 7f9796f26700 1 -- 172.21.15.81:0/1741853412 wait complete. 2023-10-25T23:45:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.365+0000 7f9796f26700 1 Processor -- start 2023-10-25T23:45:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.365+0000 7f9796f26700 1 -- start start 2023-10-25T23:45:50.372 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f9796f26700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f979006cd80 0x7f979014ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:50.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f9796f26700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97901454f0 0x7f9790132da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:50.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f9796f26700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f979014f330 0x7f9790147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:50.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f9796f26700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97901484a0 con 0x7f979006cd80 2023-10-25T23:45:50.373 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f9796f26700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979012d1f0 con 0x7f979014f330 2023-10-25T23:45:50.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f9796f26700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9790144b60 con 0x7f97901454f0 2023-10-25T23:45:50.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f9794cc2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f979006cd80 0x7f979014ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:50.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f9794cc2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f979006cd80 0x7f979014ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37460/0 (socket says 172.21.15.81:37460) 2023-10-25T23:45:50.374 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f9794cc2700 1 -- 172.21.15.81:0/2843186738 learned_addr learned my addr 172.21.15.81:0/2843186738 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:45:50.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f97954c3700 1 --2- 172.21.15.81:0/2843186738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f979014f330 0x7f9790147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:50.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f978ffff700 1 --2- 172.21.15.81:0/2843186738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97901454f0 0x7f9790132da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:50.375 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f9794cc2700 1 -- 172.21.15.81:0/2843186738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97901454f0 msgr2=0x7f9790132da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:50.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f9794cc2700 1 --2- 172.21.15.81:0/2843186738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97901454f0 0x7f9790132da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f9794cc2700 1 -- 172.21.15.81:0/2843186738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f979014f330 msgr2=0x7f9790147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:50.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f9794cc2700 1 --2- 172.21.15.81:0/2843186738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f979014f330 0x7f9790147f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.376 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f9794cc2700 1 -- 172.21.15.81:0/2843186738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9788009d00 con 0x7f979006cd80 2023-10-25T23:45:50.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f97954c3700 1 --2- 172.21.15.81:0/2843186738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f979014f330 0x7f9790147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-25T23:45:50.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f9794cc2700 1 --2- 172.21.15.81:0/2843186738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f979006cd80 0x7f979014ac60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f978400c4a0 tx=0x7f978400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:50.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.366+0000 7f978d7fa700 1 -- 172.21.15.81:0/2843186738 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840054e0 con 0x7f979006cd80 2023-10-25T23:45:50.377 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.367+0000 7f978d7fa700 1 -- 172.21.15.81:0/2843186738 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9784003680 con 0x7f979006cd80 2023-10-25T23:45:50.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.367+0000 7f9796f26700 1 -- 172.21.15.81:0/2843186738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979012bee0 con 0x7f979006cd80 2023-10-25T23:45:50.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.367+0000 7f978d7fa700 1 -- 172.21.15.81:0/2843186738 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784003ab0 con 0x7f979006cd80 2023-10-25T23:45:50.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.367+0000 7f9796f26700 1 -- 172.21.15.81:0/2843186738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97901e6810 con 0x7f979006cd80 2023-10-25T23:45:50.378 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.368+0000 7f9796f26700 1 -- 172.21.15.81:0/2843186738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979012c400 con 0x7f979006cd80 2023-10-25T23:45:50.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.368+0000 7f978d7fa700 1 -- 172.21.15.81:0/2843186738 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9784003c10 con 0x7f979006cd80 2023-10-25T23:45:50.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.368+0000 7f978d7fa700 1 --2- 172.21.15.81:0/2843186738 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f977406aed0 0x7f977406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:50.379 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.368+0000 7f978d7fa700 1 -- 172.21.15.81:0/2843186738 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f9784088930 con 0x7f979006cd80 2023-10-25T23:45:50.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.369+0000 7f978ffff700 1 --2- 172.21.15.81:0/2843186738 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f977406aed0 0x7f977406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:50.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.369+0000 7f978ffff700 1 --2- 172.21.15.81:0/2843186738 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f977406aed0 0x7f977406d390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9790072810 tx=0x7f977c008040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:50.380 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.373+0000 7f978d7fa700 1 -- 172.21.15.81:0/2843186738 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f97840538d0 con 0x7f979006cd80 2023-10-25T23:45:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.606+0000 7f9796f26700 1 -- 172.21.15.81:0/2843186738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f979004e4c0 con 0x7f979006cd80 2023-10-25T23:45:50.610 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.607+0000 7f978d7fa700 1 -- 172.21.15.81:0/2843186738 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f9784056ef0 con 0x7f979006cd80 2023-10-25T23:45:50.610 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:45:50.611 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4310,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2649006434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2649006434},{"type":"v1","addr":"172.21.15.89:6836","nonce":2649006434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4313,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1805624382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1805624382},{"type":"v1","addr":"172.21.15.89:6837","nonce":1805624382}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4347,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/1925858148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1925858148},{"type":"v1","addr":"172.21.15.81:6834","nonce":1925858148}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-25T23:36:08.648444+0000","modified":"2023-10-25T23:36:11.695560+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4350},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4350":{"gid":4350,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/1640191478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1640191478},{"type":"v1","addr":"172.21.15.81:6835","nonce":1640191478}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-25T23:45:50.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.609+0000 7f9796f26700 1 -- 172.21.15.81:0/2843186738 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f977406aed0 msgr2=0x7f977406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:50.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.609+0000 7f9796f26700 1 --2- 172.21.15.81:0/2843186738 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f977406aed0 0x7f977406d390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9790072810 tx=0x7f977c008040 comp rx=0 tx=0).stop 2023-10-25T23:45:50.612 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.609+0000 7f9796f26700 1 -- 172.21.15.81:0/2843186738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f979006cd80 msgr2=0x7f979014ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:50.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.609+0000 7f9796f26700 1 --2- 172.21.15.81:0/2843186738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f979006cd80 0x7f979014ac60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f978400c4a0 tx=0x7f978400c860 comp rx=0 tx=0).stop 2023-10-25T23:45:50.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.609+0000 7f9796f26700 1 -- 172.21.15.81:0/2843186738 shutdown_connections 2023-10-25T23:45:50.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.609+0000 7f9796f26700 1 --2- 172.21.15.81:0/2843186738 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f977406aed0 0x7f977406d390 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.613 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.609+0000 7f9796f26700 1 --2- 172.21.15.81:0/2843186738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f979014f330 0x7f9790147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.609+0000 7f9796f26700 1 --2- 172.21.15.81:0/2843186738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f979006cd80 0x7f979014ac60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.609+0000 7f9796f26700 1 --2- 172.21.15.81:0/2843186738 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97901454f0 0x7f9790132da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.609+0000 7f9796f26700 1 -- 172.21.15.81:0/2843186738 >> 172.21.15.81:0/2843186738 conn(0x7f97900c0a40 msgr2=0x7f97900c0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.609+0000 7f9796f26700 1 -- 172.21.15.81:0/2843186738 shutdown_connections 2023-10-25T23:45:50.615 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.610+0000 7f9796f26700 1 -- 172.21.15.81:0/2843186738 wait complete. 2023-10-25T23:45:50.615 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2023-10-25T23:45:50.624 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-25T23:45:50.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.745+0000 7fe397187700 1 -- 172.21.15.81:0/2272037579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe39006dd90 msgr2=0x7fe39006e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:50.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.745+0000 7fe397187700 1 --2- 172.21.15.81:0/2272037579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe39006dd90 0x7fe39006e170 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe3840098c0 tx=0x7fe384009bd0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.745+0000 7fe397187700 1 -- 172.21.15.81:0/2272037579 shutdown_connections 2023-10-25T23:45:50.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.745+0000 7fe397187700 1 --2- 172.21.15.81:0/2272037579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe39006dd90 0x7fe39006e170 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.745+0000 7fe397187700 1 --2- 172.21.15.81:0/2272037579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3900c1050 0x7fe3900bd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.745+0000 7fe397187700 1 -- 172.21.15.81:0/2272037579 >> 172.21.15.81:0/2272037579 conn(0x7fe3900c1b30 msgr2=0x7fe3900c1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:50.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.745+0000 7fe397187700 1 -- 172.21.15.81:0/2272037579 shutdown_connections 2023-10-25T23:45:50.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.745+0000 7fe397187700 1 -- 172.21.15.81:0/2272037579 wait complete. 2023-10-25T23:45:50.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.746+0000 7fe397187700 1 Processor -- start 2023-10-25T23:45:50.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.746+0000 7fe397187700 1 -- start start 2023-10-25T23:45:50.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.746+0000 7fe397187700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe39006dd90 0x7fe3900a6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:50.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.746+0000 7fe397187700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3900bc390 0x7fe3900a73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:50.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.746+0000 7fe397187700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3900c1050 0x7fe3900a4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:50.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.746+0000 7fe397187700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3900a7920 con 0x7fe3900c1050 2023-10-25T23:45:50.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.746+0000 7fe397187700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe390149db0 con 0x7fe3900bc390 2023-10-25T23:45:50.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.746+0000 7fe397187700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3900b8530 con 0x7fe39006dd90 2023-10-25T23:45:50.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.747+0000 7fe395724700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3900c1050 0x7fe3900a4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:50.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.747+0000 7fe395724700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3900c1050 0x7fe3900a4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37478/0 (socket says 172.21.15.81:37478) 2023-10-25T23:45:50.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.747+0000 7fe395724700 1 -- 172.21.15.81:0/2976168234 learned_addr learned my addr 172.21.15.81:0/2976168234 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:45:50.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.747+0000 7fe38ffff700 1 --2- 172.21.15.81:0/2976168234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3900bc390 0x7fe3900a73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:50.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.747+0000 7fe394f23700 1 --2- 172.21.15.81:0/2976168234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe39006dd90 0x7fe3900a6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:50.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.747+0000 7fe395724700 1 -- 172.21.15.81:0/2976168234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe39006dd90 msgr2=0x7fe3900a6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:50.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.747+0000 7fe395724700 1 --2- 172.21.15.81:0/2976168234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe39006dd90 0x7fe3900a6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.755 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.747+0000 7fe395724700 1 -- 172.21.15.81:0/2976168234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3900bc390 msgr2=0x7fe3900a73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:50.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.747+0000 7fe395724700 1 --2- 172.21.15.81:0/2976168234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3900bc390 0x7fe3900a73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.747+0000 7fe395724700 1 -- 172.21.15.81:0/2976168234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe384009520 con 0x7fe3900c1050 2023-10-25T23:45:50.756 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.747+0000 7fe395724700 1 --2- 172.21.15.81:0/2976168234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3900c1050 0x7fe3900a4f50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe388009f00 tx=0x7fe38800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:50.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.747+0000 7fe38d7fa700 1 -- 172.21.15.81:0/2976168234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe388018070 con 0x7fe3900c1050 2023-10-25T23:45:50.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.747+0000 7fe38d7fa700 1 -- 172.21.15.81:0/2976168234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe38800f040 con 0x7fe3900c1050 2023-10-25T23:45:50.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.747+0000 7fe397187700 1 -- 172.21.15.81:0/2976168234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39006e210 con 0x7fe3900c1050 2023-10-25T23:45:50.757 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.747+0000 7fe38d7fa700 1 -- 172.21.15.81:0/2976168234 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe388004e10 con 0x7fe3900c1050 2023-10-25T23:45:50.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.747+0000 7fe397187700 1 -- 172.21.15.81:0/2976168234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3900bbf10 con 0x7fe3900c1050 2023-10-25T23:45:50.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.748+0000 7fe397187700 1 -- 172.21.15.81:0/2976168234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3900a4790 con 0x7fe3900c1050 2023-10-25T23:45:50.758 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.749+0000 7fe38d7fa700 1 -- 172.21.15.81:0/2976168234 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe38800c8e0 con 0x7fe3900c1050 2023-10-25T23:45:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.749+0000 7fe38d7fa700 1 --2- 172.21.15.81:0/2976168234 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe37406af00 0x7fe37406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.749+0000 7fe38d7fa700 1 -- 172.21.15.81:0/2976168234 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fe3880894f0 con 0x7fe3900c1050 2023-10-25T23:45:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.749+0000 7fe394f23700 1 --2- 172.21.15.81:0/2976168234 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe37406af00 0x7fe37406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:50.759 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.750+0000 7fe394f23700 1 --2- 172.21.15.81:0/2976168234 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe37406af00 0x7fe37406d3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe384009230 tx=0x7fe384004750 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:50.760 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.753+0000 7fe38d7fa700 1 -- 172.21.15.81:0/2976168234 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe3900a4790 con 0x7fe3900c1050 2023-10-25T23:45:50.946 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.945+0000 7fe397187700 1 -- 172.21.15.81:0/2976168234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3900a4790 con 0x7fe3900c1050 2023-10-25T23:45:50.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.946+0000 7fe38d7fa700 1 -- 172.21.15.81:0/2976168234 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16775 (secure 0 0 0) 0x7fe3900a4790 con 0x7fe3900c1050 2023-10-25T23:45:50.948 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-10-25T23:45:50.948 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"fsid":"97dca0fd-0f5a-4ed7-82a5-7d6f675b30bf","created":"2023-10-25T23:35:42.986840+0000","modified":"2023-10-25T23:44:47.868708+0000","last_up_change":"2023-10-25T23:35:55.052199+0000","last_in_change":"2023-10-25T23:35:46.443490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-25T23:35:57.031170+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-25T23:36:06.841771+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-25T23:36:07.613269+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":689,"snap_epoch":40,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"48415836-8f22-4dcd-baa3-1d09c90c9a0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6809","nonce":1045657984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6811","nonce":1045657984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6815","nonce":1045657984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1045657984},{"type":"v1","addr":"172.21.15.81:6813","nonce":1045657984}]},"public_addr":"172.21.15.81:6809/1045657984","cluster_addr":"172.21.15.81:6811/1045657984","heartbeat_back_addr":"172.21.15.81:6815/1045657984","heartbeat_front_addr":"172.21.15.81:6813/1045657984","state":["exists","up"]},{"osd":1,"uuid":"19a4f6b5-e75c-45ae-aa08-b3467e69eed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6801","nonce":725386907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6803","nonce":725386907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6807","nonce":725386907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":725386907},{"type":"v1","addr":"172.21.15.81:6805","nonce":725386907}]},"public_addr":"172.21.15.81:6801/725386907","cluster_addr":"172.21.15.81:6803/725386907","heartbeat_back_addr":"172.21.15.81:6807/725386907","heartbeat_front_addr":"172.21.15.81:6805/725386907","state":["exists","up"]},{"osd":2,"uuid":"60645312-54f5-4a74-ae52-68d17ff2d6e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6825","nonce":1744054610}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6827","nonce":1744054610}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6831","nonce":1744054610}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1744054610},{"type":"v1","addr":"172.21.15.81:6829","nonce":1744054610}]},"public_addr":"172.21.15.81:6825/1744054610","cluster_addr":"172.21.15.81:6827/1744054610","heartbeat_back_addr":"172.21.15.81:6831/1744054610","heartbeat_front_addr":"172.21.15.81:6829/1744054610","state":["exists","up"]},{"osd":3,"uuid":"c636a4a2-c1e8-4306-a78b-fe37eebab526","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6817","nonce":1391123341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6819","nonce":1391123341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6823","nonce":1391123341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1391123341},{"type":"v1","addr":"172.21.15.81:6821","nonce":1391123341}]},"public_addr":"172.21.15.81:6817/1391123341","cluster_addr":"172.21.15.81:6819/1391123341","heartbeat_back_addr":"172.21.15.81:6823/1391123341","heartbeat_front_addr":"172.21.15.81:6821/1391123341","state":["exists","up"]},{"osd":4,"uuid":"3cafc826-e531-4aa7-8b2a-b592f318f138","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6817","nonce":1232781703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6819","nonce":1232781703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6823","nonce":1232781703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":1232781703},{"type":"v1","addr":"172.21.15.89:6821","nonce":1232781703}]},"public_addr":"172.21.15.89:6817/1232781703","cluster_addr":"172.21.15.89:6819/1232781703","heartbeat_back_addr":"172.21.15.89:6823/1232781703","heartbeat_front_addr":"172.21.15.89:6821/1232781703","state":["exists","up"]},{"osd":5,"uuid":"6098deb2-258e-47e1-b283-9a24c9dddf27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6801","nonce":2255820086}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6803","nonce":2255820086}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6807","nonce":2255820086}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":2255820086},{"type":"v1","addr":"172.21.15.89:6805","nonce":2255820086}]},"public_addr":"172.21.15.89:6801/2255820086","cluster_addr":"172.21.15.89:6803/2255820086","heartbeat_back_addr":"172.21.15.89:6807/2255820086","heartbeat_front_addr":"172.21.15.89:6805/2255820086","state":["exists","up"]},{"osd":6,"uuid":"d79f68de-3c19-4f68-bbd1-59c8484dfaa2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6809","nonce":2561967165}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6811","nonce":2561967165}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6815","nonce":2561967165}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2561967165},{"type":"v1","addr":"172.21.15.89:6813","nonce":2561967165}]},"public_addr":"172.21.15.89:6809/2561967165","cluster_addr":"172.21.15.89:6811/2561967165","heartbeat_back_addr":"172.21.15.89:6815/2561967165","heartbeat_front_addr":"172.21.15.89:6813/2561967165","state":["exists","up"]},{"osd":7,"uuid":"f1f7002e-4de9-4a08-97a1-fb52a116687f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6825","nonce":2647243500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6827","nonce":2647243500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6831","nonce":2647243500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2647243500},{"type":"v1","addr":"172.21.15.89:6829","nonce":2647243500}]},"public_addr":"172.21.15.89:6825/2647243500","cluster_addr":"172.21.15.89:6827/2647243500","heartbeat_back_addr":"172.21.15.89:6831/2647243500","heartbeat_front_addr":"172.21.15.89:6829/2647243500","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.613750+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.593515+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.713198+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.725623+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.686409+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.596728+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.670930+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-25T23:35:51.676762+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":1}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":686,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-25T23:45:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.948+0000 7fe397187700 1 -- 172.21.15.81:0/2976168234 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe37406af00 msgr2=0x7fe37406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.948+0000 7fe397187700 1 --2- 172.21.15.81:0/2976168234 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe37406af00 0x7fe37406d3c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe384009230 tx=0x7fe384004750 comp rx=0 tx=0).stop 2023-10-25T23:45:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.948+0000 7fe397187700 1 -- 172.21.15.81:0/2976168234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3900c1050 msgr2=0x7fe3900a4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:50.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.948+0000 7fe397187700 1 --2- 172.21.15.81:0/2976168234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3900c1050 0x7fe3900a4f50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe388009f00 tx=0x7fe38800c3a0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.948+0000 7fe397187700 1 -- 172.21.15.81:0/2976168234 shutdown_connections 2023-10-25T23:45:50.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.948+0000 7fe397187700 1 --2- 172.21.15.81:0/2976168234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3900c1050 0x7fe3900a4f50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.951 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.948+0000 7fe397187700 1 --2- 172.21.15.81:0/2976168234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe39006dd90 0x7fe3900a6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.948+0000 7fe397187700 1 --2- 172.21.15.81:0/2976168234 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7fe37406af00 0x7fe37406d3c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.948+0000 7fe397187700 1 --2- 172.21.15.81:0/2976168234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3900bc390 0x7fe3900a73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:50.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.948+0000 7fe397187700 1 -- 172.21.15.81:0/2976168234 >> 172.21.15.81:0/2976168234 conn(0x7fe3900c1b30 msgr2=0x7fe3900c1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:50.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.948+0000 7fe397187700 1 -- 172.21.15.81:0/2976168234 shutdown_connections 2023-10-25T23:45:50.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:50.948+0000 7fe397187700 1 -- 172.21.15.81:0/2976168234 wait complete. 2023-10-25T23:45:50.962 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-25T23:45:51.085 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.083+0000 7ff12759b700 1 -- 172.21.15.81:0/3879549597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff120154900 msgr2=0x7ff120156cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:51.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.083+0000 7ff12759b700 1 --2- 172.21.15.81:0/3879549597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff120154900 0x7ff120156cf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff118009fd0 tx=0x7ff11800b380 comp rx=0 tx=0).stop 2023-10-25T23:45:51.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.083+0000 7ff12759b700 1 -- 172.21.15.81:0/3879549597 shutdown_connections 2023-10-25T23:45:51.086 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.083+0000 7ff12759b700 1 --2- 172.21.15.81:0/3879549597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff120154900 0x7ff120156cf0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:51.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.083+0000 7ff12759b700 1 -- 172.21.15.81:0/3879549597 >> 172.21.15.81:0/3879549597 conn(0x7ff12006b320 msgr2=0x7ff12006b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:51.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.083+0000 7ff12759b700 1 -- 172.21.15.81:0/3879549597 shutdown_connections 2023-10-25T23:45:51.087 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.083+0000 7ff12759b700 1 -- 172.21.15.81:0/3879549597 wait complete. 2023-10-25T23:45:51.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.085+0000 7ff12759b700 1 Processor -- start 2023-10-25T23:45:51.090 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.085+0000 7ff12759b700 1 -- start start 2023-10-25T23:45:51.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.085+0000 7ff12759b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1200bb530 0x7ff1200b9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:51.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.085+0000 7ff12759b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff120144f60 0x7ff120148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:51.091 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.085+0000 7ff12759b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff120154900 0x7ff120148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:51.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.085+0000 7ff12759b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1201428e0 con 0x7ff1200bb530 2023-10-25T23:45:51.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.085+0000 7ff12759b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12013d010 con 0x7ff120154900 2023-10-25T23:45:51.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.085+0000 7ff12759b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1200beb60 con 0x7ff120144f60 2023-10-25T23:45:51.092 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.085+0000 7ff125337700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1200bb530 0x7ff1200b9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:51.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.085+0000 7ff125337700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1200bb530 0x7ff1200b9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37488/0 (socket says 172.21.15.81:37488) 2023-10-25T23:45:51.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.085+0000 7ff125337700 1 -- 172.21.15.81:0/4082662282 learned_addr learned my addr 172.21.15.81:0/4082662282 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:45:51.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.085+0000 7ff125b38700 1 --2- 172.21.15.81:0/4082662282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff120154900 0x7ff120148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:51.093 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.085+0000 7ff124b36700 1 --2- 172.21.15.81:0/4082662282 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff120144f60 0x7ff120148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:51.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.086+0000 7ff125337700 1 -- 172.21.15.81:0/4082662282 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff120144f60 msgr2=0x7ff120148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:51.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.086+0000 7ff125337700 1 --2- 172.21.15.81:0/4082662282 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff120144f60 0x7ff120148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:51.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.086+0000 7ff125337700 1 -- 172.21.15.81:0/4082662282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff120154900 msgr2=0x7ff120148ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:51.094 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.086+0000 7ff125337700 1 --2- 172.21.15.81:0/4082662282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff120154900 0x7ff120148ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:51.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.086+0000 7ff125337700 1 -- 172.21.15.81:0/4082662282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff118009d00 con 0x7ff1200bb530 2023-10-25T23:45:51.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.086+0000 7ff124b36700 1 --2- 172.21.15.81:0/4082662282 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff120144f60 0x7ff120148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-25T23:45:51.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.086+0000 7ff125337700 1 --2- 172.21.15.81:0/4082662282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1200bb530 0x7ff1200b9100 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff11000c510 tx=0x7ff11000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:51.095 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.086+0000 7ff115ffb700 1 -- 172.21.15.81:0/4082662282 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1100052d0 con 0x7ff1200bb530 2023-10-25T23:45:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.086+0000 7ff115ffb700 1 -- 172.21.15.81:0/4082662282 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff110005430 con 0x7ff1200bb530 2023-10-25T23:45:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.086+0000 7ff12759b700 1 -- 172.21.15.81:0/4082662282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1200b7410 con 0x7ff1200bb530 2023-10-25T23:45:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.086+0000 7ff115ffb700 1 -- 172.21.15.81:0/4082662282 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1100038e0 con 0x7ff1200bb530 2023-10-25T23:45:51.096 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.086+0000 7ff12759b700 1 -- 172.21.15.81:0/4082662282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1201e4e00 con 0x7ff1200bb530 2023-10-25T23:45:51.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.087+0000 7ff12759b700 1 -- 172.21.15.81:0/4082662282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1200be930 con 0x7ff1200bb530 2023-10-25T23:45:51.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.087+0000 7ff115ffb700 1 -- 172.21.15.81:0/4082662282 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff110003a40 con 0x7ff1200bb530 2023-10-25T23:45:51.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.088+0000 7ff115ffb700 1 --2- 172.21.15.81:0/4082662282 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff10406aed0 0x7ff10406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:51.097 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.088+0000 7ff115ffb700 1 -- 172.21.15.81:0/4082662282 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5853+0+0 (secure 0 0 0) 0x7ff110088b70 con 0x7ff1200bb530 2023-10-25T23:45:51.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.088+0000 7ff124b36700 1 --2- 172.21.15.81:0/4082662282 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff10406aed0 0x7ff10406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:51.098 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.088+0000 7ff124b36700 1 --2- 172.21.15.81:0/4082662282 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff10406aed0 0x7ff10406d390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff1200b99b0 tx=0x7ff11c009040 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.092+0000 7ff115ffb700 1 -- 172.21.15.81:0/4082662282 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff1200be930 con 0x7ff1200bb530 2023-10-25T23:45:51.327 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.326+0000 7ff12759b700 1 -- 172.21.15.81:0/4082662282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff1200be930 con 0x7ff1200bb530 2023-10-25T23:45:51.329 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.328+0000 7ff115ffb700 1 -- 172.21.15.81:0/4082662282 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff1200be930 con 0x7ff1200bb530 2023-10-25T23:45:51.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.332+0000 7ff12759b700 1 -- 172.21.15.81:0/4082662282 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff10406aed0 msgr2=0x7ff10406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:51.333 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.332+0000 7ff12759b700 1 --2- 172.21.15.81:0/4082662282 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff10406aed0 0x7ff10406d390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff1200b99b0 tx=0x7ff11c009040 comp rx=0 tx=0).stop 2023-10-25T23:45:51.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.332+0000 7ff12759b700 1 -- 172.21.15.81:0/4082662282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1200bb530 msgr2=0x7ff1200b9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:51.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.332+0000 7ff12759b700 1 --2- 172.21.15.81:0/4082662282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1200bb530 0x7ff1200b9100 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff11000c510 tx=0x7ff11000c820 comp rx=0 tx=0).stop 2023-10-25T23:45:51.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.332+0000 7ff12759b700 1 -- 172.21.15.81:0/4082662282 shutdown_connections 2023-10-25T23:45:51.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.332+0000 7ff12759b700 1 --2- 172.21.15.81:0/4082662282 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7ff10406aed0 0x7ff10406d390 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff1200b99b0 tx=0x7ff11c009040 comp rx=0 tx=0).stop 2023-10-25T23:45:51.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.332+0000 7ff12759b700 1 --2- 172.21.15.81:0/4082662282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff120154900 0x7ff120148ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:51.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.332+0000 7ff12759b700 1 --2- 172.21.15.81:0/4082662282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1200bb530 0x7ff1200b9100 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:51.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.332+0000 7ff12759b700 1 --2- 172.21.15.81:0/4082662282 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff120144f60 0x7ff120148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:51.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.332+0000 7ff12759b700 1 -- 172.21.15.81:0/4082662282 >> 172.21.15.81:0/4082662282 conn(0x7ff12006b320 msgr2=0x7ff1201442d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:51.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.333+0000 7ff12759b700 1 -- 172.21.15.81:0/4082662282 shutdown_connections 2023-10-25T23:45:51.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.333+0000 7ff12759b700 1 -- 172.21.15.81:0/4082662282 wait complete. 2023-10-25T23:45:51.337 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-25T23:45:51.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-25T23:45:51.384 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2023-10-25T23:45:51.473 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.471+0000 7f516b3b8700 1 -- 172.21.15.81:0/508783884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51640b72c0 msgr2=0x7f516414b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:51.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.471+0000 7f516b3b8700 1 --2- 172.21.15.81:0/508783884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51640b72c0 0x7f516414b890 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f51640890f0 tx=0x7f5160009c70 comp rx=0 tx=0).stop 2023-10-25T23:45:51.474 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.471+0000 7f516b3b8700 1 -- 172.21.15.81:0/508783884 shutdown_connections 2023-10-25T23:45:51.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.471+0000 7f516b3b8700 1 --2- 172.21.15.81:0/508783884 >> v2:172.21.15.89:3300/0 conn(0x7f51640c08b0 0x7f51640c2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:51.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.471+0000 7f516b3b8700 1 --2- 172.21.15.81:0/508783884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51640b72c0 0x7f516414b890 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:51.475 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.471+0000 7f516b3b8700 1 -- 172.21.15.81:0/508783884 >> 172.21.15.81:0/508783884 conn(0x7f516406ac80 msgr2=0x7f516406b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.471+0000 7f516b3b8700 1 -- 172.21.15.81:0/508783884 shutdown_connections 2023-10-25T23:45:51.476 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.471+0000 7f516b3b8700 1 -- 172.21.15.81:0/508783884 wait complete. 2023-10-25T23:45:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.472+0000 7f516b3b8700 1 Processor -- start 2023-10-25T23:45:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.473+0000 7f516b3b8700 1 -- start start 2023-10-25T23:45:51.479 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.473+0000 7f516b3b8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51640c08b0 0x7f516414bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.473+0000 7f516b3b8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51640c3110 0x7f516414d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.473+0000 7f516b3b8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f516414c440 0x7f51640bd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:51.480 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.473+0000 7f516b3b8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51641d6f50 con 0x7f51640c08b0 2023-10-25T23:45:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.473+0000 7f516b3b8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51641d4a90 con 0x7f516414c440 2023-10-25T23:45:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.473+0000 7f516b3b8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51641e56e0 con 0x7f51640c3110 2023-10-25T23:45:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.473+0000 7f5169154700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51640c08b0 0x7f516414bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:51.481 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.473+0000 7f5169154700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51640c08b0 0x7f516414bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37512/0 (socket says 172.21.15.81:37512) 2023-10-25T23:45:51.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.473+0000 7f5169154700 1 -- 172.21.15.81:0/137070618 learned_addr learned my addr 172.21.15.81:0/137070618 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:45:51.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.473+0000 7f5169955700 1 --2- 172.21.15.81:0/137070618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f516414c440 0x7f51640bd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:51.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.473+0000 7f5168953700 1 --2- 172.21.15.81:0/137070618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51640c3110 0x7f516414d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:51.482 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.474+0000 7f5169154700 1 -- 172.21.15.81:0/137070618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51640c3110 msgr2=0x7f516414d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.474+0000 7f5169154700 1 --2- 172.21.15.81:0/137070618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51640c3110 0x7f516414d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.474+0000 7f5169154700 1 -- 172.21.15.81:0/137070618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f516414c440 msgr2=0x7f51640bd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:51.483 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.474+0000 7f5169154700 1 --2- 172.21.15.81:0/137070618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f516414c440 0x7f51640bd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:51.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.474+0000 7f5169154700 1 -- 172.21.15.81:0/137070618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51600095f0 con 0x7f51640c08b0 2023-10-25T23:45:51.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.474+0000 7f5169154700 1 --2- 172.21.15.81:0/137070618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51640c08b0 0x7f516414bf00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f515400d980 tx=0x7f515400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:51.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.474+0000 7f5159ffb700 1 -- 172.21.15.81:0/137070618 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5154004a30 con 0x7f51640c08b0 2023-10-25T23:45:51.484 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.474+0000 7f5159ffb700 1 -- 172.21.15.81:0/137070618 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5154004ca0 con 0x7f51640c08b0 2023-10-25T23:45:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.474+0000 7f516b3b8700 1 -- 172.21.15.81:0/137070618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51641e4920 con 0x7f51640c08b0 2023-10-25T23:45:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.474+0000 7f5159ffb700 1 -- 172.21.15.81:0/137070618 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5154005280 con 0x7f51640c08b0 2023-10-25T23:45:51.485 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.474+0000 7f516b3b8700 1 -- 172.21.15.81:0/137070618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51641e4ee0 con 0x7f51640c08b0 2023-10-25T23:45:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.475+0000 7f516b3b8700 1 -- 172.21.15.81:0/137070618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5164066f10 con 0x7f51640c08b0 2023-10-25T23:45:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.475+0000 7f5159ffb700 1 -- 172.21.15.81:0/137070618 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f51540053e0 con 0x7f51640c08b0 2023-10-25T23:45:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.476+0000 7f5159ffb700 1 --2- 172.21.15.81:0/137070618 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f514806aed0 0x7f514806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:51.486 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.476+0000 7f5159ffb700 1 -- 172.21.15.81:0/137070618 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f5154089c50 con 0x7f51640c08b0 2023-10-25T23:45:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.476+0000 7f5168953700 1 --2- 172.21.15.81:0/137070618 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f514806aed0 0x7f514806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.476+0000 7f5168953700 1 --2- 172.21.15.81:0/137070618 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f514806aed0 0x7f514806d390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5160000c00 tx=0x7f5160004750 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:51.488 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.480+0000 7f5159ffb700 1 -- 172.21.15.81:0/137070618 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5164066f10 con 0x7f51640c08b0 2023-10-25T23:45:51.714 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:51.713+0000 7f516b3b8700 1 -- 172.21.15.81:0/137070618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5164066f10 con 0x7f51640c08b0 2023-10-25T23:45:52.331 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.329+0000 7f5159ffb700 1 -- 172.21.15.81:0/137070618 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5164066f10 con 0x7f51640c08b0 2023-10-25T23:45:52.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.332+0000 7f516b3b8700 1 -- 172.21.15.81:0/137070618 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f514806aed0 msgr2=0x7f514806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:52.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.332+0000 7f516b3b8700 1 --2- 172.21.15.81:0/137070618 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f514806aed0 0x7f514806d390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5160000c00 tx=0x7f5160004750 comp rx=0 tx=0).stop 2023-10-25T23:45:52.334 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.332+0000 7f516b3b8700 1 -- 172.21.15.81:0/137070618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51640c08b0 msgr2=0x7f516414bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.332+0000 7f516b3b8700 1 --2- 172.21.15.81:0/137070618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51640c08b0 0x7f516414bf00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f515400d980 tx=0x7f515400dc90 comp rx=0 tx=0).stop 2023-10-25T23:45:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.332+0000 7f516b3b8700 1 -- 172.21.15.81:0/137070618 shutdown_connections 2023-10-25T23:45:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.332+0000 7f516b3b8700 1 --2- 172.21.15.81:0/137070618 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f514806aed0 0x7f514806d390 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:52.335 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.332+0000 7f516b3b8700 1 --2- 172.21.15.81:0/137070618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f516414c440 0x7f51640bd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.332+0000 7f516b3b8700 1 --2- 172.21.15.81:0/137070618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51640c08b0 0x7f516414bf00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.332+0000 7f516b3b8700 1 --2- 172.21.15.81:0/137070618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51640c3110 0x7f516414d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.332+0000 7f516b3b8700 1 -- 172.21.15.81:0/137070618 >> 172.21.15.81:0/137070618 conn(0x7f516406ac80 msgr2=0x7f51640a3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.332+0000 7f516b3b8700 1 -- 172.21.15.81:0/137070618 shutdown_connections 2023-10-25T23:45:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.332+0000 7f516b3b8700 1 -- 172.21.15.81:0/137070618 wait complete. 2023-10-25T23:45:52.348 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-25T23:45:52.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.520+0000 7fb00a34d700 1 -- 172.21.15.81:0/1630894135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb004146490 msgr2=0x7fb004072030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:52.522 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.520+0000 7fb00a34d700 1 --2- 172.21.15.81:0/1630894135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb004146490 0x7fb004072030 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7faff40098c0 tx=0x7faff4009bd0 comp rx=0 tx=0).stop 2023-10-25T23:45:52.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.520+0000 7fb00a34d700 1 -- 172.21.15.81:0/1630894135 shutdown_connections 2023-10-25T23:45:52.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.520+0000 7fb00a34d700 1 --2- 172.21.15.81:0/1630894135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb004146490 0x7fb004072030 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:52.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.520+0000 7fb00a34d700 1 -- 172.21.15.81:0/1630894135 >> 172.21.15.81:0/1630894135 conn(0x7fb0040bcc50 msgr2=0x7fb0040bd060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:52.523 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.520+0000 7fb00a34d700 1 -- 172.21.15.81:0/1630894135 shutdown_connections 2023-10-25T23:45:52.524 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.520+0000 7fb00a34d700 1 -- 172.21.15.81:0/1630894135 wait complete. 2023-10-25T23:45:52.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.521+0000 7fb00a34d700 1 Processor -- start 2023-10-25T23:45:52.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.521+0000 7fb00a34d700 1 -- start start 2023-10-25T23:45:52.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb00a34d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0040705f0 0x7fb0041e67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:52.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb00a34d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb004146490 0x7fb0040a48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:52.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb00a34d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb00414c280 0x7fb004148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:52.528 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb00a34d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb004144750 con 0x7fb00414c280 2023-10-25T23:45:52.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb00a34d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb004148850 con 0x7fb004146490 2023-10-25T23:45:52.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb00a34d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0041e6360 con 0x7fb0040705f0 2023-10-25T23:45:52.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb0088ea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb00414c280 0x7fb004148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:52.529 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb0088ea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb00414c280 0x7fb004148e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37532/0 (socket says 172.21.15.81:37532) 2023-10-25T23:45:52.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb0088ea700 1 -- 172.21.15.81:0/1260701107 learned_addr learned my addr 172.21.15.81:0/1260701107 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:45:52.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb0037fe700 1 --2- 172.21.15.81:0/1260701107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb004146490 0x7fb0040a48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:52.530 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb003fff700 1 --2- 172.21.15.81:0/1260701107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0040705f0 0x7fb0041e67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:52.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb0088ea700 1 -- 172.21.15.81:0/1260701107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0040705f0 msgr2=0x7fb0041e67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:52.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb0088ea700 1 --2- 172.21.15.81:0/1260701107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0040705f0 0x7fb0041e67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:52.531 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb0088ea700 1 -- 172.21.15.81:0/1260701107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb004146490 msgr2=0x7fb0040a48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:52.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb0088ea700 1 --2- 172.21.15.81:0/1260701107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb004146490 0x7fb0040a48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:52.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb0088ea700 1 -- 172.21.15.81:0/1260701107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff4009520 con 0x7fb00414c280 2023-10-25T23:45:52.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb0088ea700 1 --2- 172.21.15.81:0/1260701107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb00414c280 0x7fb004148e60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7faffc00cb80 tx=0x7faffc00ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:52.532 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb000ff9700 1 -- 172.21.15.81:0/1260701107 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc003c00 con 0x7fb00414c280 2023-10-25T23:45:52.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb000ff9700 1 -- 172.21.15.81:0/1260701107 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7faffc003d60 con 0x7fb00414c280 2023-10-25T23:45:52.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb00a34d700 1 -- 172.21.15.81:0/1260701107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0040a2e80 con 0x7fb00414c280 2023-10-25T23:45:52.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb000ff9700 1 -- 172.21.15.81:0/1260701107 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc00aa60 con 0x7fb00414c280 2023-10-25T23:45:52.533 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.522+0000 7fb00a34d700 1 -- 172.21.15.81:0/1260701107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb004144500 con 0x7fb00414c280 2023-10-25T23:45:52.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.523+0000 7fb00a34d700 1 -- 172.21.15.81:0/1260701107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb004067490 con 0x7fb00414c280 2023-10-25T23:45:52.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.524+0000 7fb000ff9700 1 -- 172.21.15.81:0/1260701107 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faffc00abc0 con 0x7fb00414c280 2023-10-25T23:45:52.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.524+0000 7fb000ff9700 1 --2- 172.21.15.81:0/1260701107 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7faff006af00 0x7faff006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:52.534 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.524+0000 7fb000ff9700 1 -- 172.21.15.81:0/1260701107 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5911+0+0 (secure 0 0 0) 0x7faffc089680 con 0x7fb00414c280 2023-10-25T23:45:52.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.524+0000 7fb003fff700 1 --2- 172.21.15.81:0/1260701107 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7faff006af00 0x7faff006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:52.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.525+0000 7fb003fff700 1 --2- 172.21.15.81:0/1260701107 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7faff006af00 0x7faff006d3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faff4005850 tx=0x7faff4004750 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:52.535 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.528+0000 7fb000ff9700 1 -- 172.21.15.81:0/1260701107 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faffc054670 con 0x7fb00414c280 2023-10-25T23:45:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:52.718+0000 7fb00a34d700 1 -- 172.21.15.81:0/1260701107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb0041e60b0 con 0x7fb00414c280 2023-10-25T23:45:53.336 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.334+0000 7fb000ff9700 1 -- 172.21.15.81:0/1260701107 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) v1 ==== 181+0+0 (secure 0 0 0) 0x7faffc001c10 con 0x7fb00414c280 2023-10-25T23:45:53.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.338+0000 7fb00a34d700 1 -- 172.21.15.81:0/1260701107 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7faff006af00 msgr2=0x7faff006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:53.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.338+0000 7fb00a34d700 1 --2- 172.21.15.81:0/1260701107 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7faff006af00 0x7faff006d3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faff4005850 tx=0x7faff4004750 comp rx=0 tx=0).stop 2023-10-25T23:45:53.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.338+0000 7fb00a34d700 1 -- 172.21.15.81:0/1260701107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb00414c280 msgr2=0x7fb004148e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:53.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.338+0000 7fb00a34d700 1 --2- 172.21.15.81:0/1260701107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb00414c280 0x7fb004148e60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7faffc00cb80 tx=0x7faffc00ce90 comp rx=0 tx=0).stop 2023-10-25T23:45:53.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.338+0000 7fb00a34d700 1 -- 172.21.15.81:0/1260701107 shutdown_connections 2023-10-25T23:45:53.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.338+0000 7fb00a34d700 1 --2- 172.21.15.81:0/1260701107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb00414c280 0x7fb004148e60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:53.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.338+0000 7fb00a34d700 1 --2- 172.21.15.81:0/1260701107 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0040705f0 0x7fb0041e67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:53.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.338+0000 7fb00a34d700 1 --2- 172.21.15.81:0/1260701107 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7faff006af00 0x7faff006d3c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:53.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.338+0000 7fb00a34d700 1 --2- 172.21.15.81:0/1260701107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb004146490 0x7fb0040a48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:53.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.338+0000 7fb00a34d700 1 -- 172.21.15.81:0/1260701107 >> 172.21.15.81:0/1260701107 conn(0x7fb0040bcc50 msgr2=0x7fb0040bd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:53.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.339+0000 7fb00a34d700 1 -- 172.21.15.81:0/1260701107 shutdown_connections 2023-10-25T23:45:53.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.339+0000 7fb00a34d700 1 -- 172.21.15.81:0/1260701107 wait complete. 2023-10-25T23:45:53.344 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2023-10-25T23:45:53.363 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-25T23:45:53.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.496+0000 7f3f85162700 1 -- 172.21.15.81:0/645976318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f68003c30 msgr2=0x7f3f68004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:53.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.496+0000 7f3f85162700 1 --2- 172.21.15.81:0/645976318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f68003c30 0x7f3f68004030 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3f70006fd0 tx=0x7f3f68005880 comp rx=0 tx=0).stop 2023-10-25T23:45:53.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.496+0000 7f3f7f59e700 1 -- 172.21.15.81:0/645976318 reap_dead start 2023-10-25T23:45:53.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.496+0000 7f3f85162700 1 -- 172.21.15.81:0/645976318 shutdown_connections 2023-10-25T23:45:53.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.496+0000 7f3f85162700 1 -- 172.21.15.81:0/645976318 >> 172.21.15.81:0/645976318 conn(0x7f3f8006b320 msgr2=0x7f3f8006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:53.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.496+0000 7f3f85162700 1 -- 172.21.15.81:0/645976318 shutdown_connections 2023-10-25T23:45:53.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.496+0000 7f3f85162700 1 -- 172.21.15.81:0/645976318 wait complete. 2023-10-25T23:45:53.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.498+0000 7f3f85162700 1 Processor -- start 2023-10-25T23:45:53.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.498+0000 7f3f85162700 1 -- start start 2023-10-25T23:45:53.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.498+0000 7f3f85162700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f68003c30 0x7f3f8014e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:53.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.498+0000 7f3f85162700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f8014c520 0x7f3f80147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:53.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.498+0000 7f3f85162700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f800b6ef0 0x7f3f800b7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:53.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.498+0000 7f3f85162700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f80147950 con 0x7f3f68003c30 2023-10-25T23:45:53.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.498+0000 7f3f85162700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8014cae0 con 0x7f3f8014c520 2023-10-25T23:45:53.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.498+0000 7f3f85162700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8014ce30 con 0x7f3f800b6ef0 2023-10-25T23:45:53.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.499+0000 7f3f7ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f68003c30 0x7f3f8014e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.499+0000 7f3f7ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f68003c30 0x7f3f8014e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37548/0 (socket says 172.21.15.81:37548) 2023-10-25T23:45:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.499+0000 7f3f7ed9d700 1 -- 172.21.15.81:0/2822387803 learned_addr learned my addr 172.21.15.81:0/2822387803 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-10-25T23:45:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.499+0000 7f3f7e59c700 1 --2- 172.21.15.81:0/2822387803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f8014c520 0x7f3f80147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.499+0000 7f3f7f59e700 1 --2- 172.21.15.81:0/2822387803 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f800b6ef0 0x7f3f800b7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.499+0000 7f3f7ed9d700 1 -- 172.21.15.81:0/2822387803 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f800b6ef0 msgr2=0x7f3f800b7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.499+0000 7f3f7ed9d700 1 --2- 172.21.15.81:0/2822387803 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f800b6ef0 0x7f3f800b7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.499+0000 7f3f7ed9d700 1 -- 172.21.15.81:0/2822387803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f8014c520 msgr2=0x7f3f80147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.499+0000 7f3f7ed9d700 1 --2- 172.21.15.81:0/2822387803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f8014c520 0x7f3f80147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.499+0000 7f3f7ed9d700 1 -- 172.21.15.81:0/2822387803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8014d110 con 0x7f3f68003c30 2023-10-25T23:45:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.499+0000 7f3f7ed9d700 1 --2- 172.21.15.81:0/2822387803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f68003c30 0x7f3f8014e160 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800baf0 tx=0x7f3f70003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.499+0000 7f3f677fe700 1 -- 172.21.15.81:0/2822387803 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f70015040 con 0x7f3f68003c30 2023-10-25T23:45:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.499+0000 7f3f677fe700 1 -- 172.21.15.81:0/2822387803 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3f7000c560 con 0x7f3f68003c30 2023-10-25T23:45:53.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.499+0000 7f3f85162700 1 -- 172.21.15.81:0/2822387803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8014d3f0 con 0x7f3f68003c30 2023-10-25T23:45:53.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.499+0000 7f3f677fe700 1 -- 172.21.15.81:0/2822387803 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7000c970 con 0x7f3f68003c30 2023-10-25T23:45:53.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.499+0000 7f3f85162700 1 -- 172.21.15.81:0/2822387803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8014d6d0 con 0x7f3f68003c30 2023-10-25T23:45:53.509 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.500+0000 7f3f85162700 1 -- 172.21.15.81:0/2822387803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f8004e4c0 con 0x7f3f68003c30 2023-10-25T23:45:53.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.501+0000 7f3f677fe700 1 -- 172.21.15.81:0/2822387803 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3f7000cad0 con 0x7f3f68003c30 2023-10-25T23:45:53.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.501+0000 7f3f677fe700 1 --2- 172.21.15.81:0/2822387803 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f3f6c06af00 0x7f3f6c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-25T23:45:53.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.501+0000 7f3f677fe700 1 -- 172.21.15.81:0/2822387803 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f3f7008aa30 con 0x7f3f68003c30 2023-10-25T23:45:53.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.501+0000 7f3f7e59c700 1 --2- 172.21.15.81:0/2822387803 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f3f6c06af00 0x7f3f6c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-25T23:45:53.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.501+0000 7f3f7e59c700 1 --2- 172.21.15.81:0/2822387803 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f3f6c06af00 0x7f3f6c06d3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3f80149b60 tx=0x7f3f74009260 comp rx=0 tx=0).ready entity=mgr.4133 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-25T23:45:53.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.505+0000 7f3f677fe700 1 -- 172.21.15.81:0/2822387803 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3f70055c50 con 0x7f3f68003c30 2023-10-25T23:45:53.700 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:53.699+0000 7f3f85162700 1 -- 172.21.15.81:0/2822387803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3f80147950 con 0x7f3f68003c30 2023-10-25T23:45:54.337 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:54.335+0000 7f3f677fe700 1 -- 172.21.15.81:0/2822387803 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3f80147950 con 0x7f3f68003c30 2023-10-25T23:45:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:54.337+0000 7f3f85162700 1 -- 172.21.15.81:0/2822387803 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f3f6c06af00 msgr2=0x7f3f6c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:54.337+0000 7f3f85162700 1 --2- 172.21.15.81:0/2822387803 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f3f6c06af00 0x7f3f6c06d3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3f80149b60 tx=0x7f3f74009260 comp rx=0 tx=0).stop 2023-10-25T23:45:54.339 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:54.337+0000 7f3f85162700 1 -- 172.21.15.81:0/2822387803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f68003c30 msgr2=0x7f3f8014e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-25T23:45:54.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:54.337+0000 7f3f85162700 1 --2- 172.21.15.81:0/2822387803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f68003c30 0x7f3f8014e160 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800baf0 tx=0x7f3f70003910 comp rx=0 tx=0).stop 2023-10-25T23:45:54.340 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:54.337+0000 7f3f85162700 1 -- 172.21.15.81:0/2822387803 shutdown_connections 2023-10-25T23:45:54.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:54.337+0000 7f3f85162700 1 --2- 172.21.15.81:0/2822387803 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f800b6ef0 0x7f3f800b7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:54.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:54.337+0000 7f3f85162700 1 --2- 172.21.15.81:0/2822387803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f68003c30 0x7f3f8014e160 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:54.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:54.337+0000 7f3f85162700 1 --2- 172.21.15.81:0/2822387803 >> [v2:172.21.15.89:6832/3905428844,v1:172.21.15.89:6833/3905428844] conn(0x7f3f6c06af00 0x7f3f6c06d3c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:54.341 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:54.337+0000 7f3f85162700 1 --2- 172.21.15.81:0/2822387803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f8014c520 0x7f3f80147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-25T23:45:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:54.337+0000 7f3f85162700 1 -- 172.21.15.81:0/2822387803 >> 172.21.15.81:0/2822387803 conn(0x7f3f8006b320 msgr2=0x7f3f8014a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-25T23:45:54.342 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:54.338+0000 7f3f85162700 1 -- 172.21.15.81:0/2822387803 shutdown_connections 2023-10-25T23:45:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:2023-10-25T23:45:54.339+0000 7f3f85162700 1 -- 172.21.15.81:0/2822387803 wait complete. 2023-10-25T23:45:54.343 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2023-10-25T23:45:54.366 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-25T23:45:54.367 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-25T23:45:54.367 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T23:45:54.383 INFO:tasks.ceph.mds.a:Stopped 2023-10-25T23:45:54.383 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-25T23:45:54.384 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T23:45:54.441 INFO:tasks.ceph.mds.c:Stopped 2023-10-25T23:45:54.441 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-25T23:45:54.442 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T23:45:54.461 INFO:tasks.ceph.mds.b:Stopped 2023-10-25T23:45:54.462 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-25T23:45:54.462 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T23:45:54.510 INFO:tasks.ceph.mds.d:Stopped 2023-10-25T23:45:54.511 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-25T23:45:54.511 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-25T23:45:54.511 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T23:45:54.559 INFO:tasks.ceph.osd.0:Stopped 2023-10-25T23:45:54.560 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-25T23:45:54.560 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T23:45:54.606 INFO:tasks.ceph.osd.1:Stopped 2023-10-25T23:45:54.606 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-25T23:45:54.607 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T23:45:54.651 INFO:tasks.ceph.osd.2:Stopped 2023-10-25T23:45:54.652 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-25T23:45:54.652 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T23:45:54.692 INFO:tasks.ceph.osd.3:Stopped 2023-10-25T23:45:54.692 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-25T23:45:54.692 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T23:45:54.735 INFO:tasks.ceph.osd.4:Stopped 2023-10-25T23:45:54.736 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-25T23:45:54.736 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T23:45:54.785 INFO:tasks.ceph.osd.5:Stopped 2023-10-25T23:45:54.785 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-25T23:45:54.785 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T23:45:54.826 INFO:tasks.ceph.osd.6:Stopped 2023-10-25T23:45:54.827 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-25T23:45:54.827 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T23:45:54.876 INFO:tasks.ceph.osd.7:Stopped 2023-10-25T23:45:54.877 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-25T23:45:54.877 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-25T23:45:54.878 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T23:45:54.901 INFO:tasks.ceph.mgr.y:Stopped 2023-10-25T23:45:54.902 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-25T23:45:54.902 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T23:45:54.925 INFO:tasks.ceph.mgr.x:Stopped 2023-10-25T23:45:54.925 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-25T23:45:54.926 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-25T23:45:54.926 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T23:45:54.952 INFO:tasks.ceph.mon.a:Stopped 2023-10-25T23:45:54.953 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-25T23:45:54.953 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T23:45:54.976 INFO:tasks.ceph.mon.b:Stopped 2023-10-25T23:45:54.977 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-25T23:45:54.977 INFO:teuthology.orchestra.run:waiting for 300 2023-10-25T23:45:55.027 INFO:tasks.ceph.mon.c:Stopped 2023-10-25T23:45:55.027 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-25T23:45:55.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-25T23:45:55.058 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-25T23:45:55.059 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-25T23:45:55.357 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-25T23:45:55.357 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-25T23:45:55.512 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-25T23:45:55.513 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-25T23:45:55.597 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi081.front.sepia.ceph.com 2023-10-25T23:45:55.598 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-25T23:45:55.709 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-25T23:45:55.710 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-25T23:45:56.001 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-25T23:45:56.002 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-25T23:45:56.130 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-25T23:45:56.131 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-25T23:45:56.201 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-25T23:45:56.202 DEBUG:teuthology.orchestra.run.smithi089:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-25T23:45:56.286 INFO:tasks.ceph:Archiving mon data... 2023-10-25T23:45:56.288 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436391/data/mon.a.tgz 2023-10-25T23:45:56.288 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2023-10-25T23:45:56.306 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.2bO5DQMtHH 2023-10-25T23:45:56.307 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.2bO5DQMtHH 2023-10-25T23:45:56.440 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.2bO5DQMtHH 2023-10-25T23:45:56.526 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.2bO5DQMtHH is 256KB 2023-10-25T23:45:56.594 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.2bO5DQMtHH 2023-10-25T23:45:56.612 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436391/data/mon.b.tgz 2023-10-25T23:45:56.612 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-10-25T23:45:56.632 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.uG4UCFDZ9S 2023-10-25T23:45:56.633 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.uG4UCFDZ9S 2023-10-25T23:45:56.758 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.uG4UCFDZ9S 2023-10-25T23:45:56.845 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.uG4UCFDZ9S is 262KB 2023-10-25T23:45:56.942 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.uG4UCFDZ9S 2023-10-25T23:45:56.959 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436391/data/mon.c.tgz 2023-10-25T23:45:56.959 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2023-10-25T23:45:57.015 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.IunG9iI14O 2023-10-25T23:45:57.015 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.IunG9iI14O 2023-10-25T23:45:57.129 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.IunG9iI14O 2023-10-25T23:45:57.213 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.IunG9iI14O is 262KB 2023-10-25T23:45:57.280 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.IunG9iI14O 2023-10-25T23:45:57.296 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-25T23:45:57.297 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-25T23:45:57.299 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-25T23:45:57.362 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-25T23:45:57.363 DEBUG:teuthology.orchestra.run.smithi081:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-25T23:45:57.368 DEBUG:teuthology.orchestra.run.smithi089:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-25T23:45:57.406 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-25T23:45:57.438 INFO:teuthology.orchestra.run.smithi089.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-25T23:45:57.443 INFO:tasks.ceph:Archiving crash dumps... 2023-10-25T23:45:57.446 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436391/remote/smithi081/crash 2023-10-25T23:45:57.447 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-25T23:45:57.479 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436391/remote/smithi089/crash 2023-10-25T23:45:57.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-25T23:45:57.509 INFO:tasks.ceph:Shutting down logrotate 2023-10-25T23:45:57.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:45:57.524 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-25T23:45:57.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-25T23:45:57.620 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-25T23:45:57.659 INFO:tasks.ceph:Compressing logs... 2023-10-25T23:45:57.660 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-25T23:45:57.663 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-25T23:45:57.686 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116581.log 2023-10-25T23:45:57.686 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116054.log 2023-10-25T23:45:57.697 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107497.log 2023-10-25T23:45:57.697 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116581.log: /var/log/ceph/ceph-client.admin.116054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116238.log 2023-10-25T23:45:57.697 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.116581.log.gz 2023-10-25T23:45:57.698 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.116054.log.gz 2023-10-25T23:45:57.698 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116100.log 2023-10-25T23:45:57.698 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107497.log.gz 2023-10-25T23:45:57.698 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108130.log 2023-10-25T23:45:57.699 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116100.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.116238.log.gz 2023-10-25T23:45:57.699 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109522.log 2023-10-25T23:45:57.699 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.116100.log.gz 2023-10-25T23:45:57.700 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100840.log 2023-10-25T23:45:57.700 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.108130.log.gz 2023-10-25T23:45:57.700 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108944.log 2023-10-25T23:45:57.700 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109522.log.gz 2023-10-25T23:45:57.701 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109676.log 2023-10-25T23:45:57.701 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108944.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.100840.log.gz 2023-10-25T23:45:57.701 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108648.log 2023-10-25T23:45:57.701 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.108944.log.gz 2023-10-25T23:45:57.702 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100646.log 2023-10-25T23:45:57.702 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.109676.log.gz 2023-10-25T23:45:57.702 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109295.log 2023-10-25T23:45:57.702 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100646.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108648.log.gz 2023-10-25T23:45:57.703 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-25T23:45:57.703 INFO:teuthology.orchestra.run.smithi081.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.100646.log.gz 2023-10-25T23:45:57.703 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110396.log 2023-10-25T23:45:57.704 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.109295.log.gz 2023-10-25T23:45:57.704 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115732.log 2023-10-25T23:45:57.704 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116703.log 2023-10-25T23:45:57.704 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115732.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110396.log.gz 2023-10-25T23:45:57.705 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108510.log 2023-10-25T23:45:57.705 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.115732.log.gz 2023-10-25T23:45:57.705 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108740.log 2023-10-25T23:45:57.705 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116703.log.gz/var/log/ceph/ceph-client.admin.108510.log: 2023-10-25T23:45:57.706 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109890.log 2023-10-25T23:45:57.706 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108740.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108510.log.gz 2023-10-25T23:45:57.706 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-25T23:45:57.707 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109890.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108740.log.gz 2023-10-25T23:45:57.707 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109675.log 2023-10-25T23:45:57.707 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.109890.log.gz 2023-10-25T23:45:57.707 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108178.log 2023-10-25T23:45:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100906.log 2023-10-25T23:45:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108178.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.109675.log.gz 2023-10-25T23:45:57.708 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108938.log 2023-10-25T23:45:57.709 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108178.log.gz 2023-10-25T23:45:57.709 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115778.log 2023-10-25T23:45:57.709 INFO:teuthology.orchestra.run.smithi081.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.100906.log.gz 2023-10-25T23:45:57.709 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101074.log 2023-10-25T23:45:57.710 INFO:teuthology.orchestra.run.smithi081.stderr: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-25T23:45:57.710 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115778.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.108938.log.gz 2023-10-25T23:45:57.710 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108232.log 2023-10-25T23:45:57.711 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115778.log.gz 2023-10-25T23:45:57.711 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.101074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116422.log 2023-10-25T23:45:57.711 INFO:teuthology.orchestra.run.smithi081.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.101074.log.gz 2023-10-25T23:45:57.712 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108937.log 2023-10-25T23:45:57.712 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108232.log.gz 2023-10-25T23:45:57.712 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109310.log 2023-10-25T23:45:57.712 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108937.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.116422.log.gz 2023-10-25T23:45:57.713 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116192.log 2023-10-25T23:45:57.713 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.108937.log.gz 2023-10-25T23:45:57.713 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109310.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-25T23:45:57.713 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109310.log.gz 2023-10-25T23:45:57.714 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108464.log 2023-10-25T23:45:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.0.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116192.log.gz 2023-10-25T23:45:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110442.log 2023-10-25T23:45:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115434.log 2023-10-25T23:45:57.737 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110442.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108464.log.gz 2023-10-25T23:45:57.738 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100542.log 2023-10-25T23:45:57.738 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.110442.log.gz 2023-10-25T23:45:57.738 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109682.log 2023-10-25T23:45:57.739 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.115434.log.gz 2023-10-25T23:45:57.739 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108418.log 2023-10-25T23:45:57.739 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100542.log: 75.4% -- replaced with /var/log/ceph/ceph-client.admin.100542.log.gz 2023-10-25T23:45:57.739 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110120.log 2023-10-25T23:45:57.740 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108418.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.109682.log.gz 2023-10-25T23:45:57.740 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-25T23:45:57.740 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110120.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108418.log.gz 2023-10-25T23:45:57.741 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115824.log 2023-10-25T23:45:57.741 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.110120.log.gz 2023-10-25T23:45:57.741 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110488.log 2023-10-25T23:45:57.741 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109311.log 2023-10-25T23:45:57.742 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115824.log: /var/log/ceph/ceph-client.admin.110488.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.115824.log.gz 2023-10-25T23:45:57.743 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110488.log.gz 2023-10-25T23:45:57.744 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109311.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109311.log.gz 2023-10-25T23:45:57.744 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109314.log 2023-10-25T23:45:57.744 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110534.log 2023-10-25T23:45:57.745 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108947.log 2023-10-25T23:45:57.745 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.109314.log.gz 2023-10-25T23:45:57.745 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107923.log 2023-10-25T23:45:57.746 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107582.log 2023-10-25T23:45:57.746 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110534.log.gz 2023-10-25T23:45:57.746 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108947.log: 93.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-25T23:45:57.746 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115296.log 2023-10-25T23:45:57.747 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108947.log.gz 2023-10-25T23:45:57.747 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107923.log.gz 2023-10-25T23:45:57.747 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107582.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-25T23:45:57.748 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.107582.log.gz 2023-10-25T23:45:57.748 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109302.log 2023-10-25T23:45:57.748 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115296.log: /var/log/ceph/ceph-osd.3.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.115296.log.gz 2023-10-25T23:45:57.748 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109302.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.109302.log.gz 2023-10-25T23:45:57.749 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108015.log 2023-10-25T23:45:57.749 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108942.log 2023-10-25T23:45:57.749 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101452.log 2023-10-25T23:45:57.750 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.108015.log.gz 2023-10-25T23:45:57.750 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110074.log 2023-10-25T23:45:57.750 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.101452.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.108942.log.gz 2023-10-25T23:45:57.751 INFO:teuthology.orchestra.run.smithi081.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.101452.log.gz 2023-10-25T23:45:57.751 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110074.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110074.log.gz 2023-10-25T23:45:57.751 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117155.log 2023-10-25T23:45:57.753 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100475.log 2023-10-25T23:45:57.753 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109315.log 2023-10-25T23:45:57.753 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.117155.log.gz 2023-10-25T23:45:57.754 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107822.log 2023-10-25T23:45:57.754 INFO:teuthology.orchestra.run.smithi081.stderr: 75.6% -- replaced with /var/log/ceph/ceph-client.admin.100475.log.gz 2023-10-25T23:45:57.754 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116770.log 2023-10-25T23:45:57.755 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109315.log: /var/log/ceph/ceph-client.admin.107822.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.109315.log.gz 2023-10-25T23:45:57.755 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110350.log 2023-10-25T23:45:57.755 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.107822.log.gz 2023-10-25T23:45:57.756 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116770.log: /var/log/ceph/ceph-client.admin.110350.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.116770.log.gz 2023-10-25T23:45:57.756 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110350.log.gz 2023-10-25T23:45:57.757 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109677.log 2023-10-25T23:45:57.757 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100443.log 2023-10-25T23:45:57.758 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109677.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-25T23:45:57.758 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109677.log.gz 2023-10-25T23:45:57.758 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111174.log 2023-10-25T23:45:57.759 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100443.log.gz 2023-10-25T23:45:57.759 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100317.log 2023-10-25T23:45:57.759 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.0.111174.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.0.111174.log.gz--verbose 2023-10-25T23:45:57.759 INFO:teuthology.orchestra.run.smithi081.stderr:-- /var/log/ceph/ceph-client.admin.100379.log 2023-10-25T23:45:57.760 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100257.log 2023-10-25T23:45:57.760 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100317.log.gz 2023-10-25T23:45:57.760 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100379.log.gz 2023-10-25T23:45:57.761 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100257.log.gz 2023-10-25T23:45:57.761 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110028.log 2023-10-25T23:45:57.761 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110304.log 2023-10-25T23:45:57.761 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100411.log 2023-10-25T23:45:57.762 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110028.log.gz 2023-10-25T23:45:57.762 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115640.log 2023-10-25T23:45:57.762 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110304.log.gz 2023-10-25T23:45:57.763 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100411.log.gz 2023-10-25T23:45:57.763 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115640.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.115640.log.gz 2023-10-25T23:45:57.763 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101319.log 2023-10-25T23:45:57.764 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108556.log 2023-10-25T23:45:57.764 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.101319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108694.log 2023-10-25T23:45:57.764 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.101319.log.gz 2023-10-25T23:45:57.764 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109309.log 2023-10-25T23:45:57.765 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.108556.log.gz 2023-10-25T23:45:57.765 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108694.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108694.log.gz 2023-10-25T23:45:57.765 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109309.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.109309.log.gz 2023-10-25T23:45:57.765 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116535.log 2023-10-25T23:45:57.766 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107969.log 2023-10-25T23:45:57.766 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116284.log 2023-10-25T23:45:57.766 INFO:teuthology.orchestra.run.smithi081.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.116535.log.gz 2023-10-25T23:45:57.767 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107969.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-25T23:45:57.767 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107969.log.gz 2023-10-25T23:45:57.767 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116284.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116284.log.gz 2023-10-25T23:45:57.767 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.audit.log: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-25T23:45:57.768 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116468.log 2023-10-25T23:45:57.770 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116814.log 2023-10-25T23:45:57.771 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116376.log 2023-10-25T23:45:57.772 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.116468.log.gz 2023-10-25T23:45:57.772 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116814.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116814.log.gz 2023-10-25T23:45:57.773 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100721.log 2023-10-25T23:45:57.774 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109683.log 2023-10-25T23:45:57.774 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.116376.log.gz 2023-10-25T23:45:57.775 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100721.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.100721.log.gz 2023-10-25T23:45:57.776 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108372.log 2023-10-25T23:45:57.777 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109683.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.94092.log 2023-10-25T23:45:57.777 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109683.log.gz 2023-10-25T23:45:57.778 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108324.log 2023-10-25T23:45:57.778 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108372.log.gz 2023-10-25T23:45:57.778 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.tmp-client.admin.94092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115686.log 2023-10-25T23:45:57.779 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.94092.log.gz 2023-10-25T23:45:57.779 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100836.log 2023-10-25T23:45:57.779 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108324.log.gz 2023-10-25T23:45:57.779 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115686.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.115686.log.gz 2023-10-25T23:45:57.780 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100836.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.100836.log.gz 2023-10-25T23:45:57.780 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109305.log 2023-10-25T23:45:57.780 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108943.log 2023-10-25T23:45:57.781 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109305.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109305.log.gz 2023-10-25T23:45:57.781 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108943.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.108943.log.gz 2023-10-25T23:45:57.781 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116330.log 2023-10-25T23:45:57.781 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100835.log 2023-10-25T23:45:57.782 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115480.log 2023-10-25T23:45:57.782 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.116330.log.gz 2023-10-25T23:45:57.782 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109936.log 2023-10-25T23:45:57.783 INFO:teuthology.orchestra.run.smithi081.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.100835.log.gz 2023-10-25T23:45:57.783 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115480.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115480.log.gz 2023-10-25T23:45:57.783 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117044.log 2023-10-25T23:45:57.784 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.109936.log.gz 2023-10-25T23:45:57.784 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-25T23:45:57.785 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108934.log 2023-10-25T23:45:57.786 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117044.log: /var/log/ceph/ceph-osd.1.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.117044.log.gz 2023-10-25T23:45:57.786 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108934.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108934.log.gz 2023-10-25T23:45:57.786 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107691.log 2023-10-25T23:45:57.787 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108602.log 2023-10-25T23:45:57.787 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107691.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107691.log.gz 2023-10-25T23:45:57.787 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108602.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108602.log.gz 2023-10-25T23:45:57.788 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116998.log 2023-10-25T23:45:57.788 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116906.log 2023-10-25T23:45:57.788 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116998.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.116998.log.gz 2023-10-25T23:45:57.788 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116906.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116906.log.gz 2023-10-25T23:45:57.789 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110258.log 2023-10-25T23:45:57.789 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108936.log 2023-10-25T23:45:57.789 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110258.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.110258.log.gz 2023-10-25T23:45:57.790 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115342.log 2023-10-25T23:45:57.790 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108936.log.gz 2023-10-25T23:45:57.790 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110580.log 2023-10-25T23:45:57.790 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115342.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.115342.log.gz 2023-10-25T23:45:57.791 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117109.log 2023-10-25T23:45:57.791 INFO:teuthology.orchestra.run.smithi081.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.110580.log.gz 2023-10-25T23:45:57.791 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117109.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.117109.log.gz 2023-10-25T23:45:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116952.log 2023-10-25T23:45:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108278.log 2023-10-25T23:45:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116952.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116952.log.gz 2023-10-25T23:45:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108278.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108278.log.gz 2023-10-25T23:45:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115388.log 2023-10-25T23:45:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109679.log 2023-10-25T23:45:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115388.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.115388.log.gz 2023-10-25T23:45:57.794 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109679.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.109679.log.gz 2023-10-25T23:45:57.794 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100347.log 2023-10-25T23:45:57.794 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108061.log 2023-10-25T23:45:57.794 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100347.log: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.100347.log.gz 2023-10-25T23:45:57.795 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.108061.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108061.log.gz 2023-10-25T23:45:57.795 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116146.log 2023-10-25T23:45:57.795 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100843.log 2023-10-25T23:45:57.795 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116146.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.116146.log.gz 2023-10-25T23:45:57.796 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100843.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.100843.log.gz 2023-10-25T23:45:57.796 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110692.log 2023-10-25T23:45:57.796 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100825.log 2023-10-25T23:45:57.797 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110692.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110692.log.gz 2023-10-25T23:45:57.797 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100825.log: gzip -5 86.3%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.100825.log.gz/var/log/ceph/ceph-client.admin.109982.log 2023-10-25T23:45:57.797 INFO:teuthology.orchestra.run.smithi081.stderr: 2023-10-25T23:45:57.798 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107776.log 2023-10-25T23:45:57.810 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109982.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109982.log.gz 2023-10-25T23:45:57.810 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107776.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.107776.log.gz 2023-10-25T23:45:57.811 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115870.log 2023-10-25T23:45:57.811 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-25T23:45:57.811 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115870.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.115870.log.gz 2023-10-25T23:45:57.812 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111182.log 2023-10-25T23:45:57.812 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110166.log 2023-10-25T23:45:57.812 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.111182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.111182.log.gz 2023-10-25T23:45:57.812 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110166.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110166.log.gz 2023-10-25T23:45:57.813 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100846.log 2023-10-25T23:45:57.813 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.100846.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.100846.log.gz 2023-10-25T23:45:57.813 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116860.log 2023-10-25T23:45:57.814 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116860.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116860.log.gz 2023-10-25T23:45:57.814 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-25T23:45:57.814 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mgr.y.log: 94.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-25T23:45:57.814 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107874.log 2023-10-25T23:45:57.815 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.107874.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107874.log.gz 2023-10-25T23:45:57.815 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110212.log 2023-10-25T23:45:57.815 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110212.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110212.log.gz 2023-10-25T23:45:57.815 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109681.log 2023-10-25T23:45:57.816 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109681.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109681.log.gz 2023-10-25T23:45:57.816 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116008.log 2023-10-25T23:45:57.816 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116008.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.116008.log.gz 2023-10-25T23:45:57.817 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115962.log 2023-10-25T23:45:57.817 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115962.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.115962.log.gz 2023-10-25T23:45:57.817 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116636.log 2023-10-25T23:45:57.817 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116636.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.116636.log.gz 2023-10-25T23:45:57.818 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115916.log 2023-10-25T23:45:57.818 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115916.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.115916.log.gz 2023-10-25T23:45:57.818 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100557.log 2023-10-25T23:45:57.819 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-25T23:45:57.819 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-25T23:45:57.819 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.100557.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-25T23:45:57.820 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.5.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.100557.log.gz 2023-10-25T23:45:57.820 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100323.log 2023-10-25T23:45:57.821 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-25T23:45:57.822 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.100323.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-25T23:45:57.823 INFO:teuthology.orchestra.run.smithi089.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.100323.log.gz 2023-10-25T23:45:57.824 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-25T23:45:57.824 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100513.log 2023-10-25T23:45:57.825 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.100513.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.100513.log.gz 2023-10-25T23:45:57.825 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-25T23:45:57.825 INFO:teuthology.orchestra.run.smithi089.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-25T23:45:57.826 INFO:teuthology.orchestra.run.smithi089.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-25T23:45:57.826 INFO:teuthology.orchestra.run.smithi089.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-25T23:45:57.826 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100278.log 2023-10-25T23:45:57.826 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100466.log 2023-10-25T23:45:57.827 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.100278.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.100278.log.gz 2023-10-25T23:45:57.827 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.100466.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-25T23:45:57.827 INFO:teuthology.orchestra.run.smithi089.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.100466.log.gz 2023-10-25T23:45:57.828 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-25T23:45:57.829 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100232.log 2023-10-25T23:45:57.829 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.100232.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.100232.log.gz 2023-10-25T23:45:57.830 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-25T23:45:57.830 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-25T23:45:57.830 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-mds.b.log: 93.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-25T23:45:57.831 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100368.log 2023-10-25T23:45:57.831 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.100368.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.100368.log.gz 2023-10-25T23:45:57.831 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100421.log 2023-10-25T23:45:57.831 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/ceph-client.admin.100421.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.100421.log.gz 2023-10-25T23:45:57.842 INFO:teuthology.orchestra.run.smithi089.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-25T23:45:57.947 INFO:teuthology.orchestra.run.smithi089.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-25T23:45:57.948 INFO:teuthology.orchestra.run.smithi089.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-25T23:45:58.244 INFO:teuthology.orchestra.run.smithi081.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-25T23:46:01.922 INFO:teuthology.orchestra.run.smithi081.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-25T23:46:01.975 INFO:teuthology.orchestra.run.smithi081.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-25T23:46:02.004 INFO:teuthology.orchestra.run.smithi089.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-25T23:46:02.130 INFO:teuthology.orchestra.run.smithi089.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-25T23:46:03.654 INFO:teuthology.orchestra.run.smithi089.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-25T23:46:03.659 INFO:teuthology.orchestra.run.smithi081.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-25T23:46:03.750 INFO:teuthology.orchestra.run.smithi081.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-25T23:46:04.223 INFO:teuthology.orchestra.run.smithi089.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-25T23:46:04.224 INFO:teuthology.orchestra.run.smithi089.stderr: 2023-10-25T23:46:04.225 INFO:teuthology.orchestra.run.smithi089.stderr:real 0m6.495s 2023-10-25T23:46:04.225 INFO:teuthology.orchestra.run.smithi089.stderr:user 0m20.764s 2023-10-25T23:46:04.225 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m0.774s 2023-10-25T23:47:15.984 INFO:teuthology.orchestra.run.smithi081.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-25T23:47:15.986 INFO:teuthology.orchestra.run.smithi081.stderr: 2023-10-25T23:47:15.986 INFO:teuthology.orchestra.run.smithi081.stderr:real 1m18.310s 2023-10-25T23:47:15.986 INFO:teuthology.orchestra.run.smithi081.stderr:user 1m35.869s 2023-10-25T23:47:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m3.346s 2023-10-25T23:47:15.987 INFO:tasks.ceph:Archiving logs... 2023-10-25T23:47:15.988 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436391/remote/smithi081/log 2023-10-25T23:47:15.989 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-25T23:47:44.349 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436391/remote/smithi089/log 2023-10-25T23:47:44.350 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-25T23:47:47.391 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-25T23:47:47.401 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-25T23:47:47.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-25T23:47:47.405 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-25T23:47:47.500 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-25T23:47:47.510 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-25T23:47:47.510 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-25T23:47:47.513 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-25T23:47:47.529 INFO:teuthology.orchestra.run.smithi081.stderr:bash: ntpq: command not found 2023-10-25T23:47:47.532 INFO:teuthology.orchestra.run.smithi089.stderr:bash: ntpq: command not found 2023-10-25T23:47:47.534 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-25T23:47:47.534 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2023-10-25T23:47:47.534 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 55 +1838us[+1838us] +/- 95ms 2023-10-25T23:47:47.535 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv02.front.sepia.ceph.com 3 6 377 57 -1026us[-1027us] +/- 64ms 2023-10-25T23:47:47.535 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 -186us[ -186us] +/- 68ms 2023-10-25T23:47:47.535 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-25T23:47:47.537 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-25T23:47:47.538 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2023-10-25T23:47:47.538 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 56 +1839us[+1836us] +/- 95ms 2023-10-25T23:47:47.538 INFO:teuthology.orchestra.run.smithi089.stdout:^* hv02.front.sepia.ceph.com 3 6 377 55 -1027us[-1030us] +/- 64ms 2023-10-25T23:47:47.538 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 -189us[ -192us] +/- 68ms 2023-10-25T23:47:47.539 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-25T23:47:47.539 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-25T23:47:47.551 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-25T23:47:47.552 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-25T23:47:47.597 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-25T23:47:47.697 DEBUG:teuthology.orchestra.run.smithi089:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-25T23:47:47.795 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-25T23:47:47.828 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T23:47:47.829 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-25T23:47:47.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T23:47:47.862 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-25T23:47:47.874 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-25T23:47:47.897 INFO:teuthology.task.internal:Duration was 1428.973908 seconds 2023-10-25T23:47:47.897 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-25T23:47:47.931 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-25T23:47:47.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-25T23:47:47.934 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-25T23:47:47.979 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-25T23:47:47.981 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-25T23:47:48.207 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-25T23:47:48.208 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2023-10-25T23:47:48.208 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-25T23:47:48.230 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2023-10-25T23:47:48.230 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-25T23:47:48.251 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-25T23:47:48.252 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-25T23:47:48.273 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-25T23:47:48.332 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-25T23:47:48.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-25T23:47:48.355 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-25T23:47:48.444 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-25T23:47:48.454 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-25T23:47:48.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-25T23:47:48.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-25T23:47:48.507 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-25T23:47:48.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-25T23:47:48.523 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-25T23:47:48.547 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2023-10-25T23:47:48.573 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2023-10-25T23:47:48.598 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-25T23:47:48.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T23:47:48.618 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-25T23:47:48.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-25T23:47:48.654 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-25T23:47:48.664 INFO:teuthology.task.internal:Transferring archived files... 2023-10-25T23:47:48.666 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436391/remote/smithi081 2023-10-25T23:47:48.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-25T23:47:48.705 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436391/remote/smithi089 2023-10-25T23:47:48.706 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-25T23:47:48.742 INFO:teuthology.task.internal:Removing archive directory... 2023-10-25T23:47:48.743 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-25T23:47:48.745 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-25T23:47:48.793 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-25T23:47:48.804 INFO:teuthology.task.internal:Not uploading archives. 2023-10-25T23:47:48.804 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-25T23:47:48.831 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-25T23:47:48.832 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-25T23:47:48.834 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-25T23:47:48.849 INFO:teuthology.orchestra.run.smithi081.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 25 23:47 /home/ubuntu/cephtest 2023-10-25T23:47:48.851 INFO:teuthology.orchestra.run.smithi089.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 25 23:47 /home/ubuntu/cephtest 2023-10-25T23:47:48.852 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-25T23:47:48.869 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-25T23:47:48.931 INFO:teuthology.nuke:Checking targets against current locks 2023-10-25T23:47:48.956 DEBUG:teuthology.nuke:shortname: smithi081 2023-10-25T23:47:48.957 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-25T23:47:48.980 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436391', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 23:18:37.973011', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-25T23:47:48.983 DEBUG:teuthology.nuke:shortname: smithi089 2023-10-25T23:47:48.983 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-25T23:47:49.002 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-10-24_19:52:40-fs-wip-batrick-testing-20231024.144545-distro-default-smithi/7436391', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-25 23:18:37.974450', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-25T23:47:49.034 INFO:teuthology.orchestra.console.smithi081:Power off 2023-10-25T23:47:49.035 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T23:47:49.060 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-10-25T23:47:49.061 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T23:47:49.076 INFO:teuthology.orchestra.console.smithi089:Power off 2023-10-25T23:47:49.077 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-25T23:47:49.087 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-10-25T23:47:49.099 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off 2023-10-25T23:47:49.099 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T23:47:49.122 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-10-25T23:47:53.088 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T23:47:53.123 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T23:47:53.199 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-10-25T23:47:53.236 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on 2023-10-25T23:47:57.202 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T23:47:57.237 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T23:47:57.313 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-10-25T23:47:57.348 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off 2023-10-25T23:47:57.449 INFO:teuthology.orchestra.console.smithi089:Power off completed 2023-10-25T23:48:01.317 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-25T23:48:01.427 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-10-25T23:48:01.528 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-10-25T23:48:01.635 INFO:teuthology.run:Summary data: description: fs/snaps/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} duration: 1428.9739084243774 failure_reason: 'Command failed (workunit test fs/snaps/snaptest-multiple-capsnaps.sh) on smithi081 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=384993681abceb8cb8affea10538d607052db4b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-multiple-capsnaps.sh''' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=aeedaf5b85f94e20861cfe8bb8778dfb status: fail success: false 2023-10-25T23:48:01.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-25T23:48:01.709 INFO:teuthology.run:FAIL